-- Logs begin at Wed 2022-06-22 09:19:30 UTC, end at Wed 2022-06-22 10:44:51 UTC. -- Jun 22 09:58:05.341933 dv-cinder-843277-5-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 22 09:58:05.349798 dv-cinder-843277-5-iscsi devstack@keystone.service[80487]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 22 09:58:05.351778 dv-cinder-843277-5-iscsi devstack@keystone.service[80487]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 22 09:58:05 2022] *** Jun 22 09:58:05.351778 dv-cinder-843277-5-iscsi devstack@keystone.service[80487]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 22 09:58:05.351778 dv-cinder-843277-5-iscsi devstack@keystone.service[80487]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 22 09:58:05.351778 dv-cinder-843277-5-iscsi devstack@keystone.service[80487]: nodename: dv-cinder-843277-5-iscsi Jun 22 09:58:05.351778 dv-cinder-843277-5-iscsi devstack@keystone.service[80487]: machine: x86_64 Jun 22 09:58:05.351778 dv-cinder-843277-5-iscsi devstack@keystone.service[80487]: clock source: unix Jun 22 09:58:05.351778 dv-cinder-843277-5-iscsi devstack@keystone.service[80487]: pcre jit disabled Jun 22 09:58:05.351778 dv-cinder-843277-5-iscsi devstack@keystone.service[80487]: detected number of CPU cores: 4 Jun 22 09:58:05.352297 dv-cinder-843277-5-iscsi devstack@keystone.service[80487]: current working directory: / Jun 22 09:58:05.352297 dv-cinder-843277-5-iscsi devstack@keystone.service[80487]: detected binary path: /usr/bin/uwsgi-core Jun 22 09:58:05.352297 dv-cinder-843277-5-iscsi devstack@keystone.service[80487]: your processes number limit is 47680 Jun 22 09:58:05.352297 dv-cinder-843277-5-iscsi devstack@keystone.service[80487]: your memory page size is 4096 bytes Jun 22 09:58:05.352297 dv-cinder-843277-5-iscsi devstack@keystone.service[80487]: detected max file descriptor number: 2048 Jun 22 09:58:05.352297 dv-cinder-843277-5-iscsi devstack@keystone.service[80487]: lock engine: pthread robust mutexes Jun 22 09:58:05.352297 dv-cinder-843277-5-iscsi devstack@keystone.service[80487]: thunder lock: enabled Jun 22 09:58:05.352297 dv-cinder-843277-5-iscsi devstack@keystone.service[80487]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 22 09:58:05.352297 dv-cinder-843277-5-iscsi devstack@keystone.service[80487]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 22 09:58:05.396378 dv-cinder-843277-5-iscsi devstack@keystone.service[80487]: Python main interpreter initialized at 0x558d5c37e9c0 Jun 22 09:58:05.396378 dv-cinder-843277-5-iscsi devstack@keystone.service[80487]: python threads support enabled Jun 22 09:58:05.396378 dv-cinder-843277-5-iscsi devstack@keystone.service[80487]: your server socket listen backlog is limited to 100 connections Jun 22 09:58:05.396378 dv-cinder-843277-5-iscsi devstack@keystone.service[80487]: your mercy for graceful operations on workers is 90 seconds Jun 22 09:58:05.396766 dv-cinder-843277-5-iscsi devstack@keystone.service[80487]: mapped 403077 bytes (393 KB) for 2 cores Jun 22 09:58:05.396985 dv-cinder-843277-5-iscsi devstack@keystone.service[80487]: *** Operational MODE: preforking *** Jun 22 09:58:05.397317 dv-cinder-843277-5-iscsi devstack@keystone.service[80487]: *** uWSGI is running in multiple interpreter mode *** Jun 22 09:58:05.397317 dv-cinder-843277-5-iscsi devstack@keystone.service[80487]: spawned uWSGI master process (pid: 80487) Jun 22 09:58:05.397480 dv-cinder-843277-5-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 22 09:58:05.404758 dv-cinder-843277-5-iscsi devstack@keystone.service[80487]: spawned uWSGI worker 1 (pid: 80499, cores: 1) Jun 22 09:58:05.404758 dv-cinder-843277-5-iscsi devstack@keystone.service[80487]: spawned uWSGI worker 2 (pid: 80500, cores: 1) Jun 22 09:58:05.404758 dv-cinder-843277-5-iscsi devstack@keystone.service[80487]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 22 09:58:10.867452 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 09:58:10.867452 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: from cryptography.utils import int_from_bytes Jun 22 09:58:10.872652 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 09:58:10.872652 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: from cryptography.utils import int_from_bytes Jun 22 09:58:10.872797 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 09:58:10.872797 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: from cryptography.utils import int_from_bytes Jun 22 09:58:10.872797 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 09:58:10.872797 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: from cryptography.utils import int_from_bytes Jun 22 09:58:10.916947 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 09:58:10.917112 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 09:58:10.917252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] command line args: [] {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 09:58:10.917539 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 09:58:10.917721 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ================================================================================ {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 09:58:10.917984 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] admin_token = **** {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.918234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] config_dir = [] {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.918421 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.918602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] config_source = [] {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.918781 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] debug = True {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.918978 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.919471 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.919564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.919776 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.919869 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 09:58:10.919976 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 09:58:10.920078 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.920193 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] command line args: [] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 09:58:10.920295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] list_limit = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.920396 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] log_config_append = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.920495 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 09:58:10.920595 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.920734 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ================================================================================ {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 09:58:10.920875 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] log_dir = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.920987 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] admin_token = **** {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.921091 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] log_file = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.921197 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] config_dir = [] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.921298 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.921430 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.921559 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.921640 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] config_source = [] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.921756 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.921837 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] debug = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.921837 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.922055 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.922055 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.922240 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.922314 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.922436 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.922519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.922597 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.922719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.922804 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.922881 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.923002 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] list_limit = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.923084 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.923161 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] log_config_append = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.923312 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.923398 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.923498 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] log_dir = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.923582 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.923683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] log_file = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.923767 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.923959 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.924091 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.924220 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.924301 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.924476 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.924747 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.924862 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.924998 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] publish_errors = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.925080 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.925195 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.925314 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.925395 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.925478 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.925659 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.925743 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.925823 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.925946 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.926026 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.926188 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.926277 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] standard_threads = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.926428 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.926506 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.926668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.926753 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.926823 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.926922 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.927000 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] use_journal = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.927165 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] use_json = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.927262 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.927342 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] use_stderr = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.927445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.927530 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] use_syslog = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.927719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.927953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.928040 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.928141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] publish_errors = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.928225 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.928381 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.928465 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.928613 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.928695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.928789 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.928927 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.929070 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.929155 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.929313 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.929398 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.929554 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] standard_threads = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.929633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.929823 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.930157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.930284 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.930365 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.930436 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.930506 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.930584 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] use_journal = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.930655 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.930733 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] use_json = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.930733 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] use_stderr = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.930873 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.930945 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] use_syslog = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.931021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.931138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 09:58:10.931231 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.931400 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.931479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.931646 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.931723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.931913 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.932001 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.932161 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.932243 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.932407 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.932483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.932644 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.932735 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.932921 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.933015 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.933167 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.933251 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.933425 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.933512 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.933672 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.933755 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.933908 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.933991 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.934139 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.934292 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.934378 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.934455 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.934591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.934669 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.934839 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.934925 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.935087 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.935165 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.935320 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.935408 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.935549 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.935634 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.935796 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.935880 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.936041 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.936126 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.936295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.936378 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.936546 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.936630 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.936778 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.936912 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.947704 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.947885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.947968 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.948046 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.948117 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.948193 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.948268 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.948268 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.948384 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.948442 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.948534 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.948600 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.948666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.948724 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.948781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.948872 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.948941 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.948998 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.949066 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.949125 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.949181 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.949243 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.949307 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.949366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.949433 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.949492 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.949556 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.949614 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.949671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.949733 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.949791 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.949858 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.949922 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.949980 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.950045 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.950115 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.950189 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.950268 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.950341 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.950413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.950478 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.950546 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.950610 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.950692 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.950764 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.950830 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.950830 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.950965 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.951037 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.951103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.951167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.951237 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.951302 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.951374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.951439 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.951509 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.951579 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.951644 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.951713 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.951777 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.951841 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.952413 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.952413 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.952556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.952620 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.952727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.952727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.952960 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.953043 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.953121 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.953199 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.953271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.953347 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.953421 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.953486 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.953556 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.953621 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.953692 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.953757 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.953903 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.953978 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.954043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.954115 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.954186 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.954256 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.954333 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.954415 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.954499 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.954577 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.954649 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.954720 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.954791 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.954860 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.954938 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.955009 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.955080 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.955150 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.955220 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.955297 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.955369 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.955439 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.955439 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.955563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.955632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.955709 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.955788 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.955859 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.955934 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.956005 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.956074 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.956151 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.956222 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.956292 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.956361 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.956436 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.956506 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.956586 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.956657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.956727 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.956796 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.956883 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.956955 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.957037 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.957115 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.957186 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.957256 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.957332 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.957402 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.957483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.957560 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] auth.external = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.957630 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.957700 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.957769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.957943 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.958027 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.958111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.958216 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.958297 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] auth.password = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.958370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.958447 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] auth.token = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.958527 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.958605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.958677 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.958747 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.958817 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.958887 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.958994 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.959071 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.959143 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.959220 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.959291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.959368 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.959469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.959550 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.959631 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.959703 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] credential.caching = True {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.959770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.959834 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.959910 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.959991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.960072 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.960150 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.960150 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.960280 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.960358 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.960436 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.960515 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.960592 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] auth.external = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.960592 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.960720 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.960720 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.960865 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.960960 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.961034 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.961104 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.961181 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] auth.password = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.961252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.961322 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] auth.token = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.961400 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.961471 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.961541 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.961617 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.961689 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.961759 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.961836 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.961908 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.961978 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] federation.caching = True {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.962059 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.962132 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.962202 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.962346 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.962426 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.962497 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.962574 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] credential.caching = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.962656 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.962979 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.963063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.963136 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.963208 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.963208 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.963341 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.963412 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.963494 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.963566 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.963636 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.963706 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.963776 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.963854 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.963925 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.963995 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] identity.caching = True {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.964065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.964140 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.964236 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.964351 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.964418 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.964477 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.964542 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.964616 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.964687 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.964766 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.964866 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.964942 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.965013 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.965083 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.965083 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.965223 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.965297 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.965367 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] federation.caching = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.965437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.965507 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.965584 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.965666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.965739 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.965809 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.965879 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.965949 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.966019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.966097 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.966170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.966240 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.966310 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.966380 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.966451 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.966561 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.966633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.966704 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.966775 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.966892 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.967010 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.967139 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.967245 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.967386 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity.caching = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.967465 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.967722 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.968294 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.968462 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.968544 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.968710 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.968790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.968972 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.969052 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.971655 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.971733 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.971794 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.971851 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.971923 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.971982 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.972069 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.972142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.972212 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.972282 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.972352 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.972421 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.972500 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.972572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.972637 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.972696 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.972752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.972810 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.972951 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.973025 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.973096 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.973165 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.973235 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.973305 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.973384 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.973455 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.973525 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.973595 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.973665 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.973746 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.973819 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.973889 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.973959 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.974029 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.974099 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.974177 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.974249 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.974351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.974426 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.974503 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.974575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.974654 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.974726 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.974796 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.974866 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.974866 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.974993 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.975072 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.user = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.975145 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.975215 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.975284 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.975353 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.975423 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.975500 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.975572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.975642 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.975711 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.975828 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.975946 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.976076 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.976189 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.976312 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.976446 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.976546 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.976688 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.976775 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.976960 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.977043 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.977216 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.977295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.977468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.977560 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.977713 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.977792 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.977956 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.978034 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.978202 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.978288 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.978448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.978527 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.978689 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.978767 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.978919 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.979005 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.979175 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.979253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.979412 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.979490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.979664 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.979761 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.979885 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.979964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.980122 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.980201 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.980358 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.980445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.980604 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.980682 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.980904 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.980998 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.981133 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.981225 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.981343 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.981423 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.981588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.981667 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.981825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.981912 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.982061 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.982141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.982298 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.982377 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.982545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.982632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.982787 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.982867 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.983020 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.983127 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.983311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.983466 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.983541 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] resource.caching = True {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.983612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.983793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.983872 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.984042 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.984129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.984285 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.984365 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.984536 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.984614 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.984774 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.984881 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.985037 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.985116 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.985285 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.985364 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.985524 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.985611 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.985762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.985840 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.986000 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] role.caching = True {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.986079 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.986248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] role.driver = sql {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.986336 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.986480 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.986562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.986819 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.986904 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.986965 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.987102 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.987219 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.987290 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.987469 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.987550 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.987719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.987800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.987971 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.988056 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.988217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.988297 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.988462 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.988544 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.988700 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.988780 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.988961 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.989041 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.989208 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.989290 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.989456 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.989535 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] resource.caching = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.989707 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.989786 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.989962 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.990137 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.990207 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.990375 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.990461 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.990629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.990717 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.990881 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.990961 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.991132 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.991211 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.991383 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.991470 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.991623 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.991715 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.991862 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] role.caching = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.991941 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.992111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.992199 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] role.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.992349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.992461 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.992564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.992698 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.992800 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.992992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.993075 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.993253 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.993333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.993508 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.993588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.993767 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.993847 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.994003 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.994082 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.994247 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.994325 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.994479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.994559 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.994717 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] token.caching = True {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.994796 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.994954 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.995041 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.995201 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.995280 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.995438 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.995517 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.995694 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.995787 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.995944 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.996133 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.996212 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.996384 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.996463 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.996647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.996726 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.996924 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.997010 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.997166 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.997245 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.997404 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.997486 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.997641 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.997719 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.997888 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.997966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.998139 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.998219 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.998368 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.998504 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.998632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.998731 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.998919 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.998990 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.999159 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.999238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] database.connection = **** {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.999414 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.999501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.999662 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.999751 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.999900 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:10.999980 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.000143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.000223 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.000380 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.000467 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.000617 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.000695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.000874 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.000959 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] token.caching = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.001115 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.001209 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.001370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.001449 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.001608 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.001686 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.001859 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.001947 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.002122 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.002243 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.002380 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.002461 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.002615 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.002705 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.002863 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.002943 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.003098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.003187 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.003338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.003426 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.003574 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.003653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.003745 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 09:58:11.003826 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.004055 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.004315 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.004552 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.004803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.005133 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.005406 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.connection = **** {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.006040 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.006040 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.006273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.006500 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.006746 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.006993 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.007239 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.007484 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.007738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.007981 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.008232 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.008474 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.008730 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.009004 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.009257 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.009496 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.009821 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.010071 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 09:58:11.010245 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 09:58:11.035303 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.035533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.035769 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.037887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.038127 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.038365 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.044356 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.047020 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.072547 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.072855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.073638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.073880 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.226108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.226286 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.275311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.275540 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.276061 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.276308 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.339645 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.339874 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.339965 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.340103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.340210 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.340326 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.340410 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.340548 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.340630 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.340768 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.340882 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.341021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.366013 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.366244 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.366446 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.366550 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.366686 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.366769 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.366907 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.366989 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.367127 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.367209 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.367345 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.367426 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.367566 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.367790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.378891 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.379270 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.392305 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.392534 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.392617 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.392761 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.392918 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.393004 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.393194 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.393276 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.393428 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.393589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.393665 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80499) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.393737 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.393859 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.394116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 09:58:11.410842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.410998 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.411081 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 09:58:11.411217 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 09:58:11.411376 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.411556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.411638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 09:58:11.411763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 09:58:11.411843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.412034 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.412124 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.412299 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.412380 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.412559 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.412638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.413006 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.424417 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.424764 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.425066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.425150 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.425352 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.425451 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.425618 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.425900 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.433810 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.434195 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.437213 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.437498 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.437578 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.437785 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.437867 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.438071 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.438165 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.438355 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.438436 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.438617 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.438719 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.438888 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.438976 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.439157 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.439237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.439426 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.439520 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.439693 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.439772 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.439962 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.440041 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.440224 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.467516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.467741 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.469189 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.469409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.469496 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.469692 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.474701 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.474995 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.475083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.475355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.475451 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.475668 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.482681 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.482915 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.483085 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.483895 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.487937 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.488214 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.488446 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.488530 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.488737 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.488860 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.489038 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.489121 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.489313 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.489397 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.489581 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.489666 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.489848 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.489931 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.490118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.490390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.509094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.509366 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.509934 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.510217 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.513947 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.514949 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.517622 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.518029 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.518622 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.519027 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.523035 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.524193 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.526682 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.527828 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.530387 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.530686 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.530972 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.531243 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.531514 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.531605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.531788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.531872 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.532131 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.532422 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.532705 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.533010 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.551378 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.551661 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.551927 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.552200 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.552918 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.553207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.553478 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.553754 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.560085 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.562304 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.562403 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.562627 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.564026 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.564306 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.565845 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.566129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.566413 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.566724 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.567021 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.567663 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.567970 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.568281 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.568598 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.568951 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.580305 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.580585 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.580886 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.581170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.582495 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.582779 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.582876 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.583070 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.583153 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.583354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.583444 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.585046 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.585343 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.585634 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.601491 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.604087 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.604764 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.607422 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.608057 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.610319 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.611345 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.611951 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.612228 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.612507 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.613119 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.614772 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.615060 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.615347 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.619819 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.621435 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.622793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.624976 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.625198 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.625487 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.625875 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.626153 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.628240 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.628534 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.628964 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.629250 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.635257 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.635544 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.635823 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.638437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.638735 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.639030 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.643855 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80499) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.644137 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.644412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.644684 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.644979 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.645371 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.645647 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.645926 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.646197 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.646473 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.646750 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.647004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 09:58:11.647143 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.647271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.647394 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.647519 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80499) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.647643 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.647821 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.648102 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.648482 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.648779 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.649080 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.649358 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.649638 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.649915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.650181 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.650461 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.650734 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 09:58:11.685701 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558d5c37e9c0 pid: 80499 (default app) Jun 22 09:58:11.689769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6583b3-01b3-45b6-b850-3c868d4c2cd2 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:11.689922 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558d5c37e9c0 pid: 80500 (default app) Jun 22 09:58:11.690059 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6583b3-01b3-45b6-b850-3c868d4c2cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:11.690337 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6583b3-01b3-45b6-b850-3c868d4c2cd2 None None] PATH_INFO: `/v3` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:11.694562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 791 bytes} [Wed Jun 22 09:58:11 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:20.358040 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd329708-77cc-4407-adce-bb381f1a5ec0 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:20.358566 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd329708-77cc-4407-adce-bb381f1a5ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:20.358651 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd329708-77cc-4407-adce-bb381f1a5ec0 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:20.362960 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1/2] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 09:58:20.368878 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e30e42-88a4-4a88-9f3c-223a24ef8e83 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:20.369263 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e30e42-88a4-4a88-9f3c-223a24ef8e83 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:20.369441 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e30e42-88a4-4a88-9f3c-223a24ef8e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:20.438902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: INFO dbcounter [None req-b5e30e42-88a4-4a88-9f3c-223a24ef8e83 None None] Registered counter for database keystone Jun 22 09:58:20.459853 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG oslo_db.sqlalchemy.engines [None req-b5e30e42-88a4-4a88-9f3c-223a24ef8e83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80499) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 09:58:20.466362 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writer thread running {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 09:58:20.646921 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG passlib.handlers.bcrypt [None req-b5e30e42-88a4-4a88-9f3c-223a24ef8e83 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80499) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 22 09:58:20.647246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG passlib.handlers.bcrypt [None req-b5e30e42-88a4-4a88-9f3c-223a24ef8e83 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80499) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 22 09:58:20.702750 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-b5e30e42-88a4-4a88-9f3c-223a24ef8e83 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:20.704354 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-b5e30e42-88a4-4a88-9f3c-223a24ef8e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:20.825483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 2/3] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 22 09:58:20.974580 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd329708-77cc-4407-adce-bb381f1a5ec0 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:21.044384 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: INFO dbcounter [None req-cd329708-77cc-4407-adce-bb381f1a5ec0 None None] Registered counter for database keystone Jun 22 09:58:21.063724 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG oslo_db.sqlalchemy.engines [None req-cd329708-77cc-4407-adce-bb381f1a5ec0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 09:58:21.070115 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writer thread running {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 09:58:21.189102 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd329708-77cc-4407-adce-bb381f1a5ec0 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:21.193331 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83660cb1-ff54-4aa5-81f1-eaeebbe9d7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:21.193986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83660cb1-ff54-4aa5-81f1-eaeebbe9d7ed admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:21.194269 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83660cb1-ff54-4aa5-81f1-eaeebbe9d7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:21.194543 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83660cb1-ff54-4aa5-81f1-eaeebbe9d7ed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:21.203300 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83660cb1-ff54-4aa5-81f1-eaeebbe9d7ed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:21.255729 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: WARNING keystone.common.rbac_enforcer.enforcer [None req-83660cb1-ff54-4aa5-81f1-eaeebbe9d7ed admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 22 09:58:21.256001 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83660cb1-ff54-4aa5-81f1-eaeebbe9d7ed admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:21.266634 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 2/4] 10.222.0.46 () {58 vars in 1324 bytes} [Wed Jun 22 09:58:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 09:58:21.272587 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e30e42-88a4-4a88-9f3c-223a24ef8e83 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:21.287394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e30e42-88a4-4a88-9f3c-223a24ef8e83 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:21.291846 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92d82c-c314-44ce-9b22-5439e603e02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:21.293071 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92d82c-c314-44ce-9b22-5439e603e02e admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:21.293359 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92d82c-c314-44ce-9b22-5439e603e02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:21.293637 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92d82c-c314-44ce-9b22-5439e603e02e admin admin] PATH_INFO: `/v3/projects/40e8688682434d2c9756b8751cda6e48` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:21.298306 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92d82c-c314-44ce-9b22-5439e603e02e admin admin] RBAC: Authorizing `identity:get_project(project_id=40e8688682434d2c9756b8751cda6e48)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:21.349269 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9a92d82c-c314-44ce-9b22-5439e603e02e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 22 09:58:21.349609 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92d82c-c314-44ce-9b22-5439e603e02e admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:21.354312 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 3/5] 10.222.0.46 () {56 vars in 1207 bytes} [Wed Jun 22 09:58:21 2022] GET /identity/v3/projects/40e8688682434d2c9756b8751cda6e48 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:23.398811 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a0b1a-c3a4-4421-a3e9-2c9cf5f5fae8 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:23.399327 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a0b1a-c3a4-4421-a3e9-2c9cf5f5fae8 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:23.399414 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a0b1a-c3a4-4421-a3e9-2c9cf5f5fae8 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:23.403543 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 3/6] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 09:58:23.409946 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f1414-1356-4342-923b-73b1c0665066 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:23.410418 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f1414-1356-4342-923b-73b1c0665066 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:23.410501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f1414-1356-4342-923b-73b1c0665066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:23.429230 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-221f1414-1356-4342-923b-73b1c0665066 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:23.430782 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-221f1414-1356-4342-923b-73b1c0665066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:23.438843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 4/7] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 22 09:58:23.461409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a0b1a-c3a4-4421-a3e9-2c9cf5f5fae8 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:23.474355 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a0b1a-c3a4-4421-a3e9-2c9cf5f5fae8 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:23.478691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf8119-b2eb-4325-bc80-7ec10885dec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:23.479346 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf8119-b2eb-4325-bc80-7ec10885dec0 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:23.479636 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf8119-b2eb-4325-bc80-7ec10885dec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:23.479915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf8119-b2eb-4325-bc80-7ec10885dec0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:23.488333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf8119-b2eb-4325-bc80-7ec10885dec0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:23.490148 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf8119-b2eb-4325-bc80-7ec10885dec0 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:23.499298 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 4/8] 10.222.0.46 () {58 vars in 1324 bytes} [Wed Jun 22 09:58:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 09:58:23.505121 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f1414-1356-4342-923b-73b1c0665066 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:23.515815 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f1414-1356-4342-923b-73b1c0665066 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:23.520448 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85707cf9-8b64-4c39-9a1a-db6960129ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:23.521361 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85707cf9-8b64-4c39-9a1a-db6960129ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:23.521652 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85707cf9-8b64-4c39-9a1a-db6960129ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:23.521937 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85707cf9-8b64-4c39-9a1a-db6960129ce7 admin admin] PATH_INFO: `/v3/users/af7691de913843509188548c36ece976` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:23.523370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85707cf9-8b64-4c39-9a1a-db6960129ce7 admin admin] RBAC: Authorizing `identity:get_user(user_id=af7691de913843509188548c36ece976)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:23.525262 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85707cf9-8b64-4c39-9a1a-db6960129ce7 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:23.526871 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 5/9] 10.222.0.46 () {56 vars in 1198 bytes} [Wed Jun 22 09:58:23 2022] GET /identity/v3/users/af7691de913843509188548c36ece976 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:58:25.630229 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebccef4-314a-4aef-bb0c-2dff4fba6b9d None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:25.632519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebccef4-314a-4aef-bb0c-2dff4fba6b9d None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:25.632519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebccef4-314a-4aef-bb0c-2dff4fba6b9d None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:25.632519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 5/10] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 09:58:25.637897 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef995000-9319-4768-9457-c442370b1660 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:25.638405 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef995000-9319-4768-9457-c442370b1660 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:25.638494 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef995000-9319-4768-9457-c442370b1660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:25.655902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-ef995000-9319-4768-9457-c442370b1660 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:25.657123 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-ef995000-9319-4768-9457-c442370b1660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:25.666863 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45107ce-43f1-4b9c-82a3-55e5ad4b1c6b None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:25.666863 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45107ce-43f1-4b9c-82a3-55e5ad4b1c6b None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:25.666863 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45107ce-43f1-4b9c-82a3-55e5ad4b1c6b None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:25.668195 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 6/11] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 09:58:25.674411 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0a47e-0624-42e6-8cef-a9f03bc5ea04 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:25.674699 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0a47e-0624-42e6-8cef-a9f03bc5ea04 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:25.674977 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0a47e-0624-42e6-8cef-a9f03bc5ea04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:25.718628 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG passlib.handlers.bcrypt [None req-03b0a47e-0624-42e6-8cef-a9f03bc5ea04 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80500) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 22 09:58:25.719143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG passlib.handlers.bcrypt [None req-03b0a47e-0624-42e6-8cef-a9f03bc5ea04 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80500) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 22 09:58:25.742937 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 6/12] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:58:25.765890 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-03b0a47e-0624-42e6-8cef-a9f03bc5ea04 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:25.766606 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef995000-9319-4768-9457-c442370b1660 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:25.767502 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-03b0a47e-0624-42e6-8cef-a9f03bc5ea04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:25.791429 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:25.887475 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 7/13] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 09:58:25.895161 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef995000-9319-4768-9457-c442370b1660 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:25.911606 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0a47e-0624-42e6-8cef-a9f03bc5ea04 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:25.932435 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cda2db-f291-4a3f-927c-ca506d046685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:25.933278 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cda2db-f291-4a3f-927c-ca506d046685 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:25.933570 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cda2db-f291-4a3f-927c-ca506d046685 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:25.933857 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cda2db-f291-4a3f-927c-ca506d046685 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:25.945661 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cda2db-f291-4a3f-927c-ca506d046685 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:58:25.957567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-c1cda2db-f291-4a3f-927c-ca506d046685 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 09:58:25.957567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:58:25.957567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:58:25.957567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:58:25.957567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:58:25.957567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:58:25.957567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:58:25.957567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:58:25.957567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:58:25.957567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:58:25.957567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:58:25.957567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:58:25.957567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:58:25.957567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:58:25.957567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:58:25.957567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:58:25.958448 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:58:25.958448 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:58:25.958448 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:58:25.958448 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:58:25.958448 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:58:25.958448 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:58:25.958448 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:58:25.958448 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:58:25.958448 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:58:25.958448 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:58:25.958448 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:58:25.958448 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:58:25.958448 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:58:25.958448 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:58:25.958448 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:58:25.958448 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:58:25.959731 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:58:25.959731 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:58:25.959731 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:58:25.959731 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:58:25.959731 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:58:25.959731 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:58:25.959731 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:58:25.959731 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:58:25.959731 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:58:25.959731 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:58:25.959731 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 09:58:25.959731 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:58:25.959731 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 7/14] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 09:58:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 09:58:25.964771 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cda2db-f291-4a3f-927c-ca506d046685 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:26.015008 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0a47e-0624-42e6-8cef-a9f03bc5ea04 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:26.018614 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:26.055067 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:26.059239 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc20e8f-5275-42d8-8404-a31868bf6055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:26.060149 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc20e8f-5275-42d8-8404-a31868bf6055 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:26.060436 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc20e8f-5275-42d8-8404-a31868bf6055 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:26.060715 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc20e8f-5275-42d8-8404-a31868bf6055 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:26.075426 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cda2db-f291-4a3f-927c-ca506d046685 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:26.119607 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814226e-62bb-452d-a2cf-c077d05381f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:26.120721 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814226e-62bb-452d-a2cf-c077d05381f3 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:26.121040 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814226e-62bb-452d-a2cf-c077d05381f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:26.121326 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814226e-62bb-452d-a2cf-c077d05381f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:26.122101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814226e-62bb-452d-a2cf-c077d05381f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:26.122412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814226e-62bb-452d-a2cf-c077d05381f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:26.124326 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814226e-62bb-452d-a2cf-c077d05381f3 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:26.136724 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 8/15] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:58:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:58:26.143015 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814226e-62bb-452d-a2cf-c077d05381f3 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:26.151958 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc20e8f-5275-42d8-8404-a31868bf6055 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:26.153527 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc20e8f-5275-42d8-8404-a31868bf6055 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:26.252643 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814226e-62bb-452d-a2cf-c077d05381f3 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:26.260058 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 8/16] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:58:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 09:58:26.266362 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc20e8f-5275-42d8-8404-a31868bf6055 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:26.269481 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:26.291271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257c2c7-6384-4082-8778-54d317c18fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:26.292437 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257c2c7-6384-4082-8778-54d317c18fad None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:26.292723 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257c2c7-6384-4082-8778-54d317c18fad None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:26.293028 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257c2c7-6384-4082-8778-54d317c18fad None admin] PATH_INFO: `/v3/users/af7691de913843509188548c36ece976` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:26.294292 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f257c2c7-6384-4082-8778-54d317c18fad None admin] RBAC: Authorizing `identity:get_user(user_id=af7691de913843509188548c36ece976)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:26.296324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f257c2c7-6384-4082-8778-54d317c18fad None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:26.298019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 9/17] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:58:26 2022] GET /identity/v3/users/af7691de913843509188548c36ece976 => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:58:26.303585 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257c2c7-6384-4082-8778-54d317c18fad None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:26.318601 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:26.375531 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc20e8f-5275-42d8-8404-a31868bf6055 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:26.409145 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257c2c7-6384-4082-8778-54d317c18fad None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:26.413321 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed4d0a-3408-4ffe-ba69-9a00acf63132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:26.414123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed4d0a-3408-4ffe-ba69-9a00acf63132 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:26.414411 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed4d0a-3408-4ffe-ba69-9a00acf63132 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:26.414688 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed4d0a-3408-4ffe-ba69-9a00acf63132 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:26.439820 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed4d0a-3408-4ffe-ba69-9a00acf63132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:26.441333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed4d0a-3408-4ffe-ba69-9a00acf63132 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:26.446010 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d14f8-3fb6-40cd-bb68-313b9a50ff01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:26.446802 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d14f8-3fb6-40cd-bb68-313b9a50ff01 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:26.447091 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d14f8-3fb6-40cd-bb68-313b9a50ff01 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:26.447417 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d14f8-3fb6-40cd-bb68-313b9a50ff01 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:26.448611 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d14f8-3fb6-40cd-bb68-313b9a50ff01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:26.450102 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d14f8-3fb6-40cd-bb68-313b9a50ff01 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:26.453136 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 10/18] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:58:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:58:26.459258 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d14f8-3fb6-40cd-bb68-313b9a50ff01 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:26.463633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-b1ed4d0a-3408-4ffe-ba69-9a00acf63132 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:58:26.463633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:58:26.463633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:58:26.463633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:58:26.463633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:58:26.463633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:58:26.463633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:58:26.463633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:58:26.463633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:58:26.463633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:58:26.463633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:58:26.463633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:58:26.463633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:58:26.463633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:58:26.463633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:58:26.464479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:58:26.464479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:58:26.464479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:58:26.464479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:58:26.464479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:58:26.464479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:58:26.464479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:58:26.464479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:58:26.464479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:58:26.464479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:58:26.464479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:58:26.464479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:58:26.464479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:58:26.464479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:58:26.464479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:58:26.464479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:58:26.464479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:58:26.465310 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:58:26.465310 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:58:26.465310 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:58:26.465310 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:58:26.465310 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 9/19] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:58:26.470946 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed4d0a-3408-4ffe-ba69-9a00acf63132 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:26.534598 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:26.552074 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:26.571514 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d14f8-3fb6-40cd-bb68-313b9a50ff01 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:26.584334 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed4d0a-3408-4ffe-ba69-9a00acf63132 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:26.607549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8db18-bbe9-4a63-95e4-a2ea37e175ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:26.608209 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8db18-bbe9-4a63-95e4-a2ea37e175ab None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:26.608488 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8db18-bbe9-4a63-95e4-a2ea37e175ab None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:26.608761 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8db18-bbe9-4a63-95e4-a2ea37e175ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:26.609627 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e8db18-bbe9-4a63-95e4-a2ea37e175ab None admin] RBAC: Adding query filter params (role.id=106aa464a69a49b09de7de5417083d3c, scope.domain.id=default, user.id=af7691de913843509188548c36ece976) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:26.609933 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e8db18-bbe9-4a63-95e4-a2ea37e175ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:26.611401 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e8db18-bbe9-4a63-95e4-a2ea37e175ab None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:26.618449 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 11/20] 10.222.0.46 () {56 vars in 1322 bytes} [Wed Jun 22 09:58:26 2022] GET /identity/v3/role_assignments?user.id=af7691de913843509188548c36ece976&scope.domain.id=default&role.id=106aa464a69a49b09de7de5417083d3c => generated 233 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:58:26.624582 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129cd2e-fe69-4f28-a401-80c4132dd94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:26.625318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129cd2e-fe69-4f28-a401-80c4132dd94c None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:26.625607 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129cd2e-fe69-4f28-a401-80c4132dd94c None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:26.625891 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129cd2e-fe69-4f28-a401-80c4132dd94c None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:26.626655 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129cd2e-fe69-4f28-a401-80c4132dd94c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:26.627030 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129cd2e-fe69-4f28-a401-80c4132dd94c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:26.628435 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129cd2e-fe69-4f28-a401-80c4132dd94c None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:26.653521 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 10/21] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:58:28.916457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23ee65-8470-4e38-a52d-fd28c235e619 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:28.917469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23ee65-8470-4e38-a52d-fd28c235e619 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:28.917976 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23ee65-8470-4e38-a52d-fd28c235e619 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:28.919580 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 12/22] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:58:28.927802 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d497f-0213-402f-ab00-bd5594cdb838 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:28.927802 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d497f-0213-402f-ab00-bd5594cdb838 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:28.927802 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d497f-0213-402f-ab00-bd5594cdb838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:28.949043 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-a04d497f-0213-402f-ab00-bd5594cdb838 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:28.957065 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-a04d497f-0213-402f-ab00-bd5594cdb838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:29.046070 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 11/23] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:58:29.081136 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23ee65-8470-4e38-a52d-fd28c235e619 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:29.146029 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfcb29-56c7-448c-b4fc-124fa0313bcf None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:29.146681 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfcb29-56c7-448c-b4fc-124fa0313bcf None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:29.147162 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfcb29-56c7-448c-b4fc-124fa0313bcf None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:29.148721 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 12/24] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 09:58:29.154481 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ceeda1-3fdf-4b57-8782-e04b7685adb7 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:29.155022 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ceeda1-3fdf-4b57-8782-e04b7685adb7 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:29.155501 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ceeda1-3fdf-4b57-8782-e04b7685adb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:29.181659 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-56ceeda1-3fdf-4b57-8782-e04b7685adb7 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:29.184249 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-56ceeda1-3fdf-4b57-8782-e04b7685adb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:29.245107 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:29.246568 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23ee65-8470-4e38-a52d-fd28c235e619 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:29.290410 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 13/25] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:58:29.298159 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2d72b-1731-4ad9-8e52-dba3696444bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:29.298980 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2d72b-1731-4ad9-8e52-dba3696444bd None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:29.299270 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2d72b-1731-4ad9-8e52-dba3696444bd None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:29.299551 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2d72b-1731-4ad9-8e52-dba3696444bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:29.312221 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2d72b-1731-4ad9-8e52-dba3696444bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:58:29.320182 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-b7f2d72b-1731-4ad9-8e52-dba3696444bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 09:58:29.320182 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:58:29.320182 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:58:29.320182 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:58:29.320182 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:58:29.320182 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:58:29.320182 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:58:29.320182 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:58:29.320182 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:58:29.320182 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:58:29.320182 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:58:29.320182 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:58:29.320182 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:58:29.320182 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:58:29.320182 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:58:29.320182 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:58:29.321016 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:58:29.321016 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:58:29.321016 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:58:29.321016 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:58:29.321016 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:58:29.321016 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:58:29.321016 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:58:29.321016 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:58:29.321016 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:58:29.321016 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:58:29.321016 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:58:29.321016 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:58:29.321016 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:58:29.321016 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:58:29.321016 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:58:29.321016 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:58:29.321775 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:58:29.321775 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:58:29.321775 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:58:29.321775 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:58:29.321775 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:58:29.321775 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:58:29.321775 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:58:29.321775 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:58:29.321775 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:58:29.321775 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:58:29.321775 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 09:58:29.321775 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:58:29.321775 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 13/26] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 09:58:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:58:29.327462 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ceeda1-3fdf-4b57-8782-e04b7685adb7 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:29.334078 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2d72b-1731-4ad9-8e52-dba3696444bd None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:29.338765 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:29.471810 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2d72b-1731-4ad9-8e52-dba3696444bd None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:29.517229 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86fcb0-8a64-4441-955a-e34129ce8d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:29.518276 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86fcb0-8a64-4441-955a-e34129ce8d32 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:29.518734 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86fcb0-8a64-4441-955a-e34129ce8d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:29.519155 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86fcb0-8a64-4441-955a-e34129ce8d32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:29.535446 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86fcb0-8a64-4441-955a-e34129ce8d32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:29.537183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86fcb0-8a64-4441-955a-e34129ce8d32 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:29.570535 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-ae86fcb0-8a64-4441-955a-e34129ce8d32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:58:29.570535 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:58:29.570535 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:58:29.570535 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:58:29.570535 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:58:29.570535 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:58:29.570535 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:58:29.570535 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:58:29.570535 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:58:29.570535 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:58:29.570535 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:58:29.570535 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:58:29.570535 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:58:29.570535 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:58:29.570535 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:58:29.571531 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:58:29.571531 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:58:29.571531 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:58:29.571531 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:58:29.571531 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:58:29.571531 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:58:29.571531 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:58:29.571531 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:58:29.571531 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:58:29.571531 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:58:29.571531 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:58:29.571531 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:58:29.571531 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:58:29.571531 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:58:29.571531 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:58:29.571531 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:58:29.571531 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:58:29.572502 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:58:29.572502 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:58:29.572502 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:58:29.572502 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:58:29.574086 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 14/27] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:58:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 09:58:29.574637 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ceeda1-3fdf-4b57-8782-e04b7685adb7 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:29.580806 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86fcb0-8a64-4441-955a-e34129ce8d32 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:29.666751 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:29.689812 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d62aab-d217-44a9-aa4d-08036eea99dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:29.690373 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d62aab-d217-44a9-aa4d-08036eea99dc None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:29.690667 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d62aab-d217-44a9-aa4d-08036eea99dc None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:29.690954 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d62aab-d217-44a9-aa4d-08036eea99dc None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:29.691745 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d62aab-d217-44a9-aa4d-08036eea99dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:29.692251 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d62aab-d217-44a9-aa4d-08036eea99dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:29.693550 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d62aab-d217-44a9-aa4d-08036eea99dc None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:29.718150 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 14/28] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:58:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:29.718786 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86fcb0-8a64-4441-955a-e34129ce8d32 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:29.719661 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d125662-7617-4992-8fc5-07df14d38e8c None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:29.719954 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d125662-7617-4992-8fc5-07df14d38e8c None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:29.720235 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d125662-7617-4992-8fc5-07df14d38e8c None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:29.721696 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 15/29] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:58:29.724336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d125662-7617-4992-8fc5-07df14d38e8c None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:29.782022 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f6845-23a7-4de6-88e1-c307a0a54b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:29.782899 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f6845-23a7-4de6-88e1-c307a0a54b2a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:29.783283 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f6845-23a7-4de6-88e1-c307a0a54b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:29.783659 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f6845-23a7-4de6-88e1-c307a0a54b2a None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:29.784416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f6845-23a7-4de6-88e1-c307a0a54b2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:29.784730 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f6845-23a7-4de6-88e1-c307a0a54b2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:29.787402 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f6845-23a7-4de6-88e1-c307a0a54b2a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:29.791623 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:29.811390 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 15/30] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:29.813264 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e072d0c-c50e-4113-8b78-bfa92363f8bf None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:29.813878 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e072d0c-c50e-4113-8b78-bfa92363f8bf None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:29.814173 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e072d0c-c50e-4113-8b78-bfa92363f8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:29.835323 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-9e072d0c-c50e-4113-8b78-bfa92363f8bf None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:29.837398 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-9e072d0c-c50e-4113-8b78-bfa92363f8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:29.864457 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d125662-7617-4992-8fc5-07df14d38e8c None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:29.909730 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b983728-4135-4b27-87f8-6cb810dc7e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:29.911269 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b983728-4135-4b27-87f8-6cb810dc7e95 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:29.912157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b983728-4135-4b27-87f8-6cb810dc7e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:29.912895 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b983728-4135-4b27-87f8-6cb810dc7e95 None admin] PATH_INFO: `/v3/users/af7691de913843509188548c36ece976` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:29.915299 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b983728-4135-4b27-87f8-6cb810dc7e95 None admin] RBAC: Authorizing `identity:get_user(user_id=af7691de913843509188548c36ece976)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:29.917266 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b983728-4135-4b27-87f8-6cb810dc7e95 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:29.919378 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 16/31] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:58:29 2022] GET /identity/v3/users/af7691de913843509188548c36ece976 => generated 247 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:58:29.919964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 16/32] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:58:29.921339 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334f17e-771a-47d4-ae3a-b0a4a67d53f0 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:29.921790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334f17e-771a-47d4-ae3a-b0a4a67d53f0 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:29.937501 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334f17e-771a-47d4-ae3a-b0a4a67d53f0 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:29.937501 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 17/33] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:58:29.938108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e072d0c-c50e-4113-8b78-bfa92363f8bf None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:29.938180 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3334f17e-771a-47d4-ae3a-b0a4a67d53f0 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:30.007060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:30.062950 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3334f17e-771a-47d4-ae3a-b0a4a67d53f0 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:30.070799 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e072d0c-c50e-4113-8b78-bfa92363f8bf None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:30.072542 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:30.103765 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf095a-ebee-43e1-b1ad-dfdf14f8186c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:30.104662 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf095a-ebee-43e1-b1ad-dfdf14f8186c None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:30.105093 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf095a-ebee-43e1-b1ad-dfdf14f8186c None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:30.105442 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf095a-ebee-43e1-b1ad-dfdf14f8186c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:30.107546 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf095a-ebee-43e1-b1ad-dfdf14f8186c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:30.109246 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf095a-ebee-43e1-b1ad-dfdf14f8186c None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:30.111903 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b87a5-8e2a-4431-a5e8-1c2f63e36f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:30.112706 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 18/34] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:58:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:30.113084 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b87a5-8e2a-4431-a5e8-1c2f63e36f31 None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:30.113562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b87a5-8e2a-4431-a5e8-1c2f63e36f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:30.114034 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b87a5-8e2a-4431-a5e8-1c2f63e36f31 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:30.114194 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b733d2-7d3b-44ff-afbe-8fe7694f2b2e None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:30.119685 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b733d2-7d3b-44ff-afbe-8fe7694f2b2e None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:30.119685 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b733d2-7d3b-44ff-afbe-8fe7694f2b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:30.119898 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b87a5-8e2a-4431-a5e8-1c2f63e36f31 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:30.119898 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031b87a5-8e2a-4431-a5e8-1c2f63e36f31 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:30.136241 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-b7b733d2-7d3b-44ff-afbe-8fe7694f2b2e None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:30.138866 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-b7b733d2-7d3b-44ff-afbe-8fe7694f2b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:30.220381 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 19/35] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:58:30.221467 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b733d2-7d3b-44ff-afbe-8fe7694f2b2e None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:30.336168 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b733d2-7d3b-44ff-afbe-8fe7694f2b2e None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:30.340110 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:30.374615 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07238a31-6b83-4b3f-b14d-221074ab62aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:30.375586 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07238a31-6b83-4b3f-b14d-221074ab62aa None admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:30.376064 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07238a31-6b83-4b3f-b14d-221074ab62aa None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:30.376483 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07238a31-6b83-4b3f-b14d-221074ab62aa None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:30.377429 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07238a31-6b83-4b3f-b14d-221074ab62aa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:30.378981 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07238a31-6b83-4b3f-b14d-221074ab62aa None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:30.415490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 17/36] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Jun 22 09:58:29 2022] POST /identity/v3/projects => generated 301 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:58:30.416282 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b87a5-8e2a-4431-a5e8-1c2f63e36f31 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:30.534023 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:30.538348 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b87a5-8e2a-4431-a5e8-1c2f63e36f31 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:30.577510 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64501b-8183-484a-85bd-34bdcac90922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:30.578407 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64501b-8183-484a-85bd-34bdcac90922 None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:30.578695 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64501b-8183-484a-85bd-34bdcac90922 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:30.578981 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64501b-8183-484a-85bd-34bdcac90922 None admin] PATH_INFO: `/v3/domains/default/users/af7691de913843509188548c36ece976/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:30.581260 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64501b-8183-484a-85bd-34bdcac90922 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=af7691de913843509188548c36ece976, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:30.582836 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64501b-8183-484a-85bd-34bdcac90922 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:30.590540 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 20/37] 10.222.0.46 () {60 vars in 1131 bytes} [Wed Jun 22 09:58:30 2022] POST /identity/v3/roles => generated 225 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:58:30.591986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07238a31-6b83-4b3f-b14d-221074ab62aa None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:30.704556 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 18/38] 10.222.0.46 () {58 vars in 1361 bytes} [Wed Jun 22 09:58:30 2022] PUT /identity/v3/domains/default/users/af7691de913843509188548c36ece976/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:58:30.707413 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a442d3-1930-4949-80f4-d2813ca93cf2 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:30.707918 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a442d3-1930-4949-80f4-d2813ca93cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:30.708458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a442d3-1930-4949-80f4-d2813ca93cf2 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:30.710056 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 19/39] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:58:30.712354 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bd30e-ba75-4401-b0d9-af3ddae39a63 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:30.712903 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bd30e-ba75-4401-b0d9-af3ddae39a63 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:30.713638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bd30e-ba75-4401-b0d9-af3ddae39a63 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:30.716242 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 20/40] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:58:30.721307 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19819b0c-ce7c-4504-a171-57b29e36d00a None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:30.722212 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19819b0c-ce7c-4504-a171-57b29e36d00a None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:30.722913 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19819b0c-ce7c-4504-a171-57b29e36d00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:30.745610 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07238a31-6b83-4b3f-b14d-221074ab62aa None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:30.795027 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f810fee-3d8f-4b27-b510-bc78f828aa6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:30.795739 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f810fee-3d8f-4b27-b510-bc78f828aa6f None admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:30.796025 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f810fee-3d8f-4b27-b510-bc78f828aa6f None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:30.796307 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f810fee-3d8f-4b27-b510-bc78f828aa6f None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:30.797157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f810fee-3d8f-4b27-b510-bc78f828aa6f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:30.798767 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f810fee-3d8f-4b27-b510-bc78f828aa6f None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:30.869214 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-19819b0c-ce7c-4504-a171-57b29e36d00a None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:30.870725 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-19819b0c-ce7c-4504-a171-57b29e36d00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:30.889121 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 21/41] 10.222.0.46 () {60 vars in 1131 bytes} [Wed Jun 22 09:58:30 2022] POST /identity/v3/roles => generated 219 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:58:30.890499 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0a839-abb0-4a80-9726-8cb915697c92 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:30.890825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0a839-abb0-4a80-9726-8cb915697c92 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:30.891070 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0a839-abb0-4a80-9726-8cb915697c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:30.911553 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-75f0a839-abb0-4a80-9726-8cb915697c92 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:30.913226 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-75f0a839-abb0-4a80-9726-8cb915697c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:30.940641 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:30.969477 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 21/42] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 09:58:30.994140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19819b0c-ce7c-4504-a171-57b29e36d00a None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:31.021491 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 22/43] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:58:31.053977 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0a839-abb0-4a80-9726-8cb915697c92 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:31.118507 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:31.135643 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19819b0c-ce7c-4504-a171-57b29e36d00a None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:31.175431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590c6df-e99a-4d27-9eaa-30e980fe32f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:31.176213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590c6df-e99a-4d27-9eaa-30e980fe32f4 None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:31.176509 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590c6df-e99a-4d27-9eaa-30e980fe32f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:31.176793 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590c6df-e99a-4d27-9eaa-30e980fe32f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:31.177607 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590c6df-e99a-4d27-9eaa-30e980fe32f4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:31.179006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590c6df-e99a-4d27-9eaa-30e980fe32f4 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:31.180798 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0a839-abb0-4a80-9726-8cb915697c92 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:31.215581 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b558c96-9918-4332-a46e-c35b37b7fc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:31.217056 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b558c96-9918-4332-a46e-c35b37b7fc15 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:31.217349 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b558c96-9918-4332-a46e-c35b37b7fc15 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:31.217626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b558c96-9918-4332-a46e-c35b37b7fc15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:31.218830 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b558c96-9918-4332-a46e-c35b37b7fc15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:31.220318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b558c96-9918-4332-a46e-c35b37b7fc15 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:31.221948 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 23/44] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:58:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:58:31.227456 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b558c96-9918-4332-a46e-c35b37b7fc15 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:31.253587 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:31.263306 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 22/45] 10.222.0.46 () {60 vars in 1131 bytes} [Wed Jun 22 09:58:30 2022] POST /identity/v3/roles => generated 223 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:58:31.339267 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b558c96-9918-4332-a46e-c35b37b7fc15 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:31.377223 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50661164-02e4-4673-8cee-c38e794286b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:31.377915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50661164-02e4-4673-8cee-c38e794286b4 None admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:31.378280 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50661164-02e4-4673-8cee-c38e794286b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:31.378569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50661164-02e4-4673-8cee-c38e794286b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:31.379312 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50661164-02e4-4673-8cee-c38e794286b4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:31.380835 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50661164-02e4-4673-8cee-c38e794286b4 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:31.468948 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 24/46] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Jun 22 09:58:31 2022] POST /identity/v3/projects => generated 312 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:58:32.811743 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de816877-f491-450e-a338-4b813715263b None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:32.812277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de816877-f491-450e-a338-4b813715263b None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:32.812356 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de816877-f491-450e-a338-4b813715263b None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:32.813722 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 23/47] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:58:32.819185 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3b083-aadf-4b23-aa27-5e4c0905b24c None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:32.819634 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3b083-aadf-4b23-aa27-5e4c0905b24c None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:32.820025 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3b083-aadf-4b23-aa27-5e4c0905b24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:32.837618 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-34f3b083-aadf-4b23-aa27-5e4c0905b24c None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:32.838825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-34f3b083-aadf-4b23-aa27-5e4c0905b24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:32.908945 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 25/48] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:58:32.932259 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de816877-f491-450e-a338-4b813715263b None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:33.035531 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de816877-f491-450e-a338-4b813715263b None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:33.068654 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9da4d5-efa7-437e-a821-e38b35ffe86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:33.069477 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9da4d5-efa7-437e-a821-e38b35ffe86b None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:33.069763 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9da4d5-efa7-437e-a821-e38b35ffe86b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:33.070041 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9da4d5-efa7-437e-a821-e38b35ffe86b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:33.082005 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9da4d5-efa7-437e-a821-e38b35ffe86b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:58:33.090309 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-9b9da4d5-efa7-437e-a821-e38b35ffe86b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 09:58:33.090309 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:58:33.090309 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:58:33.090309 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:58:33.090309 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:58:33.090309 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:58:33.090309 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:58:33.090309 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:58:33.090309 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:58:33.090309 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:58:33.090309 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:58:33.090309 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:58:33.090309 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:58:33.090309 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:58:33.090309 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:58:33.090309 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:58:33.091191 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:58:33.091191 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:58:33.091191 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:58:33.091191 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:58:33.091191 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:58:33.091191 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:58:33.091191 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:58:33.091191 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:58:33.091191 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:58:33.091191 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:58:33.091191 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:58:33.091191 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:58:33.091191 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:58:33.091191 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:58:33.091191 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:58:33.091191 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:58:33.091930 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:58:33.091930 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:58:33.091930 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:58:33.091930 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:58:33.091930 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:58:33.091930 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:58:33.091930 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:58:33.091930 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:58:33.091930 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:58:33.091930 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:58:33.091930 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 09:58:33.091930 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:58:33.091930 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 24/49] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 09:58:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:58:33.097399 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3b083-aadf-4b23-aa27-5e4c0905b24c None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:33.101127 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:33.201211 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3b083-aadf-4b23-aa27-5e4c0905b24c None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:33.237592 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5ee2d-3345-4a81-8815-0cc6c2eb1e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:33.238268 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5ee2d-3345-4a81-8815-0cc6c2eb1e31 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:33.238558 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5ee2d-3345-4a81-8815-0cc6c2eb1e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:33.238837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5ee2d-3345-4a81-8815-0cc6c2eb1e31 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:33.239592 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d5ee2d-3345-4a81-8815-0cc6c2eb1e31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:33.239900 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d5ee2d-3345-4a81-8815-0cc6c2eb1e31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:33.241307 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d5ee2d-3345-4a81-8815-0cc6c2eb1e31 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:33.250102 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 26/50] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:58:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:33.255486 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9da4d5-efa7-437e-a821-e38b35ffe86b None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:33.267133 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:33.354547 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9da4d5-efa7-437e-a821-e38b35ffe86b None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:33.389542 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ea216-9e5a-494c-9996-b686ce899bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:33.390460 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ea216-9e5a-494c-9996-b686ce899bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:33.390748 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ea216-9e5a-494c-9996-b686ce899bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:33.391024 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ea216-9e5a-494c-9996-b686ce899bb8 None admin] PATH_INFO: `/v3/users/af7691de913843509188548c36ece976` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:33.392228 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ea216-9e5a-494c-9996-b686ce899bb8 None admin] RBAC: Authorizing `identity:get_user(user_id=af7691de913843509188548c36ece976)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:33.393719 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ea216-9e5a-494c-9996-b686ce899bb8 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:33.395520 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 25/51] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:58:33 2022] GET /identity/v3/users/af7691de913843509188548c36ece976 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:33.400877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5ee2d-3345-4a81-8815-0cc6c2eb1e31 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:33.547775 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d1bbd-d53c-4ce6-baad-903a94c3c457 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:33.548074 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d1bbd-d53c-4ce6-baad-903a94c3c457 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:33.548357 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d1bbd-d53c-4ce6-baad-903a94c3c457 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:33.549760 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 26/52] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 09:58:33.554668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc715804-4c79-4636-b3a8-353c5e5c6afd None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:33.554966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc715804-4c79-4636-b3a8-353c5e5c6afd None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:33.555254 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc715804-4c79-4636-b3a8-353c5e5c6afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:33.571495 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-dc715804-4c79-4636-b3a8-353c5e5c6afd None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:33.572729 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-dc715804-4c79-4636-b3a8-353c5e5c6afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:33.574202 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:33.610661 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5ee2d-3345-4a81-8815-0cc6c2eb1e31 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:33.641517 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 27/53] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 09:58:33.644922 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f74bfb-891b-4fc1-8dbe-8bdd27f02802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:33.645720 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f74bfb-891b-4fc1-8dbe-8bdd27f02802 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:33.646004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f74bfb-891b-4fc1-8dbe-8bdd27f02802 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:33.646282 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f74bfb-891b-4fc1-8dbe-8bdd27f02802 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:33.647454 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f74bfb-891b-4fc1-8dbe-8bdd27f02802 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:33.648928 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f74bfb-891b-4fc1-8dbe-8bdd27f02802 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:33.650525 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 27/54] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:58:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:33.656187 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc715804-4c79-4636-b3a8-353c5e5c6afd None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:33.664735 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f74bfb-891b-4fc1-8dbe-8bdd27f02802 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:33.665244 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:33.756803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc715804-4c79-4636-b3a8-353c5e5c6afd None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:33.766234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f74bfb-891b-4fc1-8dbe-8bdd27f02802 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:33.790454 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bbdd2-7b8d-4618-9042-3d9e36f7f1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:33.791143 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bbdd2-7b8d-4618-9042-3d9e36f7f1df None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:33.791427 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bbdd2-7b8d-4618-9042-3d9e36f7f1df None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:33.791712 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bbdd2-7b8d-4618-9042-3d9e36f7f1df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:33.792546 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5bbdd2-7b8d-4618-9042-3d9e36f7f1df None admin] RBAC: Adding query filter params (role.id=106aa464a69a49b09de7de5417083d3c, scope.domain.id=default, user.id=af7691de913843509188548c36ece976) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:33.792889 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5bbdd2-7b8d-4618-9042-3d9e36f7f1df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:33.794928 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5bbdd2-7b8d-4618-9042-3d9e36f7f1df None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:33.800871 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 28/55] 10.222.0.46 () {56 vars in 1322 bytes} [Wed Jun 22 09:58:33 2022] GET /identity/v3/role_assignments?user.id=af7691de913843509188548c36ece976&scope.domain.id=default&role.id=106aa464a69a49b09de7de5417083d3c => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:58:33.801107 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d64cce-8183-4f89-99dc-5ac08f5256cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:33.801920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d64cce-8183-4f89-99dc-5ac08f5256cd None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:33.802210 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d64cce-8183-4f89-99dc-5ac08f5256cd None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:33.802598 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d64cce-8183-4f89-99dc-5ac08f5256cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:33.803842 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d64cce-8183-4f89-99dc-5ac08f5256cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:33.805368 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d64cce-8183-4f89-99dc-5ac08f5256cd None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:33.807106 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 28/56] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:58:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:58:33.813271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bbdd2-7b8d-4618-9042-3d9e36f7f1df None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:33.890495 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:33.923850 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bbdd2-7b8d-4618-9042-3d9e36f7f1df None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:33.960098 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d1a48-9fc2-47d8-bd0f-f9fc1cb0c916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:33.961312 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d1a48-9fc2-47d8-bd0f-f9fc1cb0c916 None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:33.961754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d1a48-9fc2-47d8-bd0f-f9fc1cb0c916 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:33.962041 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d1a48-9fc2-47d8-bd0f-f9fc1cb0c916 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:33.962768 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d1a48-9fc2-47d8-bd0f-f9fc1cb0c916 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:33.964235 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d1a48-9fc2-47d8-bd0f-f9fc1cb0c916 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:34.097301 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 29/57] 10.222.0.46 () {60 vars in 1140 bytes} [Wed Jun 22 09:58:33 2022] POST /identity/v3/projects => generated 298 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:58:36.139917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98771e9f-6ced-407f-9175-24bb6c78042e None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:36.140423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98771e9f-6ced-407f-9175-24bb6c78042e None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:36.140532 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98771e9f-6ced-407f-9175-24bb6c78042e None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:36.141869 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 29/58] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:58:36.147134 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674fc36-698d-4d7f-95c4-c97f967f5d38 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:36.147520 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674fc36-698d-4d7f-95c4-c97f967f5d38 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:36.147708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674fc36-698d-4d7f-95c4-c97f967f5d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:36.164103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-d674fc36-698d-4d7f-95c4-c97f967f5d38 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:36.165333 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-d674fc36-698d-4d7f-95c4-c97f967f5d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:36.231449 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 30/59] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:58:36.256197 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98771e9f-6ced-407f-9175-24bb6c78042e None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:36.259087 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:36.356655 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98771e9f-6ced-407f-9175-24bb6c78042e None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:36.390532 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad0654-e45b-45ff-9980-6038496cfc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:36.391258 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad0654-e45b-45ff-9980-6038496cfc33 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:36.391546 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad0654-e45b-45ff-9980-6038496cfc33 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:36.391829 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad0654-e45b-45ff-9980-6038496cfc33 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:36.393064 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad0654-e45b-45ff-9980-6038496cfc33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:36.394541 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad0654-e45b-45ff-9980-6038496cfc33 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:36.396173 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 30/60] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:58:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:36.401723 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674fc36-698d-4d7f-95c4-c97f967f5d38 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:36.452835 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:36.498064 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674fc36-698d-4d7f-95c4-c97f967f5d38 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:36.530647 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c0c3b-08db-40fb-8dbf-1cda7529795d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:36.531322 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c0c3b-08db-40fb-8dbf-1cda7529795d None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:36.531612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c0c3b-08db-40fb-8dbf-1cda7529795d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:36.531895 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c0c3b-08db-40fb-8dbf-1cda7529795d None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:36.532609 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c0c3b-08db-40fb-8dbf-1cda7529795d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:36.534180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c0c3b-08db-40fb-8dbf-1cda7529795d None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:36.661093 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 31/61] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 22 09:58:36 2022] POST /identity/v3/users => generated 275 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:58:39.804122 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d71834-12f2-487c-ba0d-f1afaabaf6f0 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:39.805142 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d71834-12f2-487c-ba0d-f1afaabaf6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:39.805625 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d71834-12f2-487c-ba0d-f1afaabaf6f0 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:39.807198 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 31/62] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:58:39.812963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adab740-0c8b-43d2-a081-3e6945fa16b4 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:39.813395 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adab740-0c8b-43d2-a081-3e6945fa16b4 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:39.813525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adab740-0c8b-43d2-a081-3e6945fa16b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:39.837838 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-7adab740-0c8b-43d2-a081-3e6945fa16b4 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:39.839354 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-7adab740-0c8b-43d2-a081-3e6945fa16b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:39.930550 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 32/63] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:58:39.973676 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d71834-12f2-487c-ba0d-f1afaabaf6f0 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:40.073769 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:40.080352 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b8fa1-e489-4921-9d7f-875bafe8701a None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:40.080655 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b8fa1-e489-4921-9d7f-875bafe8701a None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:40.080982 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b8fa1-e489-4921-9d7f-875bafe8701a None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:40.082576 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 33/64] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:58:40.090111 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013caf0-3805-4743-8334-d2d9c5a5f780 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:40.091633 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013caf0-3805-4743-8334-d2d9c5a5f780 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:40.092145 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013caf0-3805-4743-8334-d2d9c5a5f780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:40.122505 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-a013caf0-3805-4743-8334-d2d9c5a5f780 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:40.123786 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-a013caf0-3805-4743-8334-d2d9c5a5f780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:40.129025 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d71834-12f2-487c-ba0d-f1afaabaf6f0 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:40.170161 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:40.170628 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc485a5-5737-44fa-9bab-693dd93cad95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:40.172367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc485a5-5737-44fa-9bab-693dd93cad95 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:40.172887 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc485a5-5737-44fa-9bab-693dd93cad95 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:40.173421 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc485a5-5737-44fa-9bab-693dd93cad95 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:40.186223 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc485a5-5737-44fa-9bab-693dd93cad95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:58:40.195453 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-4bc485a5-5737-44fa-9bab-693dd93cad95 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:58:40.195453 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:58:40.195453 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:58:40.195453 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:58:40.195453 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:58:40.195453 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:58:40.195453 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:58:40.195453 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:58:40.195453 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:58:40.195453 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:58:40.195453 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:58:40.195453 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:58:40.195453 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:58:40.195453 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:58:40.195453 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:58:40.195453 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:58:40.196338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:58:40.196338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:58:40.196338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:58:40.196338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:58:40.196338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:58:40.196338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:58:40.196338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:58:40.196338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:58:40.196338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:58:40.196338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:58:40.196338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:58:40.196338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:58:40.196338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:58:40.196338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:58:40.196338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:58:40.196338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:58:40.197120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:58:40.197120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:58:40.197120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:58:40.197120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:58:40.197120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:58:40.197120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:58:40.197120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:58:40.197120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:58:40.197120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:58:40.197120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:58:40.197120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:58:40.197120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:58:40.200189 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 32/65] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:58:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:58:40.201831 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0dbfc-f26f-4a70-9229-2ffb48e1cb5b None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:40.202294 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0dbfc-f26f-4a70-9229-2ffb48e1cb5b None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:40.202755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0dbfc-f26f-4a70-9229-2ffb48e1cb5b None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:40.204207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 33/66] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:58:40.206802 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0dbfc-f26f-4a70-9229-2ffb48e1cb5b None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:40.216414 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 34/67] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:58:40.218076 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7252835-2299-4f28-9dd3-f7e3dfeabf6b None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:40.218582 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7252835-2299-4f28-9dd3-f7e3dfeabf6b None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:40.219085 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7252835-2299-4f28-9dd3-f7e3dfeabf6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:40.237472 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-c7252835-2299-4f28-9dd3-f7e3dfeabf6b None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:40.239502 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-c7252835-2299-4f28-9dd3-f7e3dfeabf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:40.315798 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 35/68] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:58:40.317173 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bf6f4-974e-44f6-88e3-9d3361452f1d None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:40.317472 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bf6f4-974e-44f6-88e3-9d3361452f1d None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:40.317756 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bf6f4-974e-44f6-88e3-9d3361452f1d None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:40.319048 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 36/69] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:58:40.319753 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446bf6f4-974e-44f6-88e3-9d3361452f1d None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:40.335931 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0dbfc-f26f-4a70-9229-2ffb48e1cb5b None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:40.367715 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:40.375487 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec880a64-b8ee-481f-819f-7615188b7094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:40.376156 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec880a64-b8ee-481f-819f-7615188b7094 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:40.376442 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec880a64-b8ee-481f-819f-7615188b7094 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:40.377049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec880a64-b8ee-481f-819f-7615188b7094 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:40.377585 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec880a64-b8ee-481f-819f-7615188b7094 None admin] RBAC: Adding query filter params (name=member) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:40.377856 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec880a64-b8ee-481f-819f-7615188b7094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:40.379285 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec880a64-b8ee-481f-819f-7615188b7094 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:40.390269 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 34/70] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 22 09:58:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:40.395949 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b607f-8223-4548-b9dd-e2d46e84791d None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:40.396297 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b607f-8223-4548-b9dd-e2d46e84791d None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:40.396592 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b607f-8223-4548-b9dd-e2d46e84791d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:40.415862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-c28b607f-8223-4548-b9dd-e2d46e84791d None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:40.417121 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-c28b607f-8223-4548-b9dd-e2d46e84791d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:40.432781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:40.443391 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446bf6f4-974e-44f6-88e3-9d3361452f1d None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:40.477042 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07417b89-4d1f-4f62-b5ee-b42da9b11075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:40.478077 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07417b89-4d1f-4f62-b5ee-b42da9b11075 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:40.478364 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07417b89-4d1f-4f62-b5ee-b42da9b11075 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:40.478798 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07417b89-4d1f-4f62-b5ee-b42da9b11075 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:40.490685 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07417b89-4d1f-4f62-b5ee-b42da9b11075 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:58:40.501081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 35/71] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:58:40.501081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b607f-8223-4548-b9dd-e2d46e84791d None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:40.501291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-07417b89-4d1f-4f62-b5ee-b42da9b11075 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 09:58:40.501291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:58:40.501291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:58:40.501291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:58:40.501291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:58:40.501291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:58:40.501291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:58:40.501291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:58:40.501291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:58:40.501291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:58:40.501291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:58:40.501291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:58:40.501291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:58:40.501291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:58:40.501291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:58:40.501291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:58:40.502091 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:58:40.502091 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:58:40.502091 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:58:40.502091 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:58:40.502091 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:58:40.502091 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:58:40.502091 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:58:40.502091 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:58:40.502091 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:58:40.502091 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:58:40.502091 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:58:40.502091 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:58:40.502091 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:58:40.502091 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:58:40.502091 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:58:40.502091 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:58:40.502843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:58:40.502843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:58:40.502843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:58:40.502843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:58:40.502843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:58:40.502843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:58:40.502843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:58:40.502843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:58:40.502843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:58:40.502843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:58:40.502843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 09:58:40.502843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:58:40.502843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 37/72] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 09:58:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:58:40.502843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07417b89-4d1f-4f62-b5ee-b42da9b11075 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:40.608696 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b607f-8223-4548-b9dd-e2d46e84791d None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:40.615166 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07417b89-4d1f-4f62-b5ee-b42da9b11075 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:40.630900 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:40.642180 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a2913-7f38-41b1-9319-0332e5774be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:40.643681 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a2913-7f38-41b1-9319-0332e5774be2 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:40.643681 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a2913-7f38-41b1-9319-0332e5774be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:40.643681 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a2913-7f38-41b1-9319-0332e5774be2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:40.647598 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54574d8-e3bc-4558-8364-7ac5ddd5a0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:40.648468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54574d8-e3bc-4558-8364-7ac5ddd5a0df None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:40.648750 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54574d8-e3bc-4558-8364-7ac5ddd5a0df None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:40.649056 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54574d8-e3bc-4558-8364-7ac5ddd5a0df None admin] PATH_INFO: `/v3/users/d3bcf2a71eef4b3fa6f7b6c18edc4d2f` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:40.654241 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a2913-7f38-41b1-9319-0332e5774be2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:58:40.667783 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-a49a2913-7f38-41b1-9319-0332e5774be2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:58:40.667783 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:58:40.667783 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:58:40.667783 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:58:40.667783 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:58:40.667783 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:58:40.667783 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:58:40.667783 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:58:40.667783 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:58:40.667783 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:58:40.667783 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:58:40.667783 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:58:40.667783 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:58:40.667783 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:58:40.667783 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:58:40.667783 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:58:40.669778 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:58:40.669778 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:58:40.669778 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:58:40.669778 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:58:40.669778 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:58:40.669778 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:58:40.669778 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:58:40.669778 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:58:40.669778 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:58:40.669778 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:58:40.669778 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:58:40.669778 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:58:40.669778 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:58:40.669778 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:58:40.669778 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:58:40.669778 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:58:40.670688 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:58:40.670688 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:58:40.670688 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:58:40.670688 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:58:40.670688 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:58:40.670688 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:58:40.670688 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:58:40.670688 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:58:40.670688 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:58:40.670688 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:58:40.670688 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:58:40.670688 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:58:40.670688 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 36/73] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:58:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:58:40.670688 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a2913-7f38-41b1-9319-0332e5774be2 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:40.671360 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54574d8-e3bc-4558-8364-7ac5ddd5a0df None admin] RBAC: Authorizing `identity:get_user(user_id=d3bcf2a71eef4b3fa6f7b6c18edc4d2f)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:40.671360 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54574d8-e3bc-4558-8364-7ac5ddd5a0df None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:40.673094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 38/74] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:58:40 2022] GET /identity/v3/users/d3bcf2a71eef4b3fa6f7b6c18edc4d2f => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:40.674794 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54574d8-e3bc-4558-8364-7ac5ddd5a0df None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:40.693119 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:40.770634 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a2913-7f38-41b1-9319-0332e5774be2 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:40.773311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54574d8-e3bc-4558-8364-7ac5ddd5a0df None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:40.804403 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832e856-df55-45fe-82ed-95ae9726d22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:40.805133 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832e856-df55-45fe-82ed-95ae9726d22a None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:40.805417 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832e856-df55-45fe-82ed-95ae9726d22a None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:40.805696 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832e856-df55-45fe-82ed-95ae9726d22a None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:40.806453 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832e856-df55-45fe-82ed-95ae9726d22a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:40.806764 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832e856-df55-45fe-82ed-95ae9726d22a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:40.808141 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832e856-df55-45fe-82ed-95ae9726d22a None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:40.812101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75127a15-93ac-41ce-aaac-695fdc2360d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:40.812942 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75127a15-93ac-41ce-aaac-695fdc2360d6 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:40.813234 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75127a15-93ac-41ce-aaac-695fdc2360d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:40.813688 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75127a15-93ac-41ce-aaac-695fdc2360d6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:40.817424 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 37/75] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:58:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:40.818655 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f05a51-87e8-4c11-b26b-db5bacc8a20a None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:40.818953 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f05a51-87e8-4c11-b26b-db5bacc8a20a None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:40.819243 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f05a51-87e8-4c11-b26b-db5bacc8a20a None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:40.820510 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 38/76] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:58:40.821281 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f05a51-87e8-4c11-b26b-db5bacc8a20a None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:40.824479 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75127a15-93ac-41ce-aaac-695fdc2360d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:58:40.832842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-75127a15-93ac-41ce-aaac-695fdc2360d6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 09:58:40.832842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:58:40.832842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:58:40.832842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:58:40.832842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:58:40.832842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:58:40.832842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:58:40.832842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:58:40.832842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:58:40.832842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:58:40.832842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:58:40.832842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:58:40.832842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:58:40.832842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:58:40.832842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:58:40.832842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:58:40.833801 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:58:40.833801 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:58:40.833801 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:58:40.833801 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:58:40.833801 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:58:40.833801 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:58:40.833801 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:58:40.833801 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:58:40.833801 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:58:40.833801 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:58:40.833801 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:58:40.833801 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:58:40.833801 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:58:40.833801 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:58:40.833801 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:58:40.833801 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:58:40.834577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:58:40.834577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:58:40.834577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:58:40.834577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:58:40.834577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:58:40.834577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:58:40.834577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:58:40.834577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:58:40.834577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:58:40.834577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:58:40.834577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 09:58:40.834577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:58:40.834577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 39/77] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 22 09:58:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:58:40.835210 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75127a15-93ac-41ce-aaac-695fdc2360d6 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:40.871822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:40.914288 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:40.927027 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f05a51-87e8-4c11-b26b-db5bacc8a20a None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:40.936746 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75127a15-93ac-41ce-aaac-695fdc2360d6 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:40.961825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0aaf7c-9f74-4597-bac6-78ba99446ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:40.962834 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0aaf7c-9f74-4597-bac6-78ba99446ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:40.963126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0aaf7c-9f74-4597-bac6-78ba99446ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:40.963407 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0aaf7c-9f74-4597-bac6-78ba99446ac0 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:40.964165 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0aaf7c-9f74-4597-bac6-78ba99446ac0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:40.964480 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0aaf7c-9f74-4597-bac6-78ba99446ac0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:40.966532 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0aaf7c-9f74-4597-bac6-78ba99446ac0 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:40.970990 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750aa17-48d6-4c7f-9328-fe33ac1f4618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:40.971637 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750aa17-48d6-4c7f-9328-fe33ac1f4618 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:40.971922 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750aa17-48d6-4c7f-9328-fe33ac1f4618 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:40.972201 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750aa17-48d6-4c7f-9328-fe33ac1f4618 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:40.975315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 39/78] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 22 09:58:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:40.978247 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bca043-741a-4288-a097-4232b67b3ab2 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:40.978745 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bca043-741a-4288-a097-4232b67b3ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:40.979225 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bca043-741a-4288-a097-4232b67b3ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:40.996495 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-d1bca043-741a-4288-a097-4232b67b3ab2 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:40.997754 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-d1bca043-741a-4288-a097-4232b67b3ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:41.057042 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f750aa17-48d6-4c7f-9328-fe33ac1f4618 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:41.057042 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f750aa17-48d6-4c7f-9328-fe33ac1f4618 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:41.064880 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 40/79] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:58:41.068975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bca043-741a-4288-a097-4232b67b3ab2 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:41.113447 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:41.127495 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:41.153174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 40/80] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:58:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 09:58:41.153174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750aa17-48d6-4c7f-9328-fe33ac1f4618 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:41.179036 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bca043-741a-4288-a097-4232b67b3ab2 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:41.213615 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd21db-7033-48da-8129-132555df7e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:41.214543 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd21db-7033-48da-8129-132555df7e5d None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:41.214830 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd21db-7033-48da-8129-132555df7e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:41.215658 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd21db-7033-48da-8129-132555df7e5d None admin] PATH_INFO: `/v3/users/af7691de913843509188548c36ece976` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:41.216899 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd21db-7033-48da-8129-132555df7e5d None admin] RBAC: Authorizing `identity:get_user(user_id=af7691de913843509188548c36ece976)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:41.218406 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd21db-7033-48da-8129-132555df7e5d None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:41.220030 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 41/81] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:58:41 2022] GET /identity/v3/users/af7691de913843509188548c36ece976 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:41.220790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd21db-7033-48da-8129-132555df7e5d None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:41.251814 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750aa17-48d6-4c7f-9328-fe33ac1f4618 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:41.287331 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b8582-12d2-43d2-85fd-e26c1d94ac78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:41.287997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b8582-12d2-43d2-85fd-e26c1d94ac78 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:41.288290 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b8582-12d2-43d2-85fd-e26c1d94ac78 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:41.288575 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b8582-12d2-43d2-85fd-e26c1d94ac78 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:41.289363 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b8582-12d2-43d2-85fd-e26c1d94ac78 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:41.289681 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b8582-12d2-43d2-85fd-e26c1d94ac78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:41.291067 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b8582-12d2-43d2-85fd-e26c1d94ac78 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:41.299055 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 41/82] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 09:58:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:41.299852 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b8582-12d2-43d2-85fd-e26c1d94ac78 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:41.322761 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd21db-7033-48da-8129-132555df7e5d None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:41.324955 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:41.339942 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:41.356581 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f8dbb-82a6-42d5-af50-499bfc8f046c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:41.357485 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f8dbb-82a6-42d5-af50-499bfc8f046c None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:41.357768 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f8dbb-82a6-42d5-af50-499bfc8f046c None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:41.358046 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f8dbb-82a6-42d5-af50-499bfc8f046c None admin] PATH_INFO: `/v3/users/d3bcf2a71eef4b3fa6f7b6c18edc4d2f` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:41.359264 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f8dbb-82a6-42d5-af50-499bfc8f046c None admin] RBAC: Authorizing `identity:get_user(user_id=d3bcf2a71eef4b3fa6f7b6c18edc4d2f)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:41.360703 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f8dbb-82a6-42d5-af50-499bfc8f046c None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:41.364972 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 42/83] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:58:41 2022] GET /identity/v3/users/d3bcf2a71eef4b3fa6f7b6c18edc4d2f => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:41.366126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f8dbb-82a6-42d5-af50-499bfc8f046c None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:41.402271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b8582-12d2-43d2-85fd-e26c1d94ac78 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:41.435638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd26d46-2233-4e2f-bc42-8aaec8f3e3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:41.436434 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd26d46-2233-4e2f-bc42-8aaec8f3e3fe None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:41.436715 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd26d46-2233-4e2f-bc42-8aaec8f3e3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:41.437018 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd26d46-2233-4e2f-bc42-8aaec8f3e3fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:41.438200 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd26d46-2233-4e2f-bc42-8aaec8f3e3fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:41.439660 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd26d46-2233-4e2f-bc42-8aaec8f3e3fe None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:41.441308 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 42/84] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:58:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:41.442067 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd26d46-2233-4e2f-bc42-8aaec8f3e3fe None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:41.469293 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f8dbb-82a6-42d5-af50-499bfc8f046c None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:41.503200 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc65a4b-d9fa-46c3-b70c-c62b12f7c655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:41.504064 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc65a4b-d9fa-46c3-b70c-c62b12f7c655 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:41.504352 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc65a4b-d9fa-46c3-b70c-c62b12f7c655 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:41.504631 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc65a4b-d9fa-46c3-b70c-c62b12f7c655 None admin] PATH_INFO: `/v3/projects/f040c41677374080a6ee1538a7a34a54` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:41.505865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc65a4b-d9fa-46c3-b70c-c62b12f7c655 None admin] RBAC: Authorizing `identity:get_project(project_id=f040c41677374080a6ee1538a7a34a54)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:41.507318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc65a4b-d9fa-46c3-b70c-c62b12f7c655 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:41.509062 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 43/85] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:58:41 2022] GET /identity/v3/projects/f040c41677374080a6ee1538a7a34a54 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:41.509831 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc65a4b-d9fa-46c3-b70c-c62b12f7c655 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:41.544362 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd26d46-2233-4e2f-bc42-8aaec8f3e3fe None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:41.551112 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:41.551339 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:41.578003 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56660c5-ed8a-407f-bf4c-1d0f24e0f654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:41.578586 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56660c5-ed8a-407f-bf4c-1d0f24e0f654 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:41.578894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56660c5-ed8a-407f-bf4c-1d0f24e0f654 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:41.579165 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56660c5-ed8a-407f-bf4c-1d0f24e0f654 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:41.608113 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc65a4b-d9fa-46c3-b70c-c62b12f7c655 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:41.641268 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea020f-b430-40df-b703-5091da3a1582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:41.642137 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea020f-b430-40df-b703-5091da3a1582 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:41.642425 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea020f-b430-40df-b703-5091da3a1582 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:41.642702 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea020f-b430-40df-b703-5091da3a1582 None admin] PATH_INFO: `/v3/users/d3bcf2a71eef4b3fa6f7b6c18edc4d2f` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:41.644310 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea020f-b430-40df-b703-5091da3a1582 None admin] RBAC: Authorizing `identity:get_user(user_id=d3bcf2a71eef4b3fa6f7b6c18edc4d2f)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:41.645390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cea020f-b430-40df-b703-5091da3a1582 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:41.646569 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56660c5-ed8a-407f-bf4c-1d0f24e0f654 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:41.647192 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 44/86] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:58:41 2022] GET /identity/v3/users/d3bcf2a71eef4b3fa6f7b6c18edc4d2f => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:41.647782 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea020f-b430-40df-b703-5091da3a1582 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:41.648190 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56660c5-ed8a-407f-bf4c-1d0f24e0f654 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:41.751103 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea020f-b430-40df-b703-5091da3a1582 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:41.755046 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 43/87] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:58:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 09:58:41.755867 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56660c5-ed8a-407f-bf4c-1d0f24e0f654 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:41.760893 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:41.765601 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:41.786238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feeb29b-7a13-482b-9fe1-c6dd3b5446e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:41.786822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feeb29b-7a13-482b-9fe1-c6dd3b5446e0 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:41.787111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feeb29b-7a13-482b-9fe1-c6dd3b5446e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:41.787396 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feeb29b-7a13-482b-9fe1-c6dd3b5446e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:41.858146 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56660c5-ed8a-407f-bf4c-1d0f24e0f654 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:41.860003 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feeb29b-7a13-482b-9fe1-c6dd3b5446e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:41.861521 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feeb29b-7a13-482b-9fe1-c6dd3b5446e0 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:41.894070 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f2977-f922-4e75-825b-42158c931297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:41.894738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f2977-f922-4e75-825b-42158c931297 None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:41.895019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f2977-f922-4e75-825b-42158c931297 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:41.895304 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f2977-f922-4e75-825b-42158c931297 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:41.896027 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f2977-f922-4e75-825b-42158c931297 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:41.897511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f2977-f922-4e75-825b-42158c931297 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:41.961261 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 45/88] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:58:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 09:58:41.962160 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feeb29b-7a13-482b-9fe1-c6dd3b5446e0 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:41.973070 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:42.008585 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 44/89] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 22 09:58:41 2022] POST /identity/v3/users => generated 289 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:58:42.009458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f2977-f922-4e75-825b-42158c931297 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:42.069426 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feeb29b-7a13-482b-9fe1-c6dd3b5446e0 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:42.107369 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:42.109038 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae32696-34a5-447a-ade7-47ba5af35b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:42.109664 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae32696-34a5-447a-ade7-47ba5af35b33 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:42.109949 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae32696-34a5-447a-ade7-47ba5af35b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:42.110308 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae32696-34a5-447a-ade7-47ba5af35b33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:42.111088 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae32696-34a5-447a-ade7-47ba5af35b33 None admin] RBAC: Adding query filter params (role.id=b8f82737ef614907a0d320c6e1f2facf, scope.project.id=f040c41677374080a6ee1538a7a34a54, user.id=d3bcf2a71eef4b3fa6f7b6c18edc4d2f) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:42.111398 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae32696-34a5-447a-ade7-47ba5af35b33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:42.112898 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae32696-34a5-447a-ade7-47ba5af35b33 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:42.132848 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 46/90] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 09:58:41 2022] GET /identity/v3/role_assignments?user.id=d3bcf2a71eef4b3fa6f7b6c18edc4d2f&scope.project.id=f040c41677374080a6ee1538a7a34a54&role.id=b8f82737ef614907a0d320c6e1f2facf => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:42.132848 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae32696-34a5-447a-ade7-47ba5af35b33 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:42.161164 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f2977-f922-4e75-825b-42158c931297 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:42.207757 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdd254-49c0-4b46-8b92-a425f81018dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:42.208438 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdd254-49c0-4b46-8b92-a425f81018dc None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:42.208726 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdd254-49c0-4b46-8b92-a425f81018dc None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:42.209059 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdd254-49c0-4b46-8b92-a425f81018dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:42.236191 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:42.285654 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae32696-34a5-447a-ade7-47ba5af35b33 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:42.303046 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbdd254-49c0-4b46-8b92-a425f81018dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:42.304768 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbdd254-49c0-4b46-8b92-a425f81018dc None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:42.337712 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550f958-4dc6-4b55-8dd2-84116af98ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:42.338888 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550f958-4dc6-4b55-8dd2-84116af98ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:42.339183 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550f958-4dc6-4b55-8dd2-84116af98ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:42.339467 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550f958-4dc6-4b55-8dd2-84116af98ec7 None admin] PATH_INFO: `/v3/projects/f040c41677374080a6ee1538a7a34a54` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:42.342287 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550f958-4dc6-4b55-8dd2-84116af98ec7 None admin] RBAC: Authorizing `identity:get_project(project_id=f040c41677374080a6ee1538a7a34a54)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:42.343752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550f958-4dc6-4b55-8dd2-84116af98ec7 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:42.346751 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 47/91] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:58:42 2022] GET /identity/v3/projects/f040c41677374080a6ee1538a7a34a54 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:42.347558 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550f958-4dc6-4b55-8dd2-84116af98ec7 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:42.382326 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:42.431464 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 45/92] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:58:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 09:58:42.432326 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdd254-49c0-4b46-8b92-a425f81018dc None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:42.493354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550f958-4dc6-4b55-8dd2-84116af98ec7 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:42.539742 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ffdd5-d4fd-4efe-b844-26d86cb2e5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:42.540926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ffdd5-d4fd-4efe-b844-26d86cb2e5bf None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:42.541465 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ffdd5-d4fd-4efe-b844-26d86cb2e5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:42.541756 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ffdd5-d4fd-4efe-b844-26d86cb2e5bf None admin] PATH_INFO: `/v3/projects/12bba9925e2a4739bd44159d3be6d8f9` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:42.544244 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ffdd5-d4fd-4efe-b844-26d86cb2e5bf None admin] RBAC: Authorizing `identity:get_project(project_id=12bba9925e2a4739bd44159d3be6d8f9)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:42.545747 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ffdd5-d4fd-4efe-b844-26d86cb2e5bf None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:42.545852 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdd254-49c0-4b46-8b92-a425f81018dc None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:42.547758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 48/93] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:58:42 2022] GET /identity/v3/projects/12bba9925e2a4739bd44159d3be6d8f9 => generated 312 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:42.549597 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ffdd5-d4fd-4efe-b844-26d86cb2e5bf None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:42.563102 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:42.586699 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274bf2f-1223-4155-8bfe-2bfee36890a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:42.587366 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274bf2f-1223-4155-8bfe-2bfee36890a9 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:42.587661 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274bf2f-1223-4155-8bfe-2bfee36890a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:42.587948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274bf2f-1223-4155-8bfe-2bfee36890a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:42.588800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274bf2f-1223-4155-8bfe-2bfee36890a9 None admin] RBAC: Adding query filter params (role.id=106aa464a69a49b09de7de5417083d3c, scope.project.id=f040c41677374080a6ee1538a7a34a54, user.id=af7691de913843509188548c36ece976) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:42.589153 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274bf2f-1223-4155-8bfe-2bfee36890a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:42.591231 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274bf2f-1223-4155-8bfe-2bfee36890a9 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:42.597467 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 46/94] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 09:58:42 2022] GET /identity/v3/role_assignments?user.id=af7691de913843509188548c36ece976&scope.project.id=f040c41677374080a6ee1538a7a34a54&role.id=106aa464a69a49b09de7de5417083d3c => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:42.598301 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274bf2f-1223-4155-8bfe-2bfee36890a9 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:42.662780 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:42.747078 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ffdd5-d4fd-4efe-b844-26d86cb2e5bf None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:42.769758 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274bf2f-1223-4155-8bfe-2bfee36890a9 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:42.817450 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e951704-d3f8-42ff-82bb-4d24577dbf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:42.818138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e951704-d3f8-42ff-82bb-4d24577dbf31 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:42.818427 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e951704-d3f8-42ff-82bb-4d24577dbf31 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:42.818713 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e951704-d3f8-42ff-82bb-4d24577dbf31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:42.819570 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e951704-d3f8-42ff-82bb-4d24577dbf31 None admin] RBAC: Adding query filter params (role.id=b8f82737ef614907a0d320c6e1f2facf, scope.project.id=12bba9925e2a4739bd44159d3be6d8f9, user.id=d3bcf2a71eef4b3fa6f7b6c18edc4d2f) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:42.819890 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e951704-d3f8-42ff-82bb-4d24577dbf31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:42.821442 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e951704-d3f8-42ff-82bb-4d24577dbf31 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:42.834186 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 47/95] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 09:58:42 2022] GET /identity/v3/role_assignments?user.id=d3bcf2a71eef4b3fa6f7b6c18edc4d2f&scope.project.id=12bba9925e2a4739bd44159d3be6d8f9&role.id=b8f82737ef614907a0d320c6e1f2facf => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:42.838395 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa3b13-4ca5-4d9f-9ae1-9ff4e5b65395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:42.839296 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa3b13-4ca5-4d9f-9ae1-9ff4e5b65395 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:42.839585 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa3b13-4ca5-4d9f-9ae1-9ff4e5b65395 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:42.839924 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa3b13-4ca5-4d9f-9ae1-9ff4e5b65395 None admin] PATH_INFO: `/v3/projects/f040c41677374080a6ee1538a7a34a54` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:42.841393 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa3b13-4ca5-4d9f-9ae1-9ff4e5b65395 None admin] RBAC: Authorizing `identity:get_project(project_id=f040c41677374080a6ee1538a7a34a54)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:42.842896 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa3b13-4ca5-4d9f-9ae1-9ff4e5b65395 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:42.844736 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 49/96] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:58:42 2022] GET /identity/v3/projects/f040c41677374080a6ee1538a7a34a54 => generated 298 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:42.850920 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e951704-d3f8-42ff-82bb-4d24577dbf31 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:42.980612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:42.992942 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e951704-d3f8-42ff-82bb-4d24577dbf31 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:43.036473 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77740ac3-8211-4b90-98e8-f08f31e27e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:43.037444 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77740ac3-8211-4b90-98e8-f08f31e27e3e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:43.037885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77740ac3-8211-4b90-98e8-f08f31e27e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:43.038356 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77740ac3-8211-4b90-98e8-f08f31e27e3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:43.039415 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77740ac3-8211-4b90-98e8-f08f31e27e3e None admin] RBAC: Adding query filter params (role.id=7783830649d941ea9507439a113fc5d9, scope.project.id=f040c41677374080a6ee1538a7a34a54, user.id=d3bcf2a71eef4b3fa6f7b6c18edc4d2f) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:43.039872 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77740ac3-8211-4b90-98e8-f08f31e27e3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:43.041498 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77740ac3-8211-4b90-98e8-f08f31e27e3e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:43.048581 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 48/97] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 09:58:42 2022] GET /identity/v3/role_assignments?user.id=d3bcf2a71eef4b3fa6f7b6c18edc4d2f&scope.project.id=f040c41677374080a6ee1538a7a34a54&role.id=7783830649d941ea9507439a113fc5d9 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:44.655909 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a406306-d0a7-4845-97e4-0db53182c0c5 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:44.656413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a406306-d0a7-4845-97e4-0db53182c0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:44.656511 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a406306-d0a7-4845-97e4-0db53182c0c5 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:44.658122 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 50/98] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:58:44.663794 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f250a3-0f9f-4bb0-b128-42d56714559e None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:44.664204 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f250a3-0f9f-4bb0-b128-42d56714559e None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:44.664402 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f250a3-0f9f-4bb0-b128-42d56714559e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:44.693009 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-e2f250a3-0f9f-4bb0-b128-42d56714559e None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:44.694242 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-e2f250a3-0f9f-4bb0-b128-42d56714559e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:44.789209 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 49/99] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:58:44.824075 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a406306-d0a7-4845-97e4-0db53182c0c5 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:44.948146 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f83cff-ce91-4e1e-b49f-ef37d10e47a9 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:44.948359 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f83cff-ce91-4e1e-b49f-ef37d10e47a9 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:44.948647 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f83cff-ce91-4e1e-b49f-ef37d10e47a9 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:44.950819 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 50/100] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:58:44.955782 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b09f8c-682d-43f1-9b60-92765ee2d492 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:44.956074 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b09f8c-682d-43f1-9b60-92765ee2d492 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:44.956355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b09f8c-682d-43f1-9b60-92765ee2d492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:44.959983 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:44.989939 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-08b09f8c-682d-43f1-9b60-92765ee2d492 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:44.991478 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-08b09f8c-682d-43f1-9b60-92765ee2d492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:45.004744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a406306-d0a7-4845-97e4-0db53182c0c5 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:45.062600 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca1797-e1bd-45a3-a069-3be3254f9294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:45.063425 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca1797-e1bd-45a3-a069-3be3254f9294 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:45.063714 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca1797-e1bd-45a3-a069-3be3254f9294 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:45.063997 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca1797-e1bd-45a3-a069-3be3254f9294 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:45.089094 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca1797-e1bd-45a3-a069-3be3254f9294 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:58:45.098045 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-15ca1797-e1bd-45a3-a069-3be3254f9294 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:58:45.098045 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:58:45.098045 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:58:45.098045 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:58:45.098045 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:58:45.098045 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:58:45.098045 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:58:45.098045 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:58:45.098045 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:58:45.098045 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:58:45.098045 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:58:45.098045 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:58:45.098045 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:58:45.098045 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:58:45.098045 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:58:45.098045 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:58:45.098961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:58:45.098961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:58:45.098961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:58:45.098961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:58:45.098961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:58:45.098961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:58:45.098961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:58:45.098961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:58:45.098961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:58:45.098961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:58:45.098961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:58:45.098961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:58:45.098961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:58:45.098961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:58:45.098961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:58:45.098961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:58:45.099754 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:58:45.099754 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:58:45.099754 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:58:45.099754 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:58:45.099754 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:58:45.099754 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:58:45.099754 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:58:45.099754 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:58:45.099754 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:58:45.099754 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:58:45.099754 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:58:45.099754 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:58:45.099754 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 51/101] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:58:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:58:45.108086 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca1797-e1bd-45a3-a069-3be3254f9294 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:45.123684 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 51/102] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:58:45.170257 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b09f8c-682d-43f1-9b60-92765ee2d492 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:45.197202 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:45.321105 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca1797-e1bd-45a3-a069-3be3254f9294 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:45.367573 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b09f8c-682d-43f1-9b60-92765ee2d492 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:45.395772 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4371aa-353b-4dc0-9a02-b41b03685545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:45.396603 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4371aa-353b-4dc0-9a02-b41b03685545 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:45.396917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4371aa-353b-4dc0-9a02-b41b03685545 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:45.397207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4371aa-353b-4dc0-9a02-b41b03685545 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:45.397983 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4371aa-353b-4dc0-9a02-b41b03685545 None admin] RBAC: Adding query filter params (name=member) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:45.398297 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4371aa-353b-4dc0-9a02-b41b03685545 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:45.399901 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4371aa-353b-4dc0-9a02-b41b03685545 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:45.409929 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:45.422684 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 52/103] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 22 09:58:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:45.434607 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4371aa-353b-4dc0-9a02-b41b03685545 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:45.441376 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5cedc-6fba-490e-af0e-6acbbe6a21c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:45.442224 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5cedc-6fba-490e-af0e-6acbbe6a21c2 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:45.442510 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5cedc-6fba-490e-af0e-6acbbe6a21c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:45.442786 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5cedc-6fba-490e-af0e-6acbbe6a21c2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:45.461493 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f5cedc-6fba-490e-af0e-6acbbe6a21c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:58:45.469653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-f2f5cedc-6fba-490e-af0e-6acbbe6a21c2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 09:58:45.469653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:58:45.469653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:58:45.469653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:58:45.469653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:58:45.469653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:58:45.469653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:58:45.469653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:58:45.469653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:58:45.469653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:58:45.469653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:58:45.469653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:58:45.469653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:58:45.469653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:58:45.469653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:58:45.469653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:58:45.470494 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:58:45.470494 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:58:45.470494 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:58:45.470494 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:58:45.470494 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:58:45.470494 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:58:45.470494 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:58:45.470494 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:58:45.470494 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:58:45.470494 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:58:45.470494 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:58:45.470494 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:58:45.470494 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:58:45.470494 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:58:45.470494 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:58:45.470494 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:58:45.471243 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:58:45.471243 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:58:45.471243 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:58:45.471243 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:58:45.471243 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:58:45.471243 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:58:45.471243 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:58:45.471243 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:58:45.471243 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:58:45.471243 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:58:45.471243 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 09:58:45.471243 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:58:45.473675 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 52/104] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:58:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 09:58:45.475293 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f1b86-cb53-4224-b255-f21a7cf66040 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:45.475793 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f1b86-cb53-4224-b255-f21a7cf66040 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:45.476274 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f1b86-cb53-4224-b255-f21a7cf66040 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:45.477771 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 53/105] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:58:45.484840 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72323f-a01f-4b6d-b004-a85ed1d0da29 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:45.484840 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72323f-a01f-4b6d-b004-a85ed1d0da29 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:45.484840 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72323f-a01f-4b6d-b004-a85ed1d0da29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:45.513622 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-5a72323f-a01f-4b6d-b004-a85ed1d0da29 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:45.514827 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-5a72323f-a01f-4b6d-b004-a85ed1d0da29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:45.597401 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4371aa-353b-4dc0-9a02-b41b03685545 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:45.612240 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 54/106] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:58:45.613619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72323f-a01f-4b6d-b004-a85ed1d0da29 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:45.617047 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:45.658307 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cfe909-69fc-42a2-848f-90cf39a7e9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:45.659297 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfe909-69fc-42a2-848f-90cf39a7e9cb None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:45.659610 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfe909-69fc-42a2-848f-90cf39a7e9cb None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:45.659891 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfe909-69fc-42a2-848f-90cf39a7e9cb None admin] PATH_INFO: `/v3/users/d3bcf2a71eef4b3fa6f7b6c18edc4d2f` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:45.666306 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cfe909-69fc-42a2-848f-90cf39a7e9cb None admin] RBAC: Authorizing `identity:get_user(user_id=d3bcf2a71eef4b3fa6f7b6c18edc4d2f)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:45.668491 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cfe909-69fc-42a2-848f-90cf39a7e9cb None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:45.670747 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 53/107] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:58:45 2022] GET /identity/v3/users/d3bcf2a71eef4b3fa6f7b6c18edc4d2f => generated 275 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:58:45.672244 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a9f54-e4b4-400f-b64b-b6c44ba13920 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:45.672710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a9f54-e4b4-400f-b64b-b6c44ba13920 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:45.673165 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a9f54-e4b4-400f-b64b-b6c44ba13920 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:45.674619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 54/108] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:58:45.675583 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a9f54-e4b4-400f-b64b-b6c44ba13920 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:45.731704 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72323f-a01f-4b6d-b004-a85ed1d0da29 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:45.759081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:45.767903 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5769d1-1213-4fdf-a004-dec1c7c75950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:45.768652 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5769d1-1213-4fdf-a004-dec1c7c75950 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:45.768968 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5769d1-1213-4fdf-a004-dec1c7c75950 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:45.769313 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5769d1-1213-4fdf-a004-dec1c7c75950 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:45.774281 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5769d1-1213-4fdf-a004-dec1c7c75950 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:45.774281 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5769d1-1213-4fdf-a004-dec1c7c75950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:45.774281 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5769d1-1213-4fdf-a004-dec1c7c75950 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:45.781025 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 55/109] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 22 09:58:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:45.785601 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5769d1-1213-4fdf-a004-dec1c7c75950 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:45.804179 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a9f54-e4b4-400f-b64b-b6c44ba13920 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:45.843834 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bfb227-d148-4550-a34c-8b64f1213fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:45.845113 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfb227-d148-4550-a34c-8b64f1213fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:45.845622 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfb227-d148-4550-a34c-8b64f1213fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:45.846100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfb227-d148-4550-a34c-8b64f1213fa4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:45.847796 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bfb227-d148-4550-a34c-8b64f1213fa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:45.849489 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bfb227-d148-4550-a34c-8b64f1213fa4 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:45.851584 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 55/110] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:58:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:45.857271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:45.859725 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400e6d5-0738-4c66-99f8-7480b72ac955 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:45.860246 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400e6d5-0738-4c66-99f8-7480b72ac955 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:45.860758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400e6d5-0738-4c66-99f8-7480b72ac955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:45.878402 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-d400e6d5-0738-4c66-99f8-7480b72ac955 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:45.879933 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-d400e6d5-0738-4c66-99f8-7480b72ac955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:45.894453 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5769d1-1213-4fdf-a004-dec1c7c75950 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:45.955336 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb9bae-302a-4134-83a3-5c345d82ddd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:45.956482 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb9bae-302a-4134-83a3-5c345d82ddd3 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:45.956977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb9bae-302a-4134-83a3-5c345d82ddd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:45.957398 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb9bae-302a-4134-83a3-5c345d82ddd3 None admin] PATH_INFO: `/v3/projects/f040c41677374080a6ee1538a7a34a54` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:45.958786 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb9bae-302a-4134-83a3-5c345d82ddd3 None admin] RBAC: Authorizing `identity:get_project(project_id=f040c41677374080a6ee1538a7a34a54)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:45.960796 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb9bae-302a-4134-83a3-5c345d82ddd3 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:45.962769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 56/111] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:58:45 2022] GET /identity/v3/projects/f040c41677374080a6ee1538a7a34a54 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:45.963762 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb9bae-302a-4134-83a3-5c345d82ddd3 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:45.968905 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 56/112] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:58:45.970026 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400e6d5-0738-4c66-99f8-7480b72ac955 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:46.068237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:46.084034 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb9bae-302a-4134-83a3-5c345d82ddd3 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:46.122893 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400e6d5-0738-4c66-99f8-7480b72ac955 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:46.135058 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27231468-bf94-4891-a8a2-6f5137d04ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:46.136739 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27231468-bf94-4891-a8a2-6f5137d04ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:46.137539 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27231468-bf94-4891-a8a2-6f5137d04ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:46.138163 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27231468-bf94-4891-a8a2-6f5137d04ad6 None admin] PATH_INFO: `/v3/users/261ffbf813e14043b38c0f775d35808a` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:46.141525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:46.158378 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27231468-bf94-4891-a8a2-6f5137d04ad6 None admin] RBAC: Authorizing `identity:get_user(user_id=261ffbf813e14043b38c0f775d35808a)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:46.159867 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27231468-bf94-4891-a8a2-6f5137d04ad6 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:46.162115 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 57/113] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:58:45 2022] GET /identity/v3/users/261ffbf813e14043b38c0f775d35808a => generated 289 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:46.166672 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27231468-bf94-4891-a8a2-6f5137d04ad6 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:46.172275 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f30666-c18f-4c80-b5ab-eb7ff4cbdbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:46.173411 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f30666-c18f-4c80-b5ab-eb7ff4cbdbdd None admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:46.174881 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f30666-c18f-4c80-b5ab-eb7ff4cbdbdd None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:46.175395 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f30666-c18f-4c80-b5ab-eb7ff4cbdbdd None admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:46.176433 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f30666-c18f-4c80-b5ab-eb7ff4cbdbdd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:46.178276 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f30666-c18f-4c80-b5ab-eb7ff4cbdbdd None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:46.261208 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 57/114] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Jun 22 09:58:45 2022] POST /identity/v3/projects => generated 302 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:58:46.267979 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27231468-bf94-4891-a8a2-6f5137d04ad6 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:46.269881 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f30666-c18f-4c80-b5ab-eb7ff4cbdbdd None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:46.319330 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e502b86-d487-4077-b1b4-1080bce6b563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:46.320263 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e502b86-d487-4077-b1b4-1080bce6b563 None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:46.320558 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e502b86-d487-4077-b1b4-1080bce6b563 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:46.320867 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e502b86-d487-4077-b1b4-1080bce6b563 None admin] PATH_INFO: `/v3/projects/f040c41677374080a6ee1538a7a34a54/users/d3bcf2a71eef4b3fa6f7b6c18edc4d2f/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:46.324315 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e502b86-d487-4077-b1b4-1080bce6b563 None admin] RBAC: Authorizing `identity:create_grant(project_id=f040c41677374080a6ee1538a7a34a54, user_id=d3bcf2a71eef4b3fa6f7b6c18edc4d2f, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:46.325865 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e502b86-d487-4077-b1b4-1080bce6b563 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:46.391442 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f30666-c18f-4c80-b5ab-eb7ff4cbdbdd None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:46.409475 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:46.424530 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 58/115] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 22 09:58:46 2022] PUT /identity/v3/projects/f040c41677374080a6ee1538a7a34a54/users/d3bcf2a71eef4b3fa6f7b6c18edc4d2f/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:58:46.424530 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e502b86-d487-4077-b1b4-1080bce6b563 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:46.437579 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906356f3-9a6b-4c72-8c82-413ff6517072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:46.438409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906356f3-9a6b-4c72-8c82-413ff6517072 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:46.438701 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906356f3-9a6b-4c72-8c82-413ff6517072 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:46.438984 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906356f3-9a6b-4c72-8c82-413ff6517072 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:46.461352 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906356f3-9a6b-4c72-8c82-413ff6517072 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:58:46.470004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-906356f3-9a6b-4c72-8c82-413ff6517072 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 09:58:46.470004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:58:46.470004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:58:46.470004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:58:46.470004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:58:46.470004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:58:46.470004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:58:46.470004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:58:46.470004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:58:46.470004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:58:46.470004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:58:46.470004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:58:46.470004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:58:46.470004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:58:46.470004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:58:46.470004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:58:46.470910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:58:46.470910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:58:46.470910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:58:46.470910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:58:46.470910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:58:46.470910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:58:46.470910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:58:46.470910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:58:46.470910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:58:46.470910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:58:46.470910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:58:46.470910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:58:46.470910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:58:46.470910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:58:46.470910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:58:46.470910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:58:46.477063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:58:46.477063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:58:46.477063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:58:46.477063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:58:46.477063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:58:46.477063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:58:46.477063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:58:46.477063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:58:46.477063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:58:46.477063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:58:46.477063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 09:58:46.477063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:58:46.477063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 58/116] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 09:58:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:58:46.477063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961aa26-dbce-4e78-81ed-d52f00836c87 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:46.477752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961aa26-dbce-4e78-81ed-d52f00836c87 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:46.477752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961aa26-dbce-4e78-81ed-d52f00836c87 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:46.477752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 59/117] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:58:46.477752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32bdd4-45c4-4ca0-bbb3-170cf8c4fe12 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:46.477752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32bdd4-45c4-4ca0-bbb3-170cf8c4fe12 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:46.477752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32bdd4-45c4-4ca0-bbb3-170cf8c4fe12 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:46.478464 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 60/118] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:58:46.480961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32bdd4-45c4-4ca0-bbb3-170cf8c4fe12 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:46.506623 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:46.576955 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e502b86-d487-4077-b1b4-1080bce6b563 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:46.616444 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32bdd4-45c4-4ca0-bbb3-170cf8c4fe12 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:46.624955 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a6290-f182-4650-a13e-86fc909393c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:46.625625 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a6290-f182-4650-a13e-86fc909393c9 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:46.625913 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a6290-f182-4650-a13e-86fc909393c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:46.626190 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a6290-f182-4650-a13e-86fc909393c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:46.662671 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6db183-5930-4792-831d-ced2ec8eed47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:46.664447 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6db183-5930-4792-831d-ced2ec8eed47 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:46.665195 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6db183-5930-4792-831d-ced2ec8eed47 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:46.665645 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6db183-5930-4792-831d-ced2ec8eed47 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:46.666588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6db183-5930-4792-831d-ced2ec8eed47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:46.667314 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6db183-5930-4792-831d-ced2ec8eed47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:46.670560 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6db183-5930-4792-831d-ced2ec8eed47 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:46.680656 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 61/119] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:58:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:46.682142 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ff16d-d5d2-4680-9f73-6748256c53bb None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:46.682462 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ff16d-d5d2-4680-9f73-6748256c53bb None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:46.683038 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ff16d-d5d2-4680-9f73-6748256c53bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:46.701906 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-204ff16d-d5d2-4680-9f73-6748256c53bb None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:46.703197 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-204ff16d-d5d2-4680-9f73-6748256c53bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:46.707925 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a6290-f182-4650-a13e-86fc909393c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:46.709756 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a6290-f182-4650-a13e-86fc909393c9 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:46.737589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:46.766077 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:46.781395 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 62/120] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:58:46.783015 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8bed9-abca-4f90-a745-d35e180384cd None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:46.783486 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8bed9-abca-4f90-a745-d35e180384cd None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:46.783942 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8bed9-abca-4f90-a745-d35e180384cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:46.802135 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-17f8bed9-abca-4f90-a745-d35e180384cd None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:46.803615 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-17f8bed9-abca-4f90-a745-d35e180384cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:46.818441 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 59/121] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:58:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 09:58:46.819445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a6290-f182-4650-a13e-86fc909393c9 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:46.882968 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 63/122] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:58:46.884131 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8bed9-abca-4f90-a745-d35e180384cd None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:46.992205 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a6290-f182-4650-a13e-86fc909393c9 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:47.023379 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:47.027385 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8bed9-abca-4f90-a745-d35e180384cd None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:47.040331 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d752597-0ff8-416b-8e32-961672fc2c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:47.041760 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d752597-0ff8-416b-8e32-961672fc2c73 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:47.042632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d752597-0ff8-416b-8e32-961672fc2c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:47.043128 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d752597-0ff8-416b-8e32-961672fc2c73 None admin] PATH_INFO: `/v3/users/af7691de913843509188548c36ece976` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:47.044810 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d752597-0ff8-416b-8e32-961672fc2c73 None admin] RBAC: Authorizing `identity:get_user(user_id=af7691de913843509188548c36ece976)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:47.046876 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d752597-0ff8-416b-8e32-961672fc2c73 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:47.048771 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 60/123] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:58:46 2022] GET /identity/v3/users/af7691de913843509188548c36ece976 => generated 247 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:47.050361 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d752597-0ff8-416b-8e32-961672fc2c73 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:47.066008 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207fd4aa-fa4d-419e-8a0c-a70f5be69d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:47.067017 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fd4aa-fa4d-419e-8a0c-a70f5be69d59 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:47.067379 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fd4aa-fa4d-419e-8a0c-a70f5be69d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:47.067796 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fd4aa-fa4d-419e-8a0c-a70f5be69d59 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:47.080255 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207fd4aa-fa4d-419e-8a0c-a70f5be69d59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:58:47.084108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:47.089274 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-207fd4aa-fa4d-419e-8a0c-a70f5be69d59 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:58:47.089274 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:58:47.089274 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:58:47.089274 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:58:47.089274 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:58:47.089274 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:58:47.089274 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:58:47.089274 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:58:47.089274 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:58:47.089274 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:58:47.089274 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:58:47.089274 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:58:47.089274 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:58:47.089274 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:58:47.089274 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:58:47.089274 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:58:47.091387 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:58:47.091387 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:58:47.091387 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:58:47.091387 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:58:47.091387 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:58:47.091387 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:58:47.091387 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:58:47.091387 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:58:47.091387 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:58:47.091387 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:58:47.091387 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:58:47.091387 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:58:47.091387 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:58:47.091387 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:58:47.091387 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:58:47.091387 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:58:47.092302 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:58:47.092302 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:58:47.092302 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:58:47.092302 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:58:47.092302 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:58:47.092302 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:58:47.092302 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:58:47.092302 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:58:47.092302 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:58:47.092302 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:58:47.092302 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:58:47.092302 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:58:47.092302 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 64/124] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:58:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:58:47.092302 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207fd4aa-fa4d-419e-8a0c-a70f5be69d59 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:47.199297 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d752597-0ff8-416b-8e32-961672fc2c73 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:47.208790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207fd4aa-fa4d-419e-8a0c-a70f5be69d59 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:47.235986 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a69701-e028-4c26-b61d-494bc01bab59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:47.237010 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a69701-e028-4c26-b61d-494bc01bab59 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:47.237370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a69701-e028-4c26-b61d-494bc01bab59 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:47.237730 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a69701-e028-4c26-b61d-494bc01bab59 None admin] PATH_INFO: `/v3/projects/f040c41677374080a6ee1538a7a34a54` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:47.239060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a69701-e028-4c26-b61d-494bc01bab59 None admin] RBAC: Authorizing `identity:get_project(project_id=f040c41677374080a6ee1538a7a34a54)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:47.240597 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a69701-e028-4c26-b61d-494bc01bab59 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:47.242482 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 61/125] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:58:47 2022] GET /identity/v3/projects/f040c41677374080a6ee1538a7a34a54 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:47.243337 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a69701-e028-4c26-b61d-494bc01bab59 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:47.254860 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7eab2-dd2f-451a-8b20-6984f1af48b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:47.256415 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7eab2-dd2f-451a-8b20-6984f1af48b4 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:47.256908 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7eab2-dd2f-451a-8b20-6984f1af48b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:47.257721 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7eab2-dd2f-451a-8b20-6984f1af48b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:47.272461 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7eab2-dd2f-451a-8b20-6984f1af48b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:58:47.283914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-a8f7eab2-dd2f-451a-8b20-6984f1af48b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 09:58:47.283914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:58:47.283914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:58:47.283914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:58:47.283914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:58:47.283914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:58:47.283914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:58:47.283914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:58:47.283914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:58:47.283914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:58:47.283914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:58:47.283914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:58:47.283914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:58:47.283914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:58:47.283914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:58:47.283914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:58:47.284758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:58:47.284758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:58:47.284758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:58:47.284758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:58:47.284758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:58:47.284758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:58:47.284758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:58:47.284758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:58:47.284758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:58:47.284758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:58:47.284758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:58:47.284758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:58:47.284758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:58:47.284758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:58:47.284758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:58:47.284758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:58:47.285819 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:58:47.285819 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:58:47.285819 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:58:47.285819 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:58:47.285819 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:58:47.285819 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:58:47.285819 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:58:47.285819 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:58:47.285819 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:58:47.285819 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:58:47.285819 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 09:58:47.285819 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:58:47.288406 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 65/126] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 22 09:58:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:58:47.294266 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7eab2-dd2f-451a-8b20-6984f1af48b4 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:47.320367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:47.352202 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:47.368646 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a69701-e028-4c26-b61d-494bc01bab59 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:47.412924 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ad38c-0abb-49e2-a390-92c5a2f7e984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:47.414170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7eab2-dd2f-451a-8b20-6984f1af48b4 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:47.414433 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ad38c-0abb-49e2-a390-92c5a2f7e984 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:47.414930 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ad38c-0abb-49e2-a390-92c5a2f7e984 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:47.415407 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ad38c-0abb-49e2-a390-92c5a2f7e984 None admin] PATH_INFO: `/v3/projects/f040c41677374080a6ee1538a7a34a54` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:47.418256 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ad38c-0abb-49e2-a390-92c5a2f7e984 None admin] RBAC: Authorizing `identity:get_project(project_id=f040c41677374080a6ee1538a7a34a54)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:47.419959 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ad38c-0abb-49e2-a390-92c5a2f7e984 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:47.422940 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 62/127] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:58:47 2022] GET /identity/v3/projects/f040c41677374080a6ee1538a7a34a54 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:47.424050 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ad38c-0abb-49e2-a390-92c5a2f7e984 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:47.456938 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc8d85-7c5b-47cb-acf2-51f80922653c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:47.458199 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc8d85-7c5b-47cb-acf2-51f80922653c None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:47.459103 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc8d85-7c5b-47cb-acf2-51f80922653c None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:47.459880 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc8d85-7c5b-47cb-acf2-51f80922653c None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:47.461381 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc8d85-7c5b-47cb-acf2-51f80922653c None admin] RBAC: Adding query filter params (name=member) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:47.462308 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc8d85-7c5b-47cb-acf2-51f80922653c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:47.464273 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc8d85-7c5b-47cb-acf2-51f80922653c None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:47.476124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 66/128] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 22 09:58:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:47.477715 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc8d85-7c5b-47cb-acf2-51f80922653c None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:47.536344 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ad38c-0abb-49e2-a390-92c5a2f7e984 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:47.585486 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4cb60-8ce4-406c-b3d0-5ada47766889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:47.586955 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4cb60-8ce4-406c-b3d0-5ada47766889 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:47.587744 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4cb60-8ce4-406c-b3d0-5ada47766889 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:47.588205 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4cb60-8ce4-406c-b3d0-5ada47766889 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:47.589350 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:47.589943 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4cb60-8ce4-406c-b3d0-5ada47766889 None admin] RBAC: Adding query filter params (role.id=e744213e97f341cd862b25d2c45af211, scope.project.id=f040c41677374080a6ee1538a7a34a54, user.id=261ffbf813e14043b38c0f775d35808a) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:47.591124 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4cb60-8ce4-406c-b3d0-5ada47766889 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:47.593202 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4cb60-8ce4-406c-b3d0-5ada47766889 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:47.600896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 63/129] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 09:58:47 2022] GET /identity/v3/role_assignments?user.id=261ffbf813e14043b38c0f775d35808a&scope.project.id=f040c41677374080a6ee1538a7a34a54&role.id=e744213e97f341cd862b25d2c45af211 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:47.611164 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4cb60-8ce4-406c-b3d0-5ada47766889 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:47.611902 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc8d85-7c5b-47cb-acf2-51f80922653c None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:47.635374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:47.662035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c351f-47b8-4930-8efc-173de5f8ef24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:47.663526 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c351f-47b8-4930-8efc-173de5f8ef24 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:47.664554 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c351f-47b8-4930-8efc-173de5f8ef24 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:47.665024 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c351f-47b8-4930-8efc-173de5f8ef24 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:47.666269 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c351f-47b8-4930-8efc-173de5f8ef24 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:47.666756 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c351f-47b8-4930-8efc-173de5f8ef24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:47.669115 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c351f-47b8-4930-8efc-173de5f8ef24 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:47.680754 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 67/130] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 09:58:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:47.684006 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c351f-47b8-4930-8efc-173de5f8ef24 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:47.730020 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4cb60-8ce4-406c-b3d0-5ada47766889 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:47.769795 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c148a-22c4-42e4-a34a-cdd027ccc224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:47.770695 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c148a-22c4-42e4-a34a-cdd027ccc224 None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:47.771079 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c148a-22c4-42e4-a34a-cdd027ccc224 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:47.771458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c148a-22c4-42e4-a34a-cdd027ccc224 None admin] PATH_INFO: `/v3/projects/f040c41677374080a6ee1538a7a34a54/users/af7691de913843509188548c36ece976/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:47.773598 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c148a-22c4-42e4-a34a-cdd027ccc224 None admin] RBAC: Authorizing `identity:create_grant(project_id=f040c41677374080a6ee1538a7a34a54, user_id=af7691de913843509188548c36ece976, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:47.775427 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c148a-22c4-42e4-a34a-cdd027ccc224 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:47.823275 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c351f-47b8-4930-8efc-173de5f8ef24 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:47.863612 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b7ddb-080c-4172-9d29-25a92abe4611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:47.864755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b7ddb-080c-4172-9d29-25a92abe4611 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:47.865243 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b7ddb-080c-4172-9d29-25a92abe4611 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:47.865665 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b7ddb-080c-4172-9d29-25a92abe4611 None admin] PATH_INFO: `/v3/users/d3bcf2a71eef4b3fa6f7b6c18edc4d2f` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:47.867077 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b7ddb-080c-4172-9d29-25a92abe4611 None admin] RBAC: Authorizing `identity:get_user(user_id=d3bcf2a71eef4b3fa6f7b6c18edc4d2f)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:47.868660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b7ddb-080c-4172-9d29-25a92abe4611 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:47.870469 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 68/131] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:58:47 2022] GET /identity/v3/users/d3bcf2a71eef4b3fa6f7b6c18edc4d2f => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:47.871654 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b7ddb-080c-4172-9d29-25a92abe4611 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:47.885216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:47.887359 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 64/132] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 22 09:58:47 2022] PUT /identity/v3/projects/f040c41677374080a6ee1538a7a34a54/users/af7691de913843509188548c36ece976/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:58:47.887990 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c148a-22c4-42e4-a34a-cdd027ccc224 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:47.986971 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b7ddb-080c-4172-9d29-25a92abe4611 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:48.035424 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4015575-09ea-412c-9e43-76bffb2d5875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:48.036645 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4015575-09ea-412c-9e43-76bffb2d5875 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:48.037131 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4015575-09ea-412c-9e43-76bffb2d5875 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:48.037688 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4015575-09ea-412c-9e43-76bffb2d5875 None admin] PATH_INFO: `/v3/users/d3bcf2a71eef4b3fa6f7b6c18edc4d2f` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:48.039233 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4015575-09ea-412c-9e43-76bffb2d5875 None admin] RBAC: Authorizing `identity:get_user(user_id=d3bcf2a71eef4b3fa6f7b6c18edc4d2f)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:48.040905 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4015575-09ea-412c-9e43-76bffb2d5875 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:48.042841 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 69/133] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:58:47 2022] GET /identity/v3/users/d3bcf2a71eef4b3fa6f7b6c18edc4d2f => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:48.052933 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4015575-09ea-412c-9e43-76bffb2d5875 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:48.058951 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:48.099789 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c148a-22c4-42e4-a34a-cdd027ccc224 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:48.174844 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:48.178934 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73dde8-2e56-4c37-aa63-bce89182ca06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:48.180097 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73dde8-2e56-4c37-aa63-bce89182ca06 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:48.180325 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73dde8-2e56-4c37-aa63-bce89182ca06 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:48.180700 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73dde8-2e56-4c37-aa63-bce89182ca06 None admin] PATH_INFO: `/v3/projects/12bba9925e2a4739bd44159d3be6d8f9` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:48.182035 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73dde8-2e56-4c37-aa63-bce89182ca06 None admin] RBAC: Authorizing `identity:get_project(project_id=12bba9925e2a4739bd44159d3be6d8f9)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:48.183658 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73dde8-2e56-4c37-aa63-bce89182ca06 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:48.191100 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 65/134] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:58:47 2022] GET /identity/v3/projects/12bba9925e2a4739bd44159d3be6d8f9 => generated 312 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:48.196628 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73dde8-2e56-4c37-aa63-bce89182ca06 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:48.200874 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4015575-09ea-412c-9e43-76bffb2d5875 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:48.257614 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b9a3c-f589-45fd-bc6a-1478c69a6637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:48.258520 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b9a3c-f589-45fd-bc6a-1478c69a6637 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:48.258815 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b9a3c-f589-45fd-bc6a-1478c69a6637 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:48.259102 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b9a3c-f589-45fd-bc6a-1478c69a6637 None admin] PATH_INFO: `/v3/projects/f040c41677374080a6ee1538a7a34a54` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:48.260408 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b9a3c-f589-45fd-bc6a-1478c69a6637 None admin] RBAC: Authorizing `identity:get_project(project_id=f040c41677374080a6ee1538a7a34a54)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:48.262476 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b9a3c-f589-45fd-bc6a-1478c69a6637 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:48.264219 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 70/135] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:58:48 2022] GET /identity/v3/projects/f040c41677374080a6ee1538a7a34a54 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:58:48.273849 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b9a3c-f589-45fd-bc6a-1478c69a6637 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:48.380161 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73dde8-2e56-4c37-aa63-bce89182ca06 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:48.478314 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184eb8b9-2729-4784-bd5b-0a6e06cd77ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:48.479232 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184eb8b9-2729-4784-bd5b-0a6e06cd77ff None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:48.479520 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184eb8b9-2729-4784-bd5b-0a6e06cd77ff None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:48.479799 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184eb8b9-2729-4784-bd5b-0a6e06cd77ff None admin] PATH_INFO: `/v3/projects/12bba9925e2a4739bd44159d3be6d8f9/users/d3bcf2a71eef4b3fa6f7b6c18edc4d2f/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:48.482430 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184eb8b9-2729-4784-bd5b-0a6e06cd77ff None admin] RBAC: Authorizing `identity:create_grant(project_id=12bba9925e2a4739bd44159d3be6d8f9, user_id=d3bcf2a71eef4b3fa6f7b6c18edc4d2f, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:48.483898 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184eb8b9-2729-4784-bd5b-0a6e06cd77ff None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:48.492657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b9a3c-f589-45fd-bc6a-1478c69a6637 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:48.552489 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc5efc-6854-432e-b05e-554d999450eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:48.553432 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc5efc-6854-432e-b05e-554d999450eb None admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:48.553717 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc5efc-6854-432e-b05e-554d999450eb None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:48.554030 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc5efc-6854-432e-b05e-554d999450eb None admin] PATH_INFO: `/v3/projects/f040c41677374080a6ee1538a7a34a54/users/d3bcf2a71eef4b3fa6f7b6c18edc4d2f/roles/7783830649d941ea9507439a113fc5d9` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:48.556468 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc5efc-6854-432e-b05e-554d999450eb None admin] RBAC: Authorizing `identity:create_grant(project_id=f040c41677374080a6ee1538a7a34a54, user_id=d3bcf2a71eef4b3fa6f7b6c18edc4d2f, role_id=7783830649d941ea9507439a113fc5d9)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:48.558006 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc5efc-6854-432e-b05e-554d999450eb None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:48.589239 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 66/136] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 22 09:58:48 2022] PUT /identity/v3/projects/12bba9925e2a4739bd44159d3be6d8f9/users/d3bcf2a71eef4b3fa6f7b6c18edc4d2f/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:58:48.656409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 71/137] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 22 09:58:48 2022] PUT /identity/v3/projects/f040c41677374080a6ee1538a7a34a54/users/d3bcf2a71eef4b3fa6f7b6c18edc4d2f/roles/7783830649d941ea9507439a113fc5d9 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:58:48.758704 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da766e-a2a9-47b0-9204-b18517a87977 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:48.759041 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da766e-a2a9-47b0-9204-b18517a87977 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:48.759285 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da766e-a2a9-47b0-9204-b18517a87977 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:48.760700 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 67/138] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:58:48.779360 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeef618-94b6-4fc5-9935-31073ef5e5de None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:48.779885 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeef618-94b6-4fc5-9935-31073ef5e5de None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:48.779973 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeef618-94b6-4fc5-9935-31073ef5e5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:48.793391 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:48.802878 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-feeef618-94b6-4fc5-9935-31073ef5e5de None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:48.804107 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-feeef618-94b6-4fc5-9935-31073ef5e5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:48.892966 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 72/139] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:58:48.926845 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da766e-a2a9-47b0-9204-b18517a87977 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:48.938816 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:49.052333 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da766e-a2a9-47b0-9204-b18517a87977 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:49.078555 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffa6d8-8510-4600-8ac0-d0fd0be0af3b None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:49.078856 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffa6d8-8510-4600-8ac0-d0fd0be0af3b None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:49.079115 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffa6d8-8510-4600-8ac0-d0fd0be0af3b None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:49.080601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 73/140] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:58:49.086423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2ae2a-35dc-41eb-89e4-e81fae8970f6 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:49.086708 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2ae2a-35dc-41eb-89e4-e81fae8970f6 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:49.086999 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2ae2a-35dc-41eb-89e4-e81fae8970f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:49.102344 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a2b9b-832c-429b-923f-43d454fba313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:49.103157 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a2b9b-832c-429b-923f-43d454fba313 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:49.103446 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a2b9b-832c-429b-923f-43d454fba313 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:49.103727 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a2b9b-832c-429b-923f-43d454fba313 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:49.119206 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-55f2ae2a-35dc-41eb-89e4-e81fae8970f6 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:49.122346 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-55f2ae2a-35dc-41eb-89e4-e81fae8970f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:49.130007 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a2b9b-832c-429b-923f-43d454fba313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:58:49.145896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-dc8a2b9b-832c-429b-923f-43d454fba313 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:58:49.145896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:58:49.145896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:58:49.145896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:58:49.145896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:58:49.145896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:58:49.145896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:58:49.145896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:58:49.145896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:58:49.145896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:58:49.145896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:58:49.145896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:58:49.145896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:58:49.145896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:58:49.145896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:58:49.145896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:58:49.148301 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:58:49.148301 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:58:49.148301 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:58:49.148301 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:58:49.148301 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:58:49.148301 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:58:49.148301 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:58:49.148301 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:58:49.148301 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:58:49.148301 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:58:49.148301 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:58:49.148301 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:58:49.148301 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:58:49.148301 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:58:49.148301 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:58:49.148301 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:58:49.150217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:58:49.150217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:58:49.150217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:58:49.150217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:58:49.150217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:58:49.150217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:58:49.150217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:58:49.150217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:58:49.150217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:58:49.150217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:58:49.150217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:58:49.150217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:58:49.150217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 68/141] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:58:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:58:49.157582 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a2b9b-832c-429b-923f-43d454fba313 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:49.244758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 74/142] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:58:49.262822 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:49.289665 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2ae2a-35dc-41eb-89e4-e81fae8970f6 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:49.320375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a2b9b-832c-429b-923f-43d454fba313 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:49.368693 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12fff2-1475-4c0f-ab6e-b4daa8f0d37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:49.369407 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12fff2-1475-4c0f-ab6e-b4daa8f0d37f None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:49.369697 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12fff2-1475-4c0f-ab6e-b4daa8f0d37f None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:49.369977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12fff2-1475-4c0f-ab6e-b4daa8f0d37f None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:49.370783 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12fff2-1475-4c0f-ab6e-b4daa8f0d37f None admin] RBAC: Adding query filter params (name=member) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:49.371820 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12fff2-1475-4c0f-ab6e-b4daa8f0d37f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:49.373471 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12fff2-1475-4c0f-ab6e-b4daa8f0d37f None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:49.389308 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 69/143] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 22 09:58:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:58:49.395070 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12fff2-1475-4c0f-ab6e-b4daa8f0d37f None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:49.420347 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:49.508877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2ae2a-35dc-41eb-89e4-e81fae8970f6 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:49.526642 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12fff2-1475-4c0f-ab6e-b4daa8f0d37f None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:49.560351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:49.570914 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a879d-7031-4e98-96f9-2550cb0e53ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:49.572895 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a879d-7031-4e98-96f9-2550cb0e53ec None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:49.574439 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a879d-7031-4e98-96f9-2550cb0e53ec None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:49.575467 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a879d-7031-4e98-96f9-2550cb0e53ec None admin] PATH_INFO: `/v3/users/d3bcf2a71eef4b3fa6f7b6c18edc4d2f` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:49.578116 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a879d-7031-4e98-96f9-2550cb0e53ec None admin] RBAC: Authorizing `identity:get_user(user_id=d3bcf2a71eef4b3fa6f7b6c18edc4d2f)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:49.580469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a879d-7031-4e98-96f9-2550cb0e53ec None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:49.583437 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 70/144] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:58:49 2022] GET /identity/v3/users/d3bcf2a71eef4b3fa6f7b6c18edc4d2f => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:49.589733 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a879d-7031-4e98-96f9-2550cb0e53ec None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:49.590621 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92b8e8-45f5-418e-a183-1446870bc490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:49.591677 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92b8e8-45f5-418e-a183-1446870bc490 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:49.592202 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92b8e8-45f5-418e-a183-1446870bc490 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:49.592697 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92b8e8-45f5-418e-a183-1446870bc490 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:49.594224 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92b8e8-45f5-418e-a183-1446870bc490 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:49.596211 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92b8e8-45f5-418e-a183-1446870bc490 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:49.598453 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 75/145] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:58:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:58:49.613556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92b8e8-45f5-418e-a183-1446870bc490 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:49.791298 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92b8e8-45f5-418e-a183-1446870bc490 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:49.798323 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a879d-7031-4e98-96f9-2550cb0e53ec None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:49.833949 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37820dc9-0b29-4f72-b6b2-9335af111e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:49.835229 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37820dc9-0b29-4f72-b6b2-9335af111e23 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:49.835700 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37820dc9-0b29-4f72-b6b2-9335af111e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:49.836160 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37820dc9-0b29-4f72-b6b2-9335af111e23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:49.838079 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86930317-fc4f-40f4-a2ee-0812ccb502fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:49.838773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86930317-fc4f-40f4-a2ee-0812ccb502fc None admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:49.839061 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86930317-fc4f-40f4-a2ee-0812ccb502fc None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:49.839376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86930317-fc4f-40f4-a2ee-0812ccb502fc None admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:49.840231 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86930317-fc4f-40f4-a2ee-0812ccb502fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:49.841876 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86930317-fc4f-40f4-a2ee-0812ccb502fc None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:49.855261 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:49.908861 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:49.913284 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37820dc9-0b29-4f72-b6b2-9335af111e23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:49.914988 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37820dc9-0b29-4f72-b6b2-9335af111e23 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:50.022126 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 71/146] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:58:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 09:58:50.023893 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 76/147] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 22 09:58:49 2022] POST /identity/v3/users => generated 283 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:58:50.037330 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37820dc9-0b29-4f72-b6b2-9335af111e23 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:50.150255 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:50.154532 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37820dc9-0b29-4f72-b6b2-9335af111e23 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:50.208799 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5bdc3-6443-4da6-8edb-c09c927f6693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:50.209974 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5bdc3-6443-4da6-8edb-c09c927f6693 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:50.210266 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5bdc3-6443-4da6-8edb-c09c927f6693 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:50.210546 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5bdc3-6443-4da6-8edb-c09c927f6693 None admin] PATH_INFO: `/v3/projects/f040c41677374080a6ee1538a7a34a54` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:50.213667 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5bdc3-6443-4da6-8edb-c09c927f6693 None admin] RBAC: Authorizing `identity:get_project(project_id=f040c41677374080a6ee1538a7a34a54)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:50.215294 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c5bdc3-6443-4da6-8edb-c09c927f6693 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:50.217197 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 72/148] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:58:50 2022] GET /identity/v3/projects/f040c41677374080a6ee1538a7a34a54 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:50.223236 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86930317-fc4f-40f4-a2ee-0812ccb502fc None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:50.347534 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918cac3-04d0-4d10-a615-9118eaf3f2ac None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:50.347840 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918cac3-04d0-4d10-a615-9118eaf3f2ac None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:50.348094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918cac3-04d0-4d10-a615-9118eaf3f2ac None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:50.349633 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 73/149] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 09:58:50.359268 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f13d8-f8a8-4aeb-a3d2-f19675b34b48 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:50.359268 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f13d8-f8a8-4aeb-a3d2-f19675b34b48 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:50.359268 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f13d8-f8a8-4aeb-a3d2-f19675b34b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:50.384637 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-392f13d8-f8a8-4aeb-a3d2-f19675b34b48 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:50.387030 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86930317-fc4f-40f4-a2ee-0812ccb502fc None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:50.389600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-392f13d8-f8a8-4aeb-a3d2-f19675b34b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:50.450061 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea522f-d8da-45bb-ac41-8610289863db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:50.450911 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea522f-d8da-45bb-ac41-8610289863db None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:50.451849 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea522f-d8da-45bb-ac41-8610289863db None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:50.452137 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea522f-d8da-45bb-ac41-8610289863db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:50.453024 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea522f-d8da-45bb-ac41-8610289863db None admin] RBAC: Adding query filter params (role.id=b8f82737ef614907a0d320c6e1f2facf, scope.project.id=f040c41677374080a6ee1538a7a34a54, user.id=d3bcf2a71eef4b3fa6f7b6c18edc4d2f) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:50.453342 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea522f-d8da-45bb-ac41-8610289863db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:50.454826 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea522f-d8da-45bb-ac41-8610289863db None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:50.470683 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 77/150] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 09:58:50 2022] GET /identity/v3/role_assignments?user.id=d3bcf2a71eef4b3fa6f7b6c18edc4d2f&scope.project.id=f040c41677374080a6ee1538a7a34a54&role.id=b8f82737ef614907a0d320c6e1f2facf => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:50.506283 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 74/151] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 09:58:50.539737 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea522f-d8da-45bb-ac41-8610289863db None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:50.626765 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:50.681181 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea522f-d8da-45bb-ac41-8610289863db None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:50.736195 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00c5aa-901d-4301-9576-5cb5d5fee1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:50.736951 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00c5aa-901d-4301-9576-5cb5d5fee1e6 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:50.737244 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00c5aa-901d-4301-9576-5cb5d5fee1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:50.737526 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00c5aa-901d-4301-9576-5cb5d5fee1e6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:50.752138 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00c5aa-901d-4301-9576-5cb5d5fee1e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:58:50.760094 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-0c00c5aa-901d-4301-9576-5cb5d5fee1e6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 09:58:50.760094 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:58:50.760094 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:58:50.760094 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:58:50.760094 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:58:50.760094 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:58:50.760094 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:58:50.760094 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:58:50.760094 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:58:50.760094 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:58:50.760094 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:58:50.760094 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:58:50.760094 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:58:50.760094 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:58:50.760094 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:58:50.760094 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:58:50.761006 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:58:50.761006 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:58:50.761006 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:58:50.761006 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:58:50.761006 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:58:50.761006 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:58:50.761006 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:58:50.761006 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:58:50.761006 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:58:50.761006 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:58:50.761006 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:58:50.761006 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:58:50.761006 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:58:50.761006 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:58:50.761006 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:58:50.761006 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:58:50.761773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:58:50.761773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:58:50.761773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:58:50.761773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:58:50.761773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:58:50.761773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:58:50.761773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:58:50.761773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:58:50.761773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:58:50.761773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:58:50.761773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 09:58:50.761773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:58:50.761773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 78/152] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:58:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:58:50.768756 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f13d8-f8a8-4aeb-a3d2-f19675b34b48 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:50.876664 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:50.883267 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f13d8-f8a8-4aeb-a3d2-f19675b34b48 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:50.921742 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa96b70-1eec-4cf6-9f51-06dbfb40ef52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:50.922429 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa96b70-1eec-4cf6-9f51-06dbfb40ef52 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:50.922715 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa96b70-1eec-4cf6-9f51-06dbfb40ef52 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:50.922993 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa96b70-1eec-4cf6-9f51-06dbfb40ef52 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:50.923764 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa96b70-1eec-4cf6-9f51-06dbfb40ef52 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:50.924074 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa96b70-1eec-4cf6-9f51-06dbfb40ef52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:50.925510 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa96b70-1eec-4cf6-9f51-06dbfb40ef52 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:50.939864 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 75/153] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 22 09:58:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:50.941461 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00c5aa-901d-4301-9576-5cb5d5fee1e6 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:51.057737 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00c5aa-901d-4301-9576-5cb5d5fee1e6 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:51.074626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:51.095776 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e7b45-b34a-4a10-a55e-9865033e7636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:51.096688 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e7b45-b34a-4a10-a55e-9865033e7636 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:51.097062 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e7b45-b34a-4a10-a55e-9865033e7636 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:51.097349 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e7b45-b34a-4a10-a55e-9865033e7636 None admin] PATH_INFO: `/v3/users/261ffbf813e14043b38c0f775d35808a` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:51.098681 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e7b45-b34a-4a10-a55e-9865033e7636 None admin] RBAC: Authorizing `identity:get_user(user_id=261ffbf813e14043b38c0f775d35808a)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:51.100143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e7b45-b34a-4a10-a55e-9865033e7636 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:51.103124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 79/154] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:58:50 2022] GET /identity/v3/users/261ffbf813e14043b38c0f775d35808a => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:51.111518 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa96b70-1eec-4cf6-9f51-06dbfb40ef52 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:51.201470 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c39c55-52d7-4195-9e51-de1380fb8a26 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:51.201800 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c39c55-52d7-4195-9e51-de1380fb8a26 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:51.202037 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c39c55-52d7-4195-9e51-de1380fb8a26 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:51.203564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 80/155] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 09:58:51.208530 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53563c97-af8b-4e0a-a52e-cde46cf7f63d None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:51.208876 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53563c97-af8b-4e0a-a52e-cde46cf7f63d None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:51.209127 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53563c97-af8b-4e0a-a52e-cde46cf7f63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:51.230866 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-53563c97-af8b-4e0a-a52e-cde46cf7f63d None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:51.232078 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-53563c97-af8b-4e0a-a52e-cde46cf7f63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:51.264812 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa96b70-1eec-4cf6-9f51-06dbfb40ef52 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:51.332427 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8f57d-2830-40d9-ae9b-7f27772252ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:51.333269 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8f57d-2830-40d9-ae9b-7f27772252ce None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:51.333836 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8f57d-2830-40d9-ae9b-7f27772252ce None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:51.333836 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8f57d-2830-40d9-ae9b-7f27772252ce None admin] PATH_INFO: `/v3/projects/f040c41677374080a6ee1538a7a34a54` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:51.336281 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8f57d-2830-40d9-ae9b-7f27772252ce None admin] RBAC: Authorizing `identity:get_project(project_id=f040c41677374080a6ee1538a7a34a54)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:51.337699 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8f57d-2830-40d9-ae9b-7f27772252ce None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:51.339685 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 76/156] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:58:51 2022] GET /identity/v3/projects/f040c41677374080a6ee1538a7a34a54 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:51.345649 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8f57d-2830-40d9-ae9b-7f27772252ce None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:51.372336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 81/157] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 09:58:51.393270 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:51.416557 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53563c97-af8b-4e0a-a52e-cde46cf7f63d None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:51.506872 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8f57d-2830-40d9-ae9b-7f27772252ce None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:51.552045 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec8abe-e14c-40d6-809c-1da8b38d3906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:51.552984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec8abe-e14c-40d6-809c-1da8b38d3906 None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:51.553765 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec8abe-e14c-40d6-809c-1da8b38d3906 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:51.554050 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec8abe-e14c-40d6-809c-1da8b38d3906 None admin] PATH_INFO: `/v3/projects/f040c41677374080a6ee1538a7a34a54/users/261ffbf813e14043b38c0f775d35808a/roles/e744213e97f341cd862b25d2c45af211` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:51.556115 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec8abe-e14c-40d6-809c-1da8b38d3906 None admin] RBAC: Authorizing `identity:create_grant(project_id=f040c41677374080a6ee1538a7a34a54, user_id=261ffbf813e14043b38c0f775d35808a, role_id=e744213e97f341cd862b25d2c45af211)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:51.557636 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec8abe-e14c-40d6-809c-1da8b38d3906 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:51.602303 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53563c97-af8b-4e0a-a52e-cde46cf7f63d None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:51.618564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:51.629155 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 77/158] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 22 09:58:51 2022] PUT /identity/v3/projects/f040c41677374080a6ee1538a7a34a54/users/261ffbf813e14043b38c0f775d35808a/roles/e744213e97f341cd862b25d2c45af211 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:58:51.650899 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0d870-0c55-4486-b9a4-a6b8ff8cc6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:51.651773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0d870-0c55-4486-b9a4-a6b8ff8cc6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:51.652060 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0d870-0c55-4486-b9a4-a6b8ff8cc6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:51.652337 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0d870-0c55-4486-b9a4-a6b8ff8cc6f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:51.665962 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b0d870-0c55-4486-b9a4-a6b8ff8cc6f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:58:51.674207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-c5b0d870-0c55-4486-b9a4-a6b8ff8cc6f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 09:58:51.674207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:58:51.674207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:58:51.674207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:58:51.674207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:58:51.674207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:58:51.674207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:58:51.674207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:58:51.674207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:58:51.674207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:58:51.674207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:58:51.674207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:58:51.674207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:58:51.674207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:58:51.674207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:58:51.674207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:58:51.675118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:58:51.675118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:58:51.675118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:58:51.675118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:58:51.675118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:58:51.675118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:58:51.675118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:58:51.675118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:58:51.675118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:58:51.675118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:58:51.675118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:58:51.675118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:58:51.675118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:58:51.675118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:58:51.675118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:58:51.675118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:58:51.676647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:58:51.676647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:58:51.676647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:58:51.676647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:58:51.676647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:58:51.676647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:58:51.676647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:58:51.676647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:58:51.676647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:58:51.676647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:58:51.676647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 09:58:51.676647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:58:51.676647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 82/159] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 09:58:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 09:58:51.684175 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec8abe-e14c-40d6-809c-1da8b38d3906 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:51.786428 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ba76f-57e4-4cd1-ba58-47700aa8c7e7 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:51.786752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ba76f-57e4-4cd1-ba58-47700aa8c7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:51.787001 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ba76f-57e4-4cd1-ba58-47700aa8c7e7 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:51.788559 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 83/160] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:58:51.802225 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89b686-ad74-444d-8e0f-016d6445818c None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:51.802576 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89b686-ad74-444d-8e0f-016d6445818c None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:51.802798 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89b686-ad74-444d-8e0f-016d6445818c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:51.812630 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:51.832518 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec8abe-e14c-40d6-809c-1da8b38d3906 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:51.842081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-5e89b686-ad74-444d-8e0f-016d6445818c None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:51.843538 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-5e89b686-ad74-444d-8e0f-016d6445818c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:51.873995 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d964e19-52eb-4dc5-beb0-bcadaee6f9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:51.874607 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d964e19-52eb-4dc5-beb0-bcadaee6f9e9 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:51.874896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d964e19-52eb-4dc5-beb0-bcadaee6f9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:51.875176 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d964e19-52eb-4dc5-beb0-bcadaee6f9e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:51.877465 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d964e19-52eb-4dc5-beb0-bcadaee6f9e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:51.877465 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d964e19-52eb-4dc5-beb0-bcadaee6f9e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:51.878308 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d964e19-52eb-4dc5-beb0-bcadaee6f9e9 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:51.893578 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 78/161] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:58:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:51.894729 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d964e19-52eb-4dc5-beb0-bcadaee6f9e9 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:51.969529 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 84/162] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 09:58:52.012340 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89b686-ad74-444d-8e0f-016d6445818c None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:52.013982 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d964e19-52eb-4dc5-beb0-bcadaee6f9e9 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:52.056060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df29aee-7604-4d31-84d9-6e60bfe988a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:52.057437 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df29aee-7604-4d31-84d9-6e60bfe988a4 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:52.057758 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df29aee-7604-4d31-84d9-6e60bfe988a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:52.058087 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df29aee-7604-4d31-84d9-6e60bfe988a4 None admin] PATH_INFO: `/v3/users/af7691de913843509188548c36ece976` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:52.059439 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df29aee-7604-4d31-84d9-6e60bfe988a4 None admin] RBAC: Authorizing `identity:get_user(user_id=af7691de913843509188548c36ece976)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:52.061334 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df29aee-7604-4d31-84d9-6e60bfe988a4 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:52.063491 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 79/163] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:58:51 2022] GET /identity/v3/users/af7691de913843509188548c36ece976 => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:58:52.069271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df29aee-7604-4d31-84d9-6e60bfe988a4 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:52.092246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:52.195681 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df29aee-7604-4d31-84d9-6e60bfe988a4 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:52.237437 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625f98e-0558-410c-a786-7f15bb45d97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:52.238547 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625f98e-0558-410c-a786-7f15bb45d97f None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:52.238836 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625f98e-0558-410c-a786-7f15bb45d97f None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:52.239115 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625f98e-0558-410c-a786-7f15bb45d97f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:52.248539 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89b686-ad74-444d-8e0f-016d6445818c None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:52.250714 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:52.316874 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625f98e-0558-410c-a786-7f15bb45d97f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:52.318620 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625f98e-0558-410c-a786-7f15bb45d97f None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:52.345204 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:52.374245 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad7e15-27d4-4ac9-b2a9-ddece6358a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:52.375659 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad7e15-27d4-4ac9-b2a9-ddece6358a60 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:52.376094 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad7e15-27d4-4ac9-b2a9-ddece6358a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:52.376672 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad7e15-27d4-4ac9-b2a9-ddece6358a60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:52.410620 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad7e15-27d4-4ac9-b2a9-ddece6358a60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:58:52.423781 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-1fad7e15-27d4-4ac9-b2a9-ddece6358a60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:58:52.423781 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:58:52.423781 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:58:52.423781 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:58:52.423781 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:58:52.423781 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:58:52.423781 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:58:52.423781 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:58:52.423781 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:58:52.423781 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:58:52.423781 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:58:52.423781 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:58:52.423781 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:58:52.423781 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:58:52.423781 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:58:52.423781 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:58:52.424690 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:58:52.424690 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:58:52.424690 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:58:52.424690 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:58:52.424690 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:58:52.424690 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:58:52.424690 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:58:52.424690 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:58:52.424690 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:58:52.424690 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:58:52.424690 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:58:52.424690 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:58:52.424690 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:58:52.424690 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:58:52.424690 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:58:52.424690 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:58:52.425503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:58:52.425503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:58:52.425503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:58:52.425503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:58:52.425503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:58:52.425503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:58:52.425503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:58:52.425503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:58:52.425503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:58:52.425503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:58:52.425503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:58:52.425503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:58:52.428202 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 85/164] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:58:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 09:58:52.431982 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 80/165] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:58:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 09:58:52.434246 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad7e15-27d4-4ac9-b2a9-ddece6358a60 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:52.437921 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625f98e-0558-410c-a786-7f15bb45d97f None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:52.574268 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625f98e-0558-410c-a786-7f15bb45d97f None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:52.601189 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:52.621308 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565914f5-db53-4e3d-9d32-282dd9c7effa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:52.622502 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565914f5-db53-4e3d-9d32-282dd9c7effa None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:52.622794 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565914f5-db53-4e3d-9d32-282dd9c7effa None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:52.623074 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565914f5-db53-4e3d-9d32-282dd9c7effa None admin] PATH_INFO: `/v3/projects/f040c41677374080a6ee1538a7a34a54` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:52.629903 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565914f5-db53-4e3d-9d32-282dd9c7effa None admin] RBAC: Authorizing `identity:get_project(project_id=f040c41677374080a6ee1538a7a34a54)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:52.631934 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565914f5-db53-4e3d-9d32-282dd9c7effa None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:52.633754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 81/166] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:58:52 2022] GET /identity/v3/projects/f040c41677374080a6ee1538a7a34a54 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:58:52.640856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc0bc9-a0f4-4a42-9f39-617f8793cb43 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:52.640856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc0bc9-a0f4-4a42-9f39-617f8793cb43 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:52.640856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc0bc9-a0f4-4a42-9f39-617f8793cb43 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:52.640856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 82/167] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:58:52.640856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc0bc9-a0f4-4a42-9f39-617f8793cb43 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:52.782652 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad7e15-27d4-4ac9-b2a9-ddece6358a60 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:52.834364 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc0bc9-a0f4-4a42-9f39-617f8793cb43 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:52.898099 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273fb28-0afb-4792-b2aa-7f151ad1a1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:52.898796 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273fb28-0afb-4792-b2aa-7f151ad1a1ff None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:52.899083 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273fb28-0afb-4792-b2aa-7f151ad1a1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:52.899359 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273fb28-0afb-4792-b2aa-7f151ad1a1ff None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:52.900123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273fb28-0afb-4792-b2aa-7f151ad1a1ff None admin] RBAC: Adding query filter params (name=member) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:52.900533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273fb28-0afb-4792-b2aa-7f151ad1a1ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:52.901991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8273fb28-0afb-4792-b2aa-7f151ad1a1ff None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:52.904184 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a18ad-0a62-4dba-8995-9038d4360f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:52.904874 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a18ad-0a62-4dba-8995-9038d4360f4a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:52.905166 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a18ad-0a62-4dba-8995-9038d4360f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:52.905448 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a18ad-0a62-4dba-8995-9038d4360f4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:52.906302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a18ad-0a62-4dba-8995-9038d4360f4a None admin] RBAC: Adding query filter params (role.id=106aa464a69a49b09de7de5417083d3c, scope.project.id=f040c41677374080a6ee1538a7a34a54, user.id=af7691de913843509188548c36ece976) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:52.906625 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a18ad-0a62-4dba-8995-9038d4360f4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:52.908065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a18ad-0a62-4dba-8995-9038d4360f4a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:52.920846 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 83/168] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 09:58:52 2022] GET /identity/v3/role_assignments?user.id=af7691de913843509188548c36ece976&scope.project.id=f040c41677374080a6ee1538a7a34a54&role.id=106aa464a69a49b09de7de5417083d3c => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:58:52.922386 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca11f66-399c-4134-97f0-9f0cf612b3c5 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:52.922678 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca11f66-399c-4134-97f0-9f0cf612b3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:52.922958 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca11f66-399c-4134-97f0-9f0cf612b3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:52.924290 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 86/169] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 22 09:58:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 490 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:58:52.934418 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273fb28-0afb-4792-b2aa-7f151ad1a1ff None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:52.958739 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-8ca11f66-399c-4134-97f0-9f0cf612b3c5 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:52.960287 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-8ca11f66-399c-4134-97f0-9f0cf612b3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:52.987475 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:53.068759 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8273fb28-0afb-4792-b2aa-7f151ad1a1ff None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:53.080637 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:53.110252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2daf4fd-4833-4546-b27f-bd75066201ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:53.111217 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daf4fd-4833-4546-b27f-bd75066201ee None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:53.111507 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daf4fd-4833-4546-b27f-bd75066201ee None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:53.111788 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daf4fd-4833-4546-b27f-bd75066201ee None admin] PATH_INFO: `/v3/users/d3bcf2a71eef4b3fa6f7b6c18edc4d2f` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:53.113265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2daf4fd-4833-4546-b27f-bd75066201ee None admin] RBAC: Authorizing `identity:get_user(user_id=d3bcf2a71eef4b3fa6f7b6c18edc4d2f)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:53.114750 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2daf4fd-4833-4546-b27f-bd75066201ee None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:53.116737 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 87/170] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:58:52 2022] GET /identity/v3/users/d3bcf2a71eef4b3fa6f7b6c18edc4d2f => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:53.122778 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2daf4fd-4833-4546-b27f-bd75066201ee None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:53.146439 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 84/171] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:58:53.185911 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca11f66-399c-4134-97f0-9f0cf612b3c5 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:53.233595 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:53.237773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2daf4fd-4833-4546-b27f-bd75066201ee None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:53.346163 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496d6a0-9c10-4307-b11e-5ba20ab16a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:53.346840 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496d6a0-9c10-4307-b11e-5ba20ab16a8b None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:53.347133 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496d6a0-9c10-4307-b11e-5ba20ab16a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:53.347419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496d6a0-9c10-4307-b11e-5ba20ab16a8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:53.386582 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca11f66-399c-4134-97f0-9f0cf612b3c5 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:53.426401 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4388935-5f10-4eb2-9dab-d49228e2507e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:53.427288 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4388935-5f10-4eb2-9dab-d49228e2507e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:53.427574 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4388935-5f10-4eb2-9dab-d49228e2507e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:53.427854 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4388935-5f10-4eb2-9dab-d49228e2507e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:53.439096 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4388935-5f10-4eb2-9dab-d49228e2507e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:58:53.447667 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-e4388935-5f10-4eb2-9dab-d49228e2507e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 09:58:53.447667 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:58:53.447667 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:58:53.447667 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:58:53.447667 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:58:53.447667 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:58:53.447667 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:58:53.447667 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:58:53.447667 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:58:53.447667 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:58:53.447667 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:58:53.447667 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:58:53.447667 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:58:53.447667 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:58:53.447667 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:58:53.447667 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:58:53.449221 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:58:53.449221 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:58:53.449221 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:58:53.449221 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:58:53.449221 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:58:53.449221 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:58:53.449221 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:58:53.449221 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:58:53.449221 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:58:53.449221 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:58:53.449221 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:58:53.449221 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:58:53.449221 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:58:53.449221 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:58:53.449221 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:58:53.449221 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:58:53.451542 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:58:53.451542 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:58:53.451542 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:58:53.451542 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:58:53.451542 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:58:53.451542 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:58:53.451542 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:58:53.451542 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:58:53.451542 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:58:53.451542 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:58:53.451542 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 09:58:53.451542 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:58:53.451542 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 85/172] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 22 09:58:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:58:53.455883 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4388935-5f10-4eb2-9dab-d49228e2507e None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:53.482823 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496d6a0-9c10-4307-b11e-5ba20ab16a8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:53.484291 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496d6a0-9c10-4307-b11e-5ba20ab16a8b None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:53.499921 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:53.568993 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4388935-5f10-4eb2-9dab-d49228e2507e None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:53.616686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:53.624762 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ca79a-eb0c-41ff-a8ac-a73051cf3379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:53.625789 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ca79a-eb0c-41ff-a8ac-a73051cf3379 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:53.626210 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ca79a-eb0c-41ff-a8ac-a73051cf3379 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:53.632319 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ca79a-eb0c-41ff-a8ac-a73051cf3379 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:53.632319 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ca79a-eb0c-41ff-a8ac-a73051cf3379 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:53.632319 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ca79a-eb0c-41ff-a8ac-a73051cf3379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:53.632789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 88/173] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:58:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 09:58:53.632987 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ca79a-eb0c-41ff-a8ac-a73051cf3379 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:53.636855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496d6a0-9c10-4307-b11e-5ba20ab16a8b None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:53.643170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 86/174] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 09:58:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:53.648707 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ca79a-eb0c-41ff-a8ac-a73051cf3379 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:53.806675 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496d6a0-9c10-4307-b11e-5ba20ab16a8b None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:53.840105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:53.855393 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ca79a-eb0c-41ff-a8ac-a73051cf3379 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:53.865571 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24ff8f-2890-46ec-8225-bc433327ab25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:53.866460 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24ff8f-2890-46ec-8225-bc433327ab25 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:53.866749 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24ff8f-2890-46ec-8225-bc433327ab25 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:53.867026 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24ff8f-2890-46ec-8225-bc433327ab25 None admin] PATH_INFO: `/v3/projects/12bba9925e2a4739bd44159d3be6d8f9` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:53.870532 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24ff8f-2890-46ec-8225-bc433327ab25 None admin] RBAC: Authorizing `identity:get_project(project_id=12bba9925e2a4739bd44159d3be6d8f9)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:53.872015 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24ff8f-2890-46ec-8225-bc433327ab25 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:53.874022 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 89/175] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:58:53 2022] GET /identity/v3/projects/12bba9925e2a4739bd44159d3be6d8f9 => generated 312 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:58:53.880218 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24ff8f-2890-46ec-8225-bc433327ab25 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:53.957715 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f1eb9-a700-4f10-b94a-1e55a603071f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:53.958533 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f1eb9-a700-4f10-b94a-1e55a603071f None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:53.958821 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f1eb9-a700-4f10-b94a-1e55a603071f None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:53.959104 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f1eb9-a700-4f10-b94a-1e55a603071f None admin] PATH_INFO: `/v3/users/d3bcf2a71eef4b3fa6f7b6c18edc4d2f` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:53.960722 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f1eb9-a700-4f10-b94a-1e55a603071f None admin] RBAC: Authorizing `identity:get_user(user_id=d3bcf2a71eef4b3fa6f7b6c18edc4d2f)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:53.962240 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f1eb9-a700-4f10-b94a-1e55a603071f None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:53.964633 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 87/176] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:58:53 2022] GET /identity/v3/users/d3bcf2a71eef4b3fa6f7b6c18edc4d2f => generated 275 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:58:53.970867 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f1eb9-a700-4f10-b94a-1e55a603071f None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:54.001146 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:54.074089 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24ff8f-2890-46ec-8225-bc433327ab25 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:54.147425 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47031a-4d44-4b3f-84e1-d4a3cae34876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:54.148149 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47031a-4d44-4b3f-84e1-d4a3cae34876 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:54.148439 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47031a-4d44-4b3f-84e1-d4a3cae34876 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:54.148718 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47031a-4d44-4b3f-84e1-d4a3cae34876 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:54.149601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47031a-4d44-4b3f-84e1-d4a3cae34876 None admin] RBAC: Adding query filter params (role.id=b8f82737ef614907a0d320c6e1f2facf, scope.project.id=12bba9925e2a4739bd44159d3be6d8f9, user.id=d3bcf2a71eef4b3fa6f7b6c18edc4d2f) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:54.149972 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47031a-4d44-4b3f-84e1-d4a3cae34876 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:54.152172 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47031a-4d44-4b3f-84e1-d4a3cae34876 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:54.155309 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f1eb9-a700-4f10-b94a-1e55a603071f None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:54.162785 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 90/177] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 09:58:53 2022] GET /identity/v3/role_assignments?user.id=d3bcf2a71eef4b3fa6f7b6c18edc4d2f&scope.project.id=12bba9925e2a4739bd44159d3be6d8f9&role.id=b8f82737ef614907a0d320c6e1f2facf => generated 608 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:58:54.213055 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d427606-5869-4057-8c79-404df599a63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:54.213650 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d427606-5869-4057-8c79-404df599a63e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:54.213992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d427606-5869-4057-8c79-404df599a63e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:54.214779 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d427606-5869-4057-8c79-404df599a63e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:54.275927 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:54.298683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d427606-5869-4057-8c79-404df599a63e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:54.300219 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d427606-5869-4057-8c79-404df599a63e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:54.423175 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 88/178] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:58:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 09:58:54.428632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47031a-4d44-4b3f-84e1-d4a3cae34876 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:54.507702 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd8bb4-f81a-4780-b6df-b7f619df9929 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:54.508244 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd8bb4-f81a-4780-b6df-b7f619df9929 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:54.508691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd8bb4-f81a-4780-b6df-b7f619df9929 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:54.510272 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 89/179] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 09:58:54.530333 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fadcb-3d3a-4700-bb30-25bfc7c6f50c None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:54.530913 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fadcb-3d3a-4700-bb30-25bfc7c6f50c None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:54.531360 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fadcb-3d3a-4700-bb30-25bfc7c6f50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:54.555475 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47031a-4d44-4b3f-84e1-d4a3cae34876 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:54.566119 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-c48fadcb-3d3a-4700-bb30-25bfc7c6f50c None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:54.567635 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-c48fadcb-3d3a-4700-bb30-25bfc7c6f50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:54.585354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:54.593205 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80c9bb-271c-40f8-b71d-de0a1e973fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:54.594174 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80c9bb-271c-40f8-b71d-de0a1e973fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:54.597470 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80c9bb-271c-40f8-b71d-de0a1e973fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:54.597470 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80c9bb-271c-40f8-b71d-de0a1e973fa8 None admin] PATH_INFO: `/v3/projects/f040c41677374080a6ee1538a7a34a54` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:54.597470 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80c9bb-271c-40f8-b71d-de0a1e973fa8 None admin] RBAC: Authorizing `identity:get_project(project_id=f040c41677374080a6ee1538a7a34a54)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:54.597682 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80c9bb-271c-40f8-b71d-de0a1e973fa8 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:54.599430 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 91/180] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:58:54 2022] GET /identity/v3/projects/f040c41677374080a6ee1538a7a34a54 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:54.605650 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80c9bb-271c-40f8-b71d-de0a1e973fa8 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:54.670856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:54.682182 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 90/181] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:58:54.721448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80c9bb-271c-40f8-b71d-de0a1e973fa8 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:54.726415 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fadcb-3d3a-4700-bb30-25bfc7c6f50c None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:54.758488 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680ad49-ac95-490e-a537-ce68b0b3f7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:54.759070 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680ad49-ac95-490e-a537-ce68b0b3f7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:54.759354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680ad49-ac95-490e-a537-ce68b0b3f7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:54.759632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680ad49-ac95-490e-a537-ce68b0b3f7a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:54.760541 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680ad49-ac95-490e-a537-ce68b0b3f7a1 None admin] RBAC: Adding query filter params (role.id=7783830649d941ea9507439a113fc5d9, scope.project.id=f040c41677374080a6ee1538a7a34a54, user.id=d3bcf2a71eef4b3fa6f7b6c18edc4d2f) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:54.760914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680ad49-ac95-490e-a537-ce68b0b3f7a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:54.762541 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680ad49-ac95-490e-a537-ce68b0b3f7a1 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:54.769570 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 92/182] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 09:58:54 2022] GET /identity/v3/role_assignments?user.id=d3bcf2a71eef4b3fa6f7b6c18edc4d2f&scope.project.id=f040c41677374080a6ee1538a7a34a54&role.id=7783830649d941ea9507439a113fc5d9 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:58:54.831918 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851d6b2-d3c8-4580-a0da-e27b0041ee2d None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:54.832241 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851d6b2-d3c8-4580-a0da-e27b0041ee2d None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:54.832476 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851d6b2-d3c8-4580-a0da-e27b0041ee2d None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:54.834046 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 93/183] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 09:58:54.841825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bed044-459a-4426-b11a-c63da17e3ca4 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:54.842126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bed044-459a-4426-b11a-c63da17e3ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:54.842376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bed044-459a-4426-b11a-c63da17e3ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:54.878656 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-f2bed044-459a-4426-b11a-c63da17e3ca4 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:54.879894 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-f2bed044-459a-4426-b11a-c63da17e3ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:54.916068 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fadcb-3d3a-4700-bb30-25bfc7c6f50c None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:54.970916 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520615fa-591f-4447-8afa-8c3d41e7a1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:54.971722 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520615fa-591f-4447-8afa-8c3d41e7a1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:54.971999 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520615fa-591f-4447-8afa-8c3d41e7a1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:54.972268 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520615fa-591f-4447-8afa-8c3d41e7a1d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:54.974247 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520615fa-591f-4447-8afa-8c3d41e7a1d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:54.975726 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520615fa-591f-4447-8afa-8c3d41e7a1d2 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:54.977595 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 91/184] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:58:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:58:54.978602 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46eca17-6096-4877-91d8-6a2b428ebfe0 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:54.978897 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46eca17-6096-4877-91d8-6a2b428ebfe0 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:54.979156 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46eca17-6096-4877-91d8-6a2b428ebfe0 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:54.983649 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 92/185] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:58:54.984086 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:54.984441 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46eca17-6096-4877-91d8-6a2b428ebfe0 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:55.004892 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 94/186] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 09:58:55.006305 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81c102-2cbb-43bd-adf7-07c82767c87b None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:55.006596 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81c102-2cbb-43bd-adf7-07c82767c87b None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:55.006870 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81c102-2cbb-43bd-adf7-07c82767c87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:55.023838 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-cb81c102-2cbb-43bd-adf7-07c82767c87b None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:55.024935 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-cb81c102-2cbb-43bd-adf7-07c82767c87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:55.078336 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:55.102367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 95/187] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:58:55.103210 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81c102-2cbb-43bd-adf7-07c82767c87b None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:55.123153 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46eca17-6096-4877-91d8-6a2b428ebfe0 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:55.157834 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a106c-dca7-4304-a1dc-07d2e215a4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:55.158512 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a106c-dca7-4304-a1dc-07d2e215a4a7 None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:55.158787 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a106c-dca7-4304-a1dc-07d2e215a4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:55.159066 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a106c-dca7-4304-a1dc-07d2e215a4a7 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:55.159784 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a106c-dca7-4304-a1dc-07d2e215a4a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:55.161269 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a106c-dca7-4304-a1dc-07d2e215a4a7 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:55.202820 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81c102-2cbb-43bd-adf7-07c82767c87b None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:55.219230 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:55.236576 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6d3be-efb7-4c47-ba2a-a72d5357e0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:55.237394 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6d3be-efb7-4c47-ba2a-a72d5357e0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:55.237672 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6d3be-efb7-4c47-ba2a-a72d5357e0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:55.237941 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6d3be-efb7-4c47-ba2a-a72d5357e0e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:55.247531 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 93/188] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 22 09:58:54 2022] POST /identity/v3/users => generated 297 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:58:55.247692 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6d3be-efb7-4c47-ba2a-a72d5357e0e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:58:55.248839 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccb832-0f22-42b7-9746-bc64d4cd12a5 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:55.251976 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccb832-0f22-42b7-9746-bc64d4cd12a5 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:55.251976 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccb832-0f22-42b7-9746-bc64d4cd12a5 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:55.251976 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 94/189] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:58:55.251976 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccb832-0f22-42b7-9746-bc64d4cd12a5 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:55.257445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-dbb6d3be-efb7-4c47-ba2a-a72d5357e0e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 09:58:55.257445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:58:55.257445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:58:55.257445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:58:55.257445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:58:55.257445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:58:55.257445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:58:55.257445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:58:55.257445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:58:55.257445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:58:55.257445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:58:55.257445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:58:55.257445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:58:55.257445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:58:55.257445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:58:55.257445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:58:55.258727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:58:55.258727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:58:55.258727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:58:55.258727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:58:55.258727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:58:55.258727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:58:55.258727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:58:55.258727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:58:55.258727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:58:55.258727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:58:55.258727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:58:55.258727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:58:55.258727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:58:55.258727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:58:55.258727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:58:55.258727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:58:55.259543 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:58:55.259543 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:58:55.259543 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:58:55.259543 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:58:55.259543 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:58:55.259543 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:58:55.259543 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:58:55.259543 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:58:55.259543 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:58:55.259543 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:58:55.259543 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 09:58:55.259543 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:58:55.259543 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 96/190] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 09:58:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:58:55.263205 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be4185-ccf3-40da-8dbc-ca5fce38adbf None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:55.263519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be4185-ccf3-40da-8dbc-ca5fce38adbf None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:55.263773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be4185-ccf3-40da-8dbc-ca5fce38adbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:55.282430 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-75be4185-ccf3-40da-8dbc-ca5fce38adbf None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:55.283563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-75be4185-ccf3-40da-8dbc-ca5fce38adbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:55.368860 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 97/191] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:58:55.368860 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be4185-ccf3-40da-8dbc-ca5fce38adbf None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:55.401210 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccb832-0f22-42b7-9746-bc64d4cd12a5 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:55.431201 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:55.445196 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe29d8e-e262-4452-a0f0-3286380426b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:55.446509 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe29d8e-e262-4452-a0f0-3286380426b0 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:55.446509 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe29d8e-e262-4452-a0f0-3286380426b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:55.446674 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe29d8e-e262-4452-a0f0-3286380426b0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:55.461827 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe29d8e-e262-4452-a0f0-3286380426b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:58:55.472909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-6fe29d8e-e262-4452-a0f0-3286380426b0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 09:58:55.472909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:58:55.472909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:58:55.472909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:58:55.472909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:58:55.472909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:58:55.472909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:58:55.472909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:58:55.472909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:58:55.472909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:58:55.472909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:58:55.472909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:58:55.472909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:58:55.472909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:58:55.472909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:58:55.472909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:58:55.474069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:58:55.474069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:58:55.474069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:58:55.474069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:58:55.474069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:58:55.474069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:58:55.474069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:58:55.474069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:58:55.474069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:58:55.474069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:58:55.474069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:58:55.474069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:58:55.474069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:58:55.474069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:58:55.474069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:58:55.474069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:58:55.475179 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:58:55.475179 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:58:55.475179 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:58:55.475179 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:58:55.475179 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:58:55.475179 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:58:55.475179 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:58:55.475179 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:58:55.475179 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:58:55.475179 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:58:55.475179 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 09:58:55.475179 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:58:55.475179 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 95/192] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 22 09:58:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:58:55.475974 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe29d8e-e262-4452-a0f0-3286380426b0 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:55.490400 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be4185-ccf3-40da-8dbc-ca5fce38adbf None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:55.501840 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:55.537450 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e4469-d675-4b63-a32d-6dfdc814aa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:55.538379 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e4469-d675-4b63-a32d-6dfdc814aa29 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:55.538812 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e4469-d675-4b63-a32d-6dfdc814aa29 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:55.539226 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e4469-d675-4b63-a32d-6dfdc814aa29 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:55.540157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e4469-d675-4b63-a32d-6dfdc814aa29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:55.540473 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e4469-d675-4b63-a32d-6dfdc814aa29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:55.542468 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e4469-d675-4b63-a32d-6dfdc814aa29 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:55.555150 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 98/193] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:58:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:55.556144 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e4469-d675-4b63-a32d-6dfdc814aa29 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:55.594300 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe29d8e-e262-4452-a0f0-3286380426b0 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:55.640583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdef98f-eb86-47d3-8334-ab5c7a1f49a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:55.642377 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdef98f-eb86-47d3-8334-ab5c7a1f49a5 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:55.642767 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdef98f-eb86-47d3-8334-ab5c7a1f49a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:55.643419 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdef98f-eb86-47d3-8334-ab5c7a1f49a5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:55.658538 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdef98f-eb86-47d3-8334-ab5c7a1f49a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:58:55.674344 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-abdef98f-eb86-47d3-8334-ab5c7a1f49a5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 09:58:55.674344 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:58:55.674344 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:58:55.674344 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:58:55.674344 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:58:55.674344 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:58:55.674344 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:58:55.674344 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:58:55.674344 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:58:55.674344 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:58:55.674344 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:58:55.674344 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:58:55.674344 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:58:55.674344 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:58:55.674344 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:58:55.674344 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:58:55.675445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:58:55.675445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:58:55.675445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:58:55.675445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:58:55.675445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:58:55.675445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:58:55.675445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:58:55.675445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:58:55.675445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:58:55.675445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:58:55.675445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:58:55.675445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:58:55.675445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:58:55.675445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:58:55.675445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:58:55.675445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:58:55.676241 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:58:55.676241 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:58:55.676241 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:58:55.676241 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:58:55.676241 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:58:55.676241 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:58:55.676241 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:58:55.676241 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:58:55.676241 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:58:55.676241 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:58:55.676241 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 09:58:55.676241 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:58:55.684895 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 96/194] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:58:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:58:55.688568 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdef98f-eb86-47d3-8334-ab5c7a1f49a5 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:55.698555 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e4469-d675-4b63-a32d-6dfdc814aa29 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:55.735082 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169deb1-7171-4a10-a6df-d4518133331e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:55.735812 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169deb1-7171-4a10-a6df-d4518133331e None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:55.736111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169deb1-7171-4a10-a6df-d4518133331e None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:55.736393 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169deb1-7171-4a10-a6df-d4518133331e None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:55.737182 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169deb1-7171-4a10-a6df-d4518133331e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:55.737501 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169deb1-7171-4a10-a6df-d4518133331e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:55.738926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169deb1-7171-4a10-a6df-d4518133331e None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:55.744011 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:55.748672 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 99/195] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 09:58:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:55.749356 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169deb1-7171-4a10-a6df-d4518133331e None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:55.788254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:55.832234 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdef98f-eb86-47d3-8334-ab5c7a1f49a5 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:55.867262 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169deb1-7171-4a10-a6df-d4518133331e None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:55.885603 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858f67e-f6b2-4c08-9886-de7bf6e3fbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:55.886857 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858f67e-f6b2-4c08-9886-de7bf6e3fbe0 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:55.887366 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858f67e-f6b2-4c08-9886-de7bf6e3fbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:55.887839 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858f67e-f6b2-4c08-9886-de7bf6e3fbe0 None admin] PATH_INFO: `/v3/users/b2914eda748a4741b601fb7eb9059e25` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:55.905428 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858f67e-f6b2-4c08-9886-de7bf6e3fbe0 None admin] RBAC: Authorizing `identity:get_user(user_id=b2914eda748a4741b601fb7eb9059e25)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:55.906932 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858f67e-f6b2-4c08-9886-de7bf6e3fbe0 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:55.908679 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 97/196] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:58:55 2022] GET /identity/v3/users/b2914eda748a4741b601fb7eb9059e25 => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:55.909467 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858f67e-f6b2-4c08-9886-de7bf6e3fbe0 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:55.913540 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad8899-82a8-423b-b280-9c4c706e5dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:55.917390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad8899-82a8-423b-b280-9c4c706e5dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:55.917390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad8899-82a8-423b-b280-9c4c706e5dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:55.917390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad8899-82a8-423b-b280-9c4c706e5dd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:55.917390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad8899-82a8-423b-b280-9c4c706e5dd7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:55.917390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad8899-82a8-423b-b280-9c4c706e5dd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:55.919987 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad8899-82a8-423b-b280-9c4c706e5dd7 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:55.932696 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 100/197] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 22 09:58:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:55.933448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad8899-82a8-423b-b280-9c4c706e5dd7 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:56.043018 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:56.043938 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:56.046329 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858f67e-f6b2-4c08-9886-de7bf6e3fbe0 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:56.055384 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad8899-82a8-423b-b280-9c4c706e5dd7 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:56.093220 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de4a3e-44f3-4a70-8ae9-4cfa7dd6c238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:56.094388 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de4a3e-44f3-4a70-8ae9-4cfa7dd6c238 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:56.094833 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de4a3e-44f3-4a70-8ae9-4cfa7dd6c238 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:56.095252 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de4a3e-44f3-4a70-8ae9-4cfa7dd6c238 None admin] PATH_INFO: `/v3/users/b2914eda748a4741b601fb7eb9059e25` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:56.096851 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de4a3e-44f3-4a70-8ae9-4cfa7dd6c238 None admin] RBAC: Authorizing `identity:get_user(user_id=b2914eda748a4741b601fb7eb9059e25)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:56.097324 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e63d5-0305-4a32-97ac-59e836756415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:56.098035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e63d5-0305-4a32-97ac-59e836756415 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:56.098376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e63d5-0305-4a32-97ac-59e836756415 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:56.098710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e63d5-0305-4a32-97ac-59e836756415 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:56.099145 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de4a3e-44f3-4a70-8ae9-4cfa7dd6c238 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:56.101296 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 98/198] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:58:55 2022] GET /identity/v3/users/b2914eda748a4741b601fb7eb9059e25 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:56.106463 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de4a3e-44f3-4a70-8ae9-4cfa7dd6c238 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:56.193844 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e63d5-0305-4a32-97ac-59e836756415 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:56.195557 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e63d5-0305-4a32-97ac-59e836756415 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:56.230806 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de4a3e-44f3-4a70-8ae9-4cfa7dd6c238 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:56.273000 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf59b13-66fc-4fc3-99fb-d9accb799d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:56.274063 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf59b13-66fc-4fc3-99fb-d9accb799d2f None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:56.274174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf59b13-66fc-4fc3-99fb-d9accb799d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:56.274424 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf59b13-66fc-4fc3-99fb-d9accb799d2f None admin] PATH_INFO: `/v3/users/261ffbf813e14043b38c0f775d35808a` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:56.275648 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf59b13-66fc-4fc3-99fb-d9accb799d2f None admin] RBAC: Authorizing `identity:get_user(user_id=261ffbf813e14043b38c0f775d35808a)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:56.277764 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf59b13-66fc-4fc3-99fb-d9accb799d2f None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:56.279688 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 99/199] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:58:56 2022] GET /identity/v3/users/261ffbf813e14043b38c0f775d35808a => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:56.280170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf59b13-66fc-4fc3-99fb-d9accb799d2f None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:56.315857 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:56.324055 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:56.342733 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 101/200] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:58:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 09:58:56.342733 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e63d5-0305-4a32-97ac-59e836756415 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:56.389573 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf59b13-66fc-4fc3-99fb-d9accb799d2f None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:56.431107 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7e076-8783-4a85-b8f5-4a261a3eda48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:56.432682 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7e076-8783-4a85-b8f5-4a261a3eda48 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:56.434335 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7e076-8783-4a85-b8f5-4a261a3eda48 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:56.435103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7e076-8783-4a85-b8f5-4a261a3eda48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:56.450966 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e63d5-0305-4a32-97ac-59e836756415 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:56.487438 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c1f7a-9994-4715-a61c-76a269a3b631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:56.488089 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c1f7a-9994-4715-a61c-76a269a3b631 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:56.488374 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c1f7a-9994-4715-a61c-76a269a3b631 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:56.488653 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c1f7a-9994-4715-a61c-76a269a3b631 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:56.514257 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d7e076-8783-4a85-b8f5-4a261a3eda48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:56.515961 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d7e076-8783-4a85-b8f5-4a261a3eda48 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:56.559712 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:56.585975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:56.585975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c1f7a-9994-4715-a61c-76a269a3b631 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:56.585975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c1f7a-9994-4715-a61c-76a269a3b631 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:56.631505 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 100/201] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:58:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 09:58:56.632352 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7e076-8783-4a85-b8f5-4a261a3eda48 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:56.699840 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 102/202] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:58:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 09:58:56.701107 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c1f7a-9994-4715-a61c-76a269a3b631 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:56.740518 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7e076-8783-4a85-b8f5-4a261a3eda48 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:56.776699 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4d65b-6aa4-4d99-b6db-c76ba36cf586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:56.777587 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4d65b-6aa4-4d99-b6db-c76ba36cf586 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:56.777868 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4d65b-6aa4-4d99-b6db-c76ba36cf586 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:56.778142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4d65b-6aa4-4d99-b6db-c76ba36cf586 None admin] PATH_INFO: `/v3/projects/8935dc925ceb4fbc8b07442a34045d82` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:56.779366 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4d65b-6aa4-4d99-b6db-c76ba36cf586 None admin] RBAC: Authorizing `identity:get_project(project_id=8935dc925ceb4fbc8b07442a34045d82)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:56.780975 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4d65b-6aa4-4d99-b6db-c76ba36cf586 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:56.782786 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 101/203] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:58:56 2022] GET /identity/v3/projects/8935dc925ceb4fbc8b07442a34045d82 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:56.783534 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4d65b-6aa4-4d99-b6db-c76ba36cf586 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:56.787227 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:56.798573 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:56.807800 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c1f7a-9994-4715-a61c-76a269a3b631 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:56.843438 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc34f3-2df6-4fe8-88dc-559ee4751eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:56.844486 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc34f3-2df6-4fe8-88dc-559ee4751eba None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:56.845032 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc34f3-2df6-4fe8-88dc-559ee4751eba None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:56.845286 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc34f3-2df6-4fe8-88dc-559ee4751eba None admin] PATH_INFO: `/v3/projects/8935dc925ceb4fbc8b07442a34045d82` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:56.846643 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc34f3-2df6-4fe8-88dc-559ee4751eba None admin] RBAC: Authorizing `identity:get_project(project_id=8935dc925ceb4fbc8b07442a34045d82)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:56.848599 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc34f3-2df6-4fe8-88dc-559ee4751eba None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:56.855582 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 103/204] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:58:56 2022] GET /identity/v3/projects/8935dc925ceb4fbc8b07442a34045d82 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:56.856557 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc34f3-2df6-4fe8-88dc-559ee4751eba None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:56.894644 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4d65b-6aa4-4d99-b6db-c76ba36cf586 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:56.932868 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fea1b-ef44-429d-910b-01156b82d350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:56.933967 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fea1b-ef44-429d-910b-01156b82d350 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:56.934388 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fea1b-ef44-429d-910b-01156b82d350 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:56.934798 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fea1b-ef44-429d-910b-01156b82d350 None admin] PATH_INFO: `/v3/projects/f040c41677374080a6ee1538a7a34a54` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:56.936152 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1fea1b-ef44-429d-910b-01156b82d350 None admin] RBAC: Authorizing `identity:get_project(project_id=f040c41677374080a6ee1538a7a34a54)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:56.937968 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1fea1b-ef44-429d-910b-01156b82d350 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:56.940312 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 102/205] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:58:56 2022] GET /identity/v3/projects/f040c41677374080a6ee1538a7a34a54 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:56.941350 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fea1b-ef44-429d-910b-01156b82d350 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:56.965568 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc34f3-2df6-4fe8-88dc-559ee4751eba None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:57.002043 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074caca-3f58-420e-96c1-58580139020a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:57.002857 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074caca-3f58-420e-96c1-58580139020a None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:57.003240 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074caca-3f58-420e-96c1-58580139020a None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:57.003757 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074caca-3f58-420e-96c1-58580139020a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:57.004587 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074caca-3f58-420e-96c1-58580139020a None admin] RBAC: Adding query filter params (role.id=106aa464a69a49b09de7de5417083d3c, scope.project.id=8935dc925ceb4fbc8b07442a34045d82, user.id=b2914eda748a4741b601fb7eb9059e25) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:57.005047 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074caca-3f58-420e-96c1-58580139020a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:57.006583 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074caca-3f58-420e-96c1-58580139020a None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:57.013388 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 104/206] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 09:58:56 2022] GET /identity/v3/role_assignments?user.id=b2914eda748a4741b601fb7eb9059e25&scope.project.id=8935dc925ceb4fbc8b07442a34045d82&role.id=106aa464a69a49b09de7de5417083d3c => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:57.014375 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074caca-3f58-420e-96c1-58580139020a None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:57.019772 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:57.042568 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:57.057881 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fea1b-ef44-429d-910b-01156b82d350 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:57.098089 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abac41-12ff-4a0a-97d0-42b3f2bb1eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:57.098984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abac41-12ff-4a0a-97d0-42b3f2bb1eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:57.099414 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abac41-12ff-4a0a-97d0-42b3f2bb1eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:57.099893 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abac41-12ff-4a0a-97d0-42b3f2bb1eb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:57.101003 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abac41-12ff-4a0a-97d0-42b3f2bb1eb6 None admin] RBAC: Adding query filter params (role.id=7783830649d941ea9507439a113fc5d9, scope.project.id=8935dc925ceb4fbc8b07442a34045d82, user.id=b2914eda748a4741b601fb7eb9059e25) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:57.101517 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abac41-12ff-4a0a-97d0-42b3f2bb1eb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:57.103296 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abac41-12ff-4a0a-97d0-42b3f2bb1eb6 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:57.110015 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 103/207] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 09:58:56 2022] GET /identity/v3/role_assignments?user.id=b2914eda748a4741b601fb7eb9059e25&scope.project.id=8935dc925ceb4fbc8b07442a34045d82&role.id=7783830649d941ea9507439a113fc5d9 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:57.142239 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074caca-3f58-420e-96c1-58580139020a None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:57.195098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0062f-2b40-4d7c-a0c2-c1350bb9b4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:57.195855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0062f-2b40-4d7c-a0c2-c1350bb9b4be None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:57.196139 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0062f-2b40-4d7c-a0c2-c1350bb9b4be None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:57.196416 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0062f-2b40-4d7c-a0c2-c1350bb9b4be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:57.197423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0062f-2b40-4d7c-a0c2-c1350bb9b4be None admin] RBAC: Adding query filter params (role.id=e744213e97f341cd862b25d2c45af211, scope.project.id=f040c41677374080a6ee1538a7a34a54, user.id=261ffbf813e14043b38c0f775d35808a) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:57.197739 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0062f-2b40-4d7c-a0c2-c1350bb9b4be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:57.200421 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0062f-2b40-4d7c-a0c2-c1350bb9b4be None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:57.207964 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 105/208] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 09:58:57 2022] GET /identity/v3/role_assignments?user.id=261ffbf813e14043b38c0f775d35808a&scope.project.id=f040c41677374080a6ee1538a7a34a54&role.id=e744213e97f341cd862b25d2c45af211 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:57.502616 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcc26d-5196-4a15-a931-975d27b53b42 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:57.503427 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcc26d-5196-4a15-a931-975d27b53b42 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:57.503861 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcc26d-5196-4a15-a931-975d27b53b42 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:57.505402 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 104/209] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:58:57.511067 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9609e-8ffe-49b4-b2a7-23376a64cf43 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:57.511355 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9609e-8ffe-49b4-b2a7-23376a64cf43 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:57.511632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9609e-8ffe-49b4-b2a7-23376a64cf43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:57.536795 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-32c9609e-8ffe-49b4-b2a7-23376a64cf43 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:57.538029 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-32c9609e-8ffe-49b4-b2a7-23376a64cf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:57.614328 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 106/210] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:58:57.637556 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcc26d-5196-4a15-a931-975d27b53b42 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:57.639551 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d3ed0-75d8-4381-ab84-0bc6c15e08b0 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:57.639839 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d3ed0-75d8-4381-ab84-0bc6c15e08b0 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:57.640116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d3ed0-75d8-4381-ab84-0bc6c15e08b0 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:57.641994 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 107/211] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:58:57.647336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a053e5-315c-4d51-a7e8-1fa311863081 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:57.647619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a053e5-315c-4d51-a7e8-1fa311863081 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:57.647899 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a053e5-315c-4d51-a7e8-1fa311863081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:57.671540 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-90a053e5-315c-4d51-a7e8-1fa311863081 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:57.672674 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-90a053e5-315c-4d51-a7e8-1fa311863081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:57.697271 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:57.762098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 108/212] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 09:58:57.767495 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcc26d-5196-4a15-a931-975d27b53b42 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:57.791538 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a053e5-315c-4d51-a7e8-1fa311863081 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:57.809070 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b1a00-3407-4c8b-8b12-a8379b21b526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:57.810236 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b1a00-3407-4c8b-8b12-a8379b21b526 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:57.810582 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b1a00-3407-4c8b-8b12-a8379b21b526 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:57.810926 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b1a00-3407-4c8b-8b12-a8379b21b526 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:57.813884 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:57.822710 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b1a00-3407-4c8b-8b12-a8379b21b526 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:58:57.831856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-456b1a00-3407-4c8b-8b12-a8379b21b526 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:58:57.831856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:58:57.831856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:58:57.831856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:58:57.831856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:58:57.831856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:58:57.831856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:58:57.831856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:58:57.831856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:58:57.831856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:58:57.831856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:58:57.831856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:58:57.831856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:58:57.831856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:58:57.831856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:58:57.831856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:58:57.832738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:58:57.832738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:58:57.832738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:58:57.832738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:58:57.832738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:58:57.832738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:58:57.832738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:58:57.832738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:58:57.832738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:58:57.832738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:58:57.832738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:58:57.832738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:58:57.832738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:58:57.832738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:58:57.832738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:58:57.832738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:58:57.833549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:58:57.833549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:58:57.833549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:58:57.833549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:58:57.833549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:58:57.833549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:58:57.833549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:58:57.833549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:58:57.833549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:58:57.833549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:58:57.833549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:58:57.833549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:58:57.833549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 105/213] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:58:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:58:57.839645 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b1a00-3407-4c8b-8b12-a8379b21b526 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:57.919814 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a053e5-315c-4d51-a7e8-1fa311863081 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:57.954292 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b1a00-3407-4c8b-8b12-a8379b21b526 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:57.970391 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547591f2-d8a3-4087-aed0-4875c3664c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:57.971289 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547591f2-d8a3-4087-aed0-4875c3664c04 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:57.971641 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547591f2-d8a3-4087-aed0-4875c3664c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:57.972235 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547591f2-d8a3-4087-aed0-4875c3664c04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:57.974095 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547591f2-d8a3-4087-aed0-4875c3664c04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:57.976197 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547591f2-d8a3-4087-aed0-4875c3664c04 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:57.980851 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 109/214] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:58:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:58:57.983902 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547591f2-d8a3-4087-aed0-4875c3664c04 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:58.002951 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee3062-c7d6-4cf1-a941-68440691ef40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:58.003630 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee3062-c7d6-4cf1-a941-68440691ef40 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:58.003918 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee3062-c7d6-4cf1-a941-68440691ef40 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:58.004407 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee3062-c7d6-4cf1-a941-68440691ef40 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:58.005220 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee3062-c7d6-4cf1-a941-68440691ef40 None admin] RBAC: Adding query filter params (name=member) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:58.005536 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee3062-c7d6-4cf1-a941-68440691ef40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:58.007052 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee3062-c7d6-4cf1-a941-68440691ef40 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:58.009125 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:58.035366 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 106/215] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 22 09:58:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:58.035366 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee3062-c7d6-4cf1-a941-68440691ef40 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:58.097829 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:58.104377 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547591f2-d8a3-4087-aed0-4875c3664c04 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:58.142256 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696978b5-0c0a-4c1d-916c-bec1f455bd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:58.143026 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696978b5-0c0a-4c1d-916c-bec1f455bd75 None admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:58.143225 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696978b5-0c0a-4c1d-916c-bec1f455bd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:58.143490 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696978b5-0c0a-4c1d-916c-bec1f455bd75 None admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:58.144357 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696978b5-0c0a-4c1d-916c-bec1f455bd75 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:58.145893 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696978b5-0c0a-4c1d-916c-bec1f455bd75 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:58.153187 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee3062-c7d6-4cf1-a941-68440691ef40 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:58.188577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6bed1-3c71-4d47-be4a-b3ca32e2d096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:58.190081 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6bed1-3c71-4d47-be4a-b3ca32e2d096 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:58.190081 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6bed1-3c71-4d47-be4a-b3ca32e2d096 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:58.190270 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6bed1-3c71-4d47-be4a-b3ca32e2d096 None admin] PATH_INFO: `/v3/users/0a727a87e45041b986a6279a2130d4d0` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:58.204299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6bed1-3c71-4d47-be4a-b3ca32e2d096 None admin] RBAC: Authorizing `identity:get_user(user_id=0a727a87e45041b986a6279a2130d4d0)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:58.205893 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6bed1-3c71-4d47-be4a-b3ca32e2d096 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:58.207790 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 107/216] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:58:58 2022] GET /identity/v3/users/0a727a87e45041b986a6279a2130d4d0 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:58:58.213139 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6bed1-3c71-4d47-be4a-b3ca32e2d096 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:58.276861 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 110/217] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 22 09:58:57 2022] POST /identity/v3/users => generated 297 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:58:58.337935 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6bed1-3c71-4d47-be4a-b3ca32e2d096 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:58.356350 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:58.384128 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881f1d1-6cfb-4131-ad4c-ed56ad76eadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:58.385120 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881f1d1-6cfb-4131-ad4c-ed56ad76eadc None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:58.386120 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881f1d1-6cfb-4131-ad4c-ed56ad76eadc None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:58.386545 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881f1d1-6cfb-4131-ad4c-ed56ad76eadc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:58.463789 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881f1d1-6cfb-4131-ad4c-ed56ad76eadc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:58.465519 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881f1d1-6cfb-4131-ad4c-ed56ad76eadc None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:58.570006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 108/218] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:58:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 09:58:58.575890 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696978b5-0c0a-4c1d-916c-bec1f455bd75 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:58.668933 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:58.708679 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696978b5-0c0a-4c1d-916c-bec1f455bd75 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:58.745950 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f4c74-a78a-43a4-805a-01a6e9cad688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:58.746826 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f4c74-a78a-43a4-805a-01a6e9cad688 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:58.747103 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f4c74-a78a-43a4-805a-01a6e9cad688 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:58.747371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f4c74-a78a-43a4-805a-01a6e9cad688 None admin] PATH_INFO: `/v3/projects/8935dc925ceb4fbc8b07442a34045d82` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:58.748598 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f4c74-a78a-43a4-805a-01a6e9cad688 None admin] RBAC: Authorizing `identity:get_project(project_id=8935dc925ceb4fbc8b07442a34045d82)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:58.750080 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f4c74-a78a-43a4-805a-01a6e9cad688 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:58.752194 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 111/219] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:58:58 2022] GET /identity/v3/projects/8935dc925ceb4fbc8b07442a34045d82 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:58:58.757914 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881f1d1-6cfb-4131-ad4c-ed56ad76eadc None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:58.777786 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:58.863440 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881f1d1-6cfb-4131-ad4c-ed56ad76eadc None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:58.902457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6efc8-75b3-44a8-9a81-732a0ef3b2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:58.903115 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6efc8-75b3-44a8-9a81-732a0ef3b2af None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:58.903500 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6efc8-75b3-44a8-9a81-732a0ef3b2af None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:58.903777 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6efc8-75b3-44a8-9a81-732a0ef3b2af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:58.904672 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6efc8-75b3-44a8-9a81-732a0ef3b2af None admin] RBAC: Adding query filter params (role.id=b8f82737ef614907a0d320c6e1f2facf, scope.project.id=8935dc925ceb4fbc8b07442a34045d82, user.id=0a727a87e45041b986a6279a2130d4d0) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:58.905031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6efc8-75b3-44a8-9a81-732a0ef3b2af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:58.906483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6efc8-75b3-44a8-9a81-732a0ef3b2af None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:58:58.912704 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 109/220] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 09:58:58 2022] GET /identity/v3/role_assignments?user.id=0a727a87e45041b986a6279a2130d4d0&scope.project.id=8935dc925ceb4fbc8b07442a34045d82&role.id=b8f82737ef614907a0d320c6e1f2facf => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:58:59.343026 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcec7f-11bc-4681-9ba7-1ba17c70620c None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:59.343571 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcec7f-11bc-4681-9ba7-1ba17c70620c None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:59.343571 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcec7f-11bc-4681-9ba7-1ba17c70620c None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:59.345565 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 112/221] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:58:59.350780 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006d9ba-edec-4fdb-af9e-648982beb5f3 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:59.351161 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006d9ba-edec-4fdb-af9e-648982beb5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:59.351446 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006d9ba-edec-4fdb-af9e-648982beb5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:59.372970 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-3006d9ba-edec-4fdb-af9e-648982beb5f3 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:59.374450 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-3006d9ba-edec-4fdb-af9e-648982beb5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:59.462350 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 110/222] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:58:59.491752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec11f9f-8dcc-422e-bf1b-b997dacb3416 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:59.492084 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec11f9f-8dcc-422e-bf1b-b997dacb3416 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:59.492312 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec11f9f-8dcc-422e-bf1b-b997dacb3416 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:59.493722 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 113/223] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:58:59.498434 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec11f9f-8dcc-422e-bf1b-b997dacb3416 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:59.502430 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6370046-9556-4475-81c5-a002cc387f21 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:59.502717 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6370046-9556-4475-81c5-a002cc387f21 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:59.502995 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6370046-9556-4475-81c5-a002cc387f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:59.537571 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-b6370046-9556-4475-81c5-a002cc387f21 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:58:59.538759 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-b6370046-9556-4475-81c5-a002cc387f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:58:59.546156 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:59.676740 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 111/224] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 09:58:59.681544 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec11f9f-8dcc-422e-bf1b-b997dacb3416 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:59.714701 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04df92-c061-477b-a641-5b2e6015c97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:59.715503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04df92-c061-477b-a641-5b2e6015c97f None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:59.715788 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04df92-c061-477b-a641-5b2e6015c97f None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:59.716067 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04df92-c061-477b-a641-5b2e6015c97f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:59.720583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6370046-9556-4475-81c5-a002cc387f21 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:59.736830 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:59.749929 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04df92-c061-477b-a641-5b2e6015c97f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:58:59.759440 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-ad04df92-c061-477b-a641-5b2e6015c97f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 09:58:59.759440 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:58:59.759440 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:58:59.759440 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:58:59.759440 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:58:59.759440 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:58:59.759440 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:58:59.759440 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:58:59.759440 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:58:59.759440 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:58:59.759440 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:58:59.759440 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:58:59.759440 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:58:59.759440 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:58:59.759440 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:58:59.759440 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:58:59.761219 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:58:59.761219 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:58:59.761219 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:58:59.761219 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:58:59.761219 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:58:59.761219 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:58:59.761219 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:58:59.761219 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:58:59.761219 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:58:59.761219 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:58:59.761219 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:58:59.761219 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:58:59.761219 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:58:59.761219 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:58:59.761219 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:58:59.761219 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:58:59.762075 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:58:59.762075 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:58:59.762075 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:58:59.762075 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:58:59.762075 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:58:59.762075 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:58:59.762075 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:58:59.762075 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:58:59.762075 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:58:59.762075 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:58:59.762075 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 09:58:59.762075 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:58:59.764965 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 114/225] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 09:58:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 09:58:59.777316 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04df92-c061-477b-a641-5b2e6015c97f None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:58:59.909485 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6370046-9556-4475-81c5-a002cc387f21 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:59.950100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04df92-c061-477b-a641-5b2e6015c97f None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:58:59.966554 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79818ef6-4121-4832-9ceb-d680f8b481ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:59.967386 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79818ef6-4121-4832-9ceb-d680f8b481ff None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:59.967672 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79818ef6-4121-4832-9ceb-d680f8b481ff None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:59.967950 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79818ef6-4121-4832-9ceb-d680f8b481ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:59.987105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:58:59.989089 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56691d4-ed94-42f8-9fd1-1e1fa9b1b145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:58:59.990368 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56691d4-ed94-42f8-9fd1-1e1fa9b1b145 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:58:59.990842 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56691d4-ed94-42f8-9fd1-1e1fa9b1b145 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:58:59.991397 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56691d4-ed94-42f8-9fd1-1e1fa9b1b145 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:58:59.992357 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56691d4-ed94-42f8-9fd1-1e1fa9b1b145 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:58:59.992879 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56691d4-ed94-42f8-9fd1-1e1fa9b1b145 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:58:59.993380 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79818ef6-4121-4832-9ceb-d680f8b481ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:58:59.994791 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56691d4-ed94-42f8-9fd1-1e1fa9b1b145 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:00.001831 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-79818ef6-4121-4832-9ceb-d680f8b481ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 09:59:00.001831 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:00.001831 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:00.001831 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:00.001831 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:00.001831 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:00.001831 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:00.001831 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:00.001831 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:00.001831 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:00.001831 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:00.001831 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:00.001831 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:00.001831 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:00.001831 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:00.001831 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:00.009374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:00.009374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:00.009374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:00.009374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:00.009374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:00.009374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:00.009374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:00.009374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:00.009374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:00.009374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:00.009374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:00.009374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:00.009374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:00.009374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:00.009374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:00.009374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:00.010668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:00.010668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:00.010668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:00.010668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:00.010668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:00.010668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:00.010668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:00.010668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:00.010668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:00.010668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:00.010668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 09:59:00.010668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:00.010668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 112/226] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 22 09:58:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 09:59:00.012113 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 115/227] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:58:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:00.014159 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79818ef6-4121-4832-9ceb-d680f8b481ff None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:00.017791 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56691d4-ed94-42f8-9fd1-1e1fa9b1b145 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:00.129626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:00.173469 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56691d4-ed94-42f8-9fd1-1e1fa9b1b145 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:00.201547 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79818ef6-4121-4832-9ceb-d680f8b481ff None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:00.216329 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6e3e2-8e25-44a7-a9c9-fc511a4ce731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:00.217234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6e3e2-8e25-44a7-a9c9-fc511a4ce731 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:00.217520 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6e3e2-8e25-44a7-a9c9-fc511a4ce731 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:00.217793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6e3e2-8e25-44a7-a9c9-fc511a4ce731 None admin] PATH_INFO: `/v3/users/b2914eda748a4741b601fb7eb9059e25` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:00.220149 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6e3e2-8e25-44a7-a9c9-fc511a4ce731 None admin] RBAC: Authorizing `identity:get_user(user_id=b2914eda748a4741b601fb7eb9059e25)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:00.221630 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6e3e2-8e25-44a7-a9c9-fc511a4ce731 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:00.224492 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 116/228] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:59:00 2022] GET /identity/v3/users/b2914eda748a4741b601fb7eb9059e25 => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:00.228660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6e3e2-8e25-44a7-a9c9-fc511a4ce731 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:00.293572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66903d0d-7796-4e15-8593-e6eda43e9bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:00.294273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66903d0d-7796-4e15-8593-e6eda43e9bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:00.294564 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66903d0d-7796-4e15-8593-e6eda43e9bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:00.294845 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66903d0d-7796-4e15-8593-e6eda43e9bd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:00.295619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66903d0d-7796-4e15-8593-e6eda43e9bd7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:00.295932 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66903d0d-7796-4e15-8593-e6eda43e9bd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:00.297417 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66903d0d-7796-4e15-8593-e6eda43e9bd7 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:00.329477 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 113/229] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 09:59:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:00.337830 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66903d0d-7796-4e15-8593-e6eda43e9bd7 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:00.345179 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6e3e2-8e25-44a7-a9c9-fc511a4ce731 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:00.375039 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:00.383166 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b948c96-5ee7-4ae8-ab46-01c456e32761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:00.384033 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b948c96-5ee7-4ae8-ab46-01c456e32761 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:00.384343 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b948c96-5ee7-4ae8-ab46-01c456e32761 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:00.384613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b948c96-5ee7-4ae8-ab46-01c456e32761 None admin] PATH_INFO: `/v3/projects/8935dc925ceb4fbc8b07442a34045d82` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:00.385881 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b948c96-5ee7-4ae8-ab46-01c456e32761 None admin] RBAC: Authorizing `identity:get_project(project_id=8935dc925ceb4fbc8b07442a34045d82)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:00.390496 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b948c96-5ee7-4ae8-ab46-01c456e32761 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:00.390496 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 117/230] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:59:00 2022] GET /identity/v3/projects/8935dc925ceb4fbc8b07442a34045d82 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:00.395295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b948c96-5ee7-4ae8-ab46-01c456e32761 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:00.469278 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:00.536654 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66903d0d-7796-4e15-8593-e6eda43e9bd7 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:00.576845 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c97b3-a803-476c-971d-2f2b600d7f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:00.576845 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c97b3-a803-476c-971d-2f2b600d7f7c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:00.576845 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c97b3-a803-476c-971d-2f2b600d7f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:00.576845 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c97b3-a803-476c-971d-2f2b600d7f7c None admin] PATH_INFO: `/v3/users/b2914eda748a4741b601fb7eb9059e25` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:00.578232 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c97b3-a803-476c-971d-2f2b600d7f7c None admin] RBAC: Authorizing `identity:get_user(user_id=b2914eda748a4741b601fb7eb9059e25)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:00.580022 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c97b3-a803-476c-971d-2f2b600d7f7c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:00.582310 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 114/231] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:59:00 2022] GET /identity/v3/users/b2914eda748a4741b601fb7eb9059e25 => generated 283 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:00.591382 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c97b3-a803-476c-971d-2f2b600d7f7c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:00.611748 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b948c96-5ee7-4ae8-ab46-01c456e32761 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:00.659123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92146b1-0ed7-45b1-a3dd-1876403626b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:00.659123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92146b1-0ed7-45b1-a3dd-1876403626b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:00.659123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92146b1-0ed7-45b1-a3dd-1876403626b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:00.659123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92146b1-0ed7-45b1-a3dd-1876403626b0 None admin] PATH_INFO: `/v3/projects/8935dc925ceb4fbc8b07442a34045d82/users/b2914eda748a4741b601fb7eb9059e25/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:00.660894 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92146b1-0ed7-45b1-a3dd-1876403626b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=8935dc925ceb4fbc8b07442a34045d82, user_id=b2914eda748a4741b601fb7eb9059e25, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:00.663984 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92146b1-0ed7-45b1-a3dd-1876403626b0 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:00.738842 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 118/232] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 22 09:59:00 2022] PUT /identity/v3/projects/8935dc925ceb4fbc8b07442a34045d82/users/b2914eda748a4741b601fb7eb9059e25/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:59:00.766092 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c97b3-a803-476c-971d-2f2b600d7f7c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:00.767186 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2178c-6e36-4ea7-b2c7-be6137ed4dc7 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:00.767719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2178c-6e36-4ea7-b2c7-be6137ed4dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:00.768187 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2178c-6e36-4ea7-b2c7-be6137ed4dc7 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:00.769943 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 119/233] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 09:59:00.775570 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf04a9-2a5b-41fb-8bd6-73272991cb90 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:00.776267 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf04a9-2a5b-41fb-8bd6-73272991cb90 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:00.776740 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf04a9-2a5b-41fb-8bd6-73272991cb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:00.795386 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-6adf04a9-2a5b-41fb-8bd6-73272991cb90 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:00.797035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-6adf04a9-2a5b-41fb-8bd6-73272991cb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:00.813738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:00.832510 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f609b8-0a98-4484-9087-64e4a6fba991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:00.833523 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f609b8-0a98-4484-9087-64e4a6fba991 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:00.834066 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f609b8-0a98-4484-9087-64e4a6fba991 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:00.835033 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f609b8-0a98-4484-9087-64e4a6fba991 None admin] PATH_INFO: `/v3/projects/8935dc925ceb4fbc8b07442a34045d82` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:00.835904 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f609b8-0a98-4484-9087-64e4a6fba991 None admin] RBAC: Authorizing `identity:get_project(project_id=8935dc925ceb4fbc8b07442a34045d82)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:00.837485 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f609b8-0a98-4484-9087-64e4a6fba991 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:00.839447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 115/234] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:59:00 2022] GET /identity/v3/projects/8935dc925ceb4fbc8b07442a34045d82 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:00.855363 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f609b8-0a98-4484-9087-64e4a6fba991 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:00.879667 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:00.888133 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 120/235] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 09:59:00.914721 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf04a9-2a5b-41fb-8bd6-73272991cb90 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:01.038573 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf04a9-2a5b-41fb-8bd6-73272991cb90 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:01.060492 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f609b8-0a98-4484-9087-64e4a6fba991 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:01.090319 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1232b-9a16-4e6b-a6fc-139339bf52cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:01.092138 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1232b-9a16-4e6b-a6fc-139339bf52cc None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:01.092637 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1232b-9a16-4e6b-a6fc-139339bf52cc None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:01.093293 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1232b-9a16-4e6b-a6fc-139339bf52cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:01.101737 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bc392-5e9b-46aa-bfbc-345c82d40c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:01.102617 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bc392-5e9b-46aa-bfbc-345c82d40c03 None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:01.102902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bc392-5e9b-46aa-bfbc-345c82d40c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:01.103181 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bc392-5e9b-46aa-bfbc-345c82d40c03 None admin] PATH_INFO: `/v3/projects/8935dc925ceb4fbc8b07442a34045d82/users/b2914eda748a4741b601fb7eb9059e25/roles/7783830649d941ea9507439a113fc5d9` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:01.107786 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35bc392-5e9b-46aa-bfbc-345c82d40c03 None admin] RBAC: Authorizing `identity:create_grant(project_id=8935dc925ceb4fbc8b07442a34045d82, user_id=b2914eda748a4741b601fb7eb9059e25, role_id=7783830649d941ea9507439a113fc5d9)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:01.108538 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1232b-9a16-4e6b-a6fc-139339bf52cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:01.109294 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35bc392-5e9b-46aa-bfbc-345c82d40c03 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:01.117877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-a6b1232b-9a16-4e6b-a6fc-139339bf52cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 09:59:01.117877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:01.117877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:01.117877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:01.117877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:01.117877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:01.117877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:01.117877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:01.117877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:01.117877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:01.117877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:01.117877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:01.117877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:01.117877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:01.117877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:01.117877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:01.118793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:01.118793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:01.118793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:01.118793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:01.118793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:01.118793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:01.118793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:01.118793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:01.118793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:01.118793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:01.118793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:01.118793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:01.118793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:01.118793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:01.118793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:01.118793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:01.120167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:01.120167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:01.120167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:01.120167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:01.120167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:01.120167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:01.120167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:01.120167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:01.120167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:01.120167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:01.120167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 09:59:01.120167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:01.122992 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 121/236] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:59:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:01.128770 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1232b-9a16-4e6b-a6fc-139339bf52cc None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:01.189656 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:01.231661 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 116/237] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 22 09:59:00 2022] PUT /identity/v3/projects/8935dc925ceb4fbc8b07442a34045d82/users/b2914eda748a4741b601fb7eb9059e25/roles/7783830649d941ea9507439a113fc5d9 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:59:01.232888 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d814814-ea68-4409-ac59-340b42a14aba None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:01.233190 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d814814-ea68-4409-ac59-340b42a14aba None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:01.233470 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d814814-ea68-4409-ac59-340b42a14aba None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:01.240289 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 117/238] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:01.240909 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1232b-9a16-4e6b-a6fc-139339bf52cc None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:01.248380 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f9695-151b-4ee0-aadb-7ea643e48fc3 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:01.248750 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f9695-151b-4ee0-aadb-7ea643e48fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:01.249000 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f9695-151b-4ee0-aadb-7ea643e48fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:01.278754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-379f9695-151b-4ee0-aadb-7ea643e48fc3 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:01.280018 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-379f9695-151b-4ee0-aadb-7ea643e48fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:01.312369 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306d788-88eb-441e-9c06-4784d937fe76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:01.313015 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306d788-88eb-441e-9c06-4784d937fe76 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:01.313305 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306d788-88eb-441e-9c06-4784d937fe76 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:01.313586 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306d788-88eb-441e-9c06-4784d937fe76 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:01.314364 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306d788-88eb-441e-9c06-4784d937fe76 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:01.314676 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306d788-88eb-441e-9c06-4784d937fe76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:01.316085 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306d788-88eb-441e-9c06-4784d937fe76 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:01.336402 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 122/239] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 22 09:59:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:01.346067 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306d788-88eb-441e-9c06-4784d937fe76 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:01.381067 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:01.410986 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 118/240] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 09:59:01.454374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f9695-151b-4ee0-aadb-7ea643e48fc3 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:01.497996 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306d788-88eb-441e-9c06-4784d937fe76 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:01.511387 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:01.539305 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88630851-3fba-4398-b835-d5bfa49b3420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:01.540184 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88630851-3fba-4398-b835-d5bfa49b3420 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:01.540469 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88630851-3fba-4398-b835-d5bfa49b3420 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:01.540749 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88630851-3fba-4398-b835-d5bfa49b3420 None admin] PATH_INFO: `/v3/users/8e78bc843cd94cc58adbc3e37ab57ca7` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:01.557766 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88630851-3fba-4398-b835-d5bfa49b3420 None admin] RBAC: Authorizing `identity:get_user(user_id=8e78bc843cd94cc58adbc3e37ab57ca7)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:01.559315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88630851-3fba-4398-b835-d5bfa49b3420 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:01.561088 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 123/241] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:59:01 2022] GET /identity/v3/users/8e78bc843cd94cc58adbc3e37ab57ca7 => generated 297 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:01.562533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e172ad9-4f00-42a4-a88f-e5bb1a0a9f7a None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:01.562771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e172ad9-4f00-42a4-a88f-e5bb1a0a9f7a None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:01.563053 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e172ad9-4f00-42a4-a88f-e5bb1a0a9f7a None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:01.564419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 124/242] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:01.568750 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f9695-151b-4ee0-aadb-7ea643e48fc3 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:01.569207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e172ad9-4f00-42a4-a88f-e5bb1a0a9f7a None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:01.605840 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7db73b-198f-4152-903c-6986105919ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:01.606762 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7db73b-198f-4152-903c-6986105919ea None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:01.607109 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7db73b-198f-4152-903c-6986105919ea None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:01.607381 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7db73b-198f-4152-903c-6986105919ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:01.608567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7db73b-198f-4152-903c-6986105919ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:01.610057 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7db73b-198f-4152-903c-6986105919ea None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:01.612006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 119/243] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:01.613333 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac24f36-0cec-449b-a32b-2b8bdaaa17ea None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:01.613616 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac24f36-0cec-449b-a32b-2b8bdaaa17ea None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:01.613892 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac24f36-0cec-449b-a32b-2b8bdaaa17ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:01.631751 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-4ac24f36-0cec-449b-a32b-2b8bdaaa17ea None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:01.633185 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-4ac24f36-0cec-449b-a32b-2b8bdaaa17ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:01.677937 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e172ad9-4f00-42a4-a88f-e5bb1a0a9f7a None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:01.697249 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:01.707841 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 120/244] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:01.709556 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac24f36-0cec-449b-a32b-2b8bdaaa17ea None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:01.726923 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2920b4-4fd8-4c36-973f-b982bc849b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:01.727689 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2920b4-4fd8-4c36-973f-b982bc849b3c None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:01.727978 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2920b4-4fd8-4c36-973f-b982bc849b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:01.728259 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2920b4-4fd8-4c36-973f-b982bc849b3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:01.776350 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:01.811618 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2920b4-4fd8-4c36-973f-b982bc849b3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:01.821931 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac24f36-0cec-449b-a32b-2b8bdaaa17ea None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:01.824445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2920b4-4fd8-4c36-973f-b982bc849b3c None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:01.853362 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f00b4-acf6-4935-b4ed-46ad516b5fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:01.854632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f00b4-acf6-4935-b4ed-46ad516b5fb7 None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:01.854922 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f00b4-acf6-4935-b4ed-46ad516b5fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:01.855201 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f00b4-acf6-4935-b4ed-46ad516b5fb7 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:01.856032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f00b4-acf6-4935-b4ed-46ad516b5fb7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:01.857706 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f00b4-acf6-4935-b4ed-46ad516b5fb7 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:01.932348 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 125/245] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:59:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 09:59:01.937930 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2920b4-4fd8-4c36-973f-b982bc849b3c None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:01.969386 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 121/246] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 22 09:59:01 2022] POST /identity/v3/users => generated 293 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:59:01.970058 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f00b4-acf6-4935-b4ed-46ad516b5fb7 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:02.061436 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:02.095450 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:02.113169 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2920b4-4fd8-4c36-973f-b982bc849b3c None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:02.160155 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80bccd-a77d-4161-9454-03b18b404547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:02.161476 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80bccd-a77d-4161-9454-03b18b404547 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:02.162017 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80bccd-a77d-4161-9454-03b18b404547 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:02.162550 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80bccd-a77d-4161-9454-03b18b404547 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:02.176629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80bccd-a77d-4161-9454-03b18b404547 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:02.186463 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-1c80bccd-a77d-4161-9454-03b18b404547 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:59:02.186463 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:02.186463 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:02.186463 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:02.186463 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:02.186463 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:02.186463 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:02.186463 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:02.186463 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:02.186463 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:02.186463 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:02.186463 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:02.186463 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:02.186463 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:02.186463 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:02.186463 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:02.187413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:02.187413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:02.187413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:02.187413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:02.187413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:02.187413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:02.187413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:02.187413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:02.187413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:02.187413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:02.187413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:02.187413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:02.187413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:02.187413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:02.187413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:02.187413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:02.188193 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:02.188193 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:02.188193 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:02.188193 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:02.188193 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:02.188193 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:02.188193 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:02.188193 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:02.188193 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:02.188193 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:02.188193 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:59:02.188193 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:02.191224 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 126/247] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:59:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:02.198466 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80bccd-a77d-4161-9454-03b18b404547 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:02.232443 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f00b4-acf6-4935-b4ed-46ad516b5fb7 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:02.281685 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b9343-22af-4a4e-834d-ccea79480d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:02.282572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b9343-22af-4a4e-834d-ccea79480d87 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:02.284001 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b9343-22af-4a4e-834d-ccea79480d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:02.284001 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b9343-22af-4a4e-834d-ccea79480d87 None admin] PATH_INFO: `/v3/projects/8935dc925ceb4fbc8b07442a34045d82` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:02.285560 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b9343-22af-4a4e-834d-ccea79480d87 None admin] RBAC: Authorizing `identity:get_project(project_id=8935dc925ceb4fbc8b07442a34045d82)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:02.287061 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b9343-22af-4a4e-834d-ccea79480d87 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:02.288845 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 122/248] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:59:01 2022] GET /identity/v3/projects/8935dc925ceb4fbc8b07442a34045d82 => generated 302 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:02.296137 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b9343-22af-4a4e-834d-ccea79480d87 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:02.353181 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80bccd-a77d-4161-9454-03b18b404547 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:02.381254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:02.391063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1db3cc-a9ed-4544-b8b6-26210633c805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:02.391894 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1db3cc-a9ed-4544-b8b6-26210633c805 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:02.393378 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1db3cc-a9ed-4544-b8b6-26210633c805 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:02.393378 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1db3cc-a9ed-4544-b8b6-26210633c805 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:02.393378 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1db3cc-a9ed-4544-b8b6-26210633c805 None admin] RBAC: Adding query filter params (name=member) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:02.393968 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1db3cc-a9ed-4544-b8b6-26210633c805 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:02.395527 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1db3cc-a9ed-4544-b8b6-26210633c805 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:02.406323 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 127/249] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 22 09:59:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:02.412841 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1db3cc-a9ed-4544-b8b6-26210633c805 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:02.431455 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b9343-22af-4a4e-834d-ccea79480d87 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:02.444244 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:02.474858 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8cc28-ed03-4a7a-a664-fa6d137d9a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:02.475844 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8cc28-ed03-4a7a-a664-fa6d137d9a1a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:02.476396 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8cc28-ed03-4a7a-a664-fa6d137d9a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:02.476727 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8cc28-ed03-4a7a-a664-fa6d137d9a1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:02.477618 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8cc28-ed03-4a7a-a664-fa6d137d9a1a None admin] RBAC: Adding query filter params (role.id=e744213e97f341cd862b25d2c45af211, scope.project.id=8935dc925ceb4fbc8b07442a34045d82, user.id=8e78bc843cd94cc58adbc3e37ab57ca7) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:02.478288 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8cc28-ed03-4a7a-a664-fa6d137d9a1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:02.480127 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8cc28-ed03-4a7a-a664-fa6d137d9a1a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:02.487769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 123/250] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 09:59:02 2022] GET /identity/v3/role_assignments?user.id=8e78bc843cd94cc58adbc3e37ab57ca7&scope.project.id=8935dc925ceb4fbc8b07442a34045d82&role.id=e744213e97f341cd862b25d2c45af211 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:02.563374 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1db3cc-a9ed-4544-b8b6-26210633c805 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:02.608660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861b7f4-9840-413b-8bdc-d65d7d7eedb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:02.609839 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861b7f4-9840-413b-8bdc-d65d7d7eedb4 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:02.610276 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861b7f4-9840-413b-8bdc-d65d7d7eedb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:02.610695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861b7f4-9840-413b-8bdc-d65d7d7eedb4 None admin] PATH_INFO: `/v3/users/0a727a87e45041b986a6279a2130d4d0` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:02.612964 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861b7f4-9840-413b-8bdc-d65d7d7eedb4 None admin] RBAC: Authorizing `identity:get_user(user_id=0a727a87e45041b986a6279a2130d4d0)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:02.614611 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861b7f4-9840-413b-8bdc-d65d7d7eedb4 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:02.616612 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 128/251] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:59:02 2022] GET /identity/v3/users/0a727a87e45041b986a6279a2130d4d0 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:02.623149 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8cc28-ed03-4a7a-a664-fa6d137d9a1a None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:02.745065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8cc28-ed03-4a7a-a664-fa6d137d9a1a None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:02.783468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105789a1-1f32-41a8-8999-eb33a180a642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:02.784345 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105789a1-1f32-41a8-8999-eb33a180a642 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:02.784623 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105789a1-1f32-41a8-8999-eb33a180a642 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:02.788940 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105789a1-1f32-41a8-8999-eb33a180a642 None admin] PATH_INFO: `/v3/projects/8935dc925ceb4fbc8b07442a34045d82` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:02.789706 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105789a1-1f32-41a8-8999-eb33a180a642 None admin] RBAC: Authorizing `identity:get_project(project_id=8935dc925ceb4fbc8b07442a34045d82)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:02.791260 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105789a1-1f32-41a8-8999-eb33a180a642 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:02.793762 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 124/252] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:59:02 2022] GET /identity/v3/projects/8935dc925ceb4fbc8b07442a34045d82 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:02.799395 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861b7f4-9840-413b-8bdc-d65d7d7eedb4 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:02.879102 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:02.935113 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861b7f4-9840-413b-8bdc-d65d7d7eedb4 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:02.972912 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be019fc1-d3ee-4255-93c9-5a8f705b1610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:02.973899 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be019fc1-d3ee-4255-93c9-5a8f705b1610 None admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:02.974188 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be019fc1-d3ee-4255-93c9-5a8f705b1610 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:02.974463 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be019fc1-d3ee-4255-93c9-5a8f705b1610 None admin] PATH_INFO: `/v3/projects/8935dc925ceb4fbc8b07442a34045d82/users/0a727a87e45041b986a6279a2130d4d0/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:02.976492 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be019fc1-d3ee-4255-93c9-5a8f705b1610 None admin] RBAC: Authorizing `identity:create_grant(project_id=8935dc925ceb4fbc8b07442a34045d82, user_id=0a727a87e45041b986a6279a2130d4d0, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:02.978060 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be019fc1-d3ee-4255-93c9-5a8f705b1610 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:03.059638 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 129/253] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 22 09:59:02 2022] PUT /identity/v3/projects/8935dc925ceb4fbc8b07442a34045d82/users/0a727a87e45041b986a6279a2130d4d0/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:59:03.185726 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3594bb-555c-444c-8c45-babcc1b0b6e9 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:03.186240 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3594bb-555c-444c-8c45-babcc1b0b6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:03.186240 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3594bb-555c-444c-8c45-babcc1b0b6e9 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:03.187757 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 125/254] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:03.199107 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d69e0-0723-42fc-a6c6-e38f20e343d0 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:03.199500 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d69e0-0723-42fc-a6c6-e38f20e343d0 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:03.199648 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d69e0-0723-42fc-a6c6-e38f20e343d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:03.223342 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-0d2d69e0-0723-42fc-a6c6-e38f20e343d0 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:03.224560 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-0d2d69e0-0723-42fc-a6c6-e38f20e343d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:03.327656 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 130/255] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 09:59:03.362734 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3594bb-555c-444c-8c45-babcc1b0b6e9 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:03.424080 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:03.497137 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3594bb-555c-444c-8c45-babcc1b0b6e9 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:03.544878 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1385312-7384-47c1-9708-f1bc03e334a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:03.545693 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1385312-7384-47c1-9708-f1bc03e334a6 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:03.545982 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1385312-7384-47c1-9708-f1bc03e334a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:03.546260 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1385312-7384-47c1-9708-f1bc03e334a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:03.564953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1385312-7384-47c1-9708-f1bc03e334a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:03.573823 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-f1385312-7384-47c1-9708-f1bc03e334a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 09:59:03.573823 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:03.573823 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:03.573823 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:03.573823 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:03.573823 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:03.573823 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:03.573823 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:03.573823 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:03.573823 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:03.573823 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:03.573823 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:03.573823 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:03.573823 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:03.573823 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:03.573823 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:03.574708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:03.574708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:03.574708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:03.574708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:03.574708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:03.574708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:03.574708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:03.574708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:03.574708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:03.574708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:03.574708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:03.574708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:03.574708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:03.574708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:03.574708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:03.574708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:03.575473 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:03.575473 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:03.575473 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:03.575473 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:03.575473 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:03.575473 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:03.575473 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:03.575473 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:03.575473 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:03.575473 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:03.575473 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 09:59:03.575473 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:03.578224 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 126/256] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 09:59:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:03.583513 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d69e0-0723-42fc-a6c6-e38f20e343d0 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:03.667899 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:03.708185 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d6e3c-63c9-46dc-982e-ead77afa08ad None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:03.709348 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d6e3c-63c9-46dc-982e-ead77afa08ad None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:03.709574 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d6e3c-63c9-46dc-982e-ead77afa08ad None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:03.711255 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 127/257] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:03.717672 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80069a0a-75f6-4116-b9ff-990483539922 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:03.718360 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80069a0a-75f6-4116-b9ff-990483539922 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:03.718647 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80069a0a-75f6-4116-b9ff-990483539922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:03.753012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d69e0-0723-42fc-a6c6-e38f20e343d0 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:03.755425 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-80069a0a-75f6-4116-b9ff-990483539922 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:03.756648 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-80069a0a-75f6-4116-b9ff-990483539922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:03.830310 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6e9ca-81ec-4874-bb84-4d1a52cbf2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:03.831783 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6e9ca-81ec-4874-bb84-4d1a52cbf2e2 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:03.832604 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6e9ca-81ec-4874-bb84-4d1a52cbf2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:03.833213 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6e9ca-81ec-4874-bb84-4d1a52cbf2e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:03.834488 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb6e9ca-81ec-4874-bb84-4d1a52cbf2e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:03.835019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb6e9ca-81ec-4874-bb84-4d1a52cbf2e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:03.836640 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb6e9ca-81ec-4874-bb84-4d1a52cbf2e2 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:03.849928 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 131/258] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:59:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:03.856844 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6e9ca-81ec-4874-bb84-4d1a52cbf2e2 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:03.993217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 128/259] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 09:59:04.035545 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80069a0a-75f6-4116-b9ff-990483539922 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:04.052654 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6e9ca-81ec-4874-bb84-4d1a52cbf2e2 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:04.094643 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:04.095214 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:04.100689 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786eee4-c2b5-4c45-840d-c7af6d5ad825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:04.101600 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786eee4-c2b5-4c45-840d-c7af6d5ad825 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:04.101881 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786eee4-c2b5-4c45-840d-c7af6d5ad825 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:04.102153 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786eee4-c2b5-4c45-840d-c7af6d5ad825 None admin] PATH_INFO: `/v3/users/b2914eda748a4741b601fb7eb9059e25` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:04.103360 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786eee4-c2b5-4c45-840d-c7af6d5ad825 None admin] RBAC: Authorizing `identity:get_user(user_id=b2914eda748a4741b601fb7eb9059e25)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:04.105569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786eee4-c2b5-4c45-840d-c7af6d5ad825 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:04.107539 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 132/260] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:59:03 2022] GET /identity/v3/users/b2914eda748a4741b601fb7eb9059e25 => generated 283 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:04.117885 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786eee4-c2b5-4c45-840d-c7af6d5ad825 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:04.278792 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80069a0a-75f6-4116-b9ff-990483539922 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:04.353351 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786eee4-c2b5-4c45-840d-c7af6d5ad825 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:04.360139 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5caaf6-34ae-4a15-af38-6784e8587458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:04.360998 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5caaf6-34ae-4a15-af38-6784e8587458 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:04.361279 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5caaf6-34ae-4a15-af38-6784e8587458 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:04.361552 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5caaf6-34ae-4a15-af38-6784e8587458 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:04.388314 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5caaf6-34ae-4a15-af38-6784e8587458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:04.396668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-dd5caaf6-34ae-4a15-af38-6784e8587458 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 09:59:04.396668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:04.396668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:04.396668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:04.396668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:04.396668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:04.396668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:04.396668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:04.396668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:04.396668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:04.396668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:04.396668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:04.396668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:04.396668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:04.396668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:04.396668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:04.397632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:04.397632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:04.397632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:04.397632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:04.397632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:04.397632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:04.397632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:04.397632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:04.397632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:04.397632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:04.397632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:04.397632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:04.397632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:04.397632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:04.397632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:04.397632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:04.398414 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:04.398414 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:04.398414 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:04.398414 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:04.398414 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:04.398414 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:04.398414 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:04.398414 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:04.398414 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:04.398414 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:04.398414 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 09:59:04.398414 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:04.411112 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 129/261] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 22 09:59:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:04.415803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5caaf6-34ae-4a15-af38-6784e8587458 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:04.428284 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e60ab-ba9a-4b21-b8a1-e4b36379a530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:04.428969 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e60ab-ba9a-4b21-b8a1-e4b36379a530 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:04.429252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e60ab-ba9a-4b21-b8a1-e4b36379a530 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:04.429527 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e60ab-ba9a-4b21-b8a1-e4b36379a530 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:04.521897 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:04.577996 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e60ab-ba9a-4b21-b8a1-e4b36379a530 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:04.580536 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e60ab-ba9a-4b21-b8a1-e4b36379a530 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:04.604922 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:04.623878 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5caaf6-34ae-4a15-af38-6784e8587458 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:04.717258 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93958840-d3fc-4569-b9ea-6d711302fb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:04.717942 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93958840-d3fc-4569-b9ea-6d711302fb76 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:04.718223 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93958840-d3fc-4569-b9ea-6d711302fb76 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:04.718496 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93958840-d3fc-4569-b9ea-6d711302fb76 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:04.719357 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93958840-d3fc-4569-b9ea-6d711302fb76 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:04.719544 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93958840-d3fc-4569-b9ea-6d711302fb76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:04.721014 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93958840-d3fc-4569-b9ea-6d711302fb76 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:04.747710 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 130/262] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 09:59:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:04.753831 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93958840-d3fc-4569-b9ea-6d711302fb76 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:04.756194 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 133/263] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:59:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 09:59:04.763470 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e60ab-ba9a-4b21-b8a1-e4b36379a530 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:04.962598 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:05.008233 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93958840-d3fc-4569-b9ea-6d711302fb76 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:05.016628 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e60ab-ba9a-4b21-b8a1-e4b36379a530 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:05.071977 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ff959-7ae3-4b59-a33d-54710bc8910b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:05.078332 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ff959-7ae3-4b59-a33d-54710bc8910b None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:05.078617 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ff959-7ae3-4b59-a33d-54710bc8910b None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:05.078900 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ff959-7ae3-4b59-a33d-54710bc8910b None admin] PATH_INFO: `/v3/projects/8935dc925ceb4fbc8b07442a34045d82` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:05.080180 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ff959-7ae3-4b59-a33d-54710bc8910b None admin] RBAC: Authorizing `identity:get_project(project_id=8935dc925ceb4fbc8b07442a34045d82)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:05.081800 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ff959-7ae3-4b59-a33d-54710bc8910b None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:05.084095 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 134/264] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:59:04 2022] GET /identity/v3/projects/8935dc925ceb4fbc8b07442a34045d82 => generated 302 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:05.084540 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9d845-32c9-4c73-aee6-ac89a2247b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:05.085533 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9d845-32c9-4c73-aee6-ac89a2247b70 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:05.085815 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9d845-32c9-4c73-aee6-ac89a2247b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:05.086095 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9d845-32c9-4c73-aee6-ac89a2247b70 None admin] PATH_INFO: `/v3/users/b2914eda748a4741b601fb7eb9059e25` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:05.087343 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9d845-32c9-4c73-aee6-ac89a2247b70 None admin] RBAC: Authorizing `identity:get_user(user_id=b2914eda748a4741b601fb7eb9059e25)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:05.089470 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ff959-7ae3-4b59-a33d-54710bc8910b None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:05.093637 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9d845-32c9-4c73-aee6-ac89a2247b70 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:05.095378 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 131/265] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:59:04 2022] GET /identity/v3/users/b2914eda748a4741b601fb7eb9059e25 => generated 283 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:05.100877 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9d845-32c9-4c73-aee6-ac89a2247b70 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:05.178846 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:05.259561 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ff959-7ae3-4b59-a33d-54710bc8910b None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:05.320982 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee30b09-84ae-4a21-bf5e-b12f1a0b26a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:05.321644 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee30b09-84ae-4a21-bf5e-b12f1a0b26a6 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:05.321930 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee30b09-84ae-4a21-bf5e-b12f1a0b26a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:05.322281 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee30b09-84ae-4a21-bf5e-b12f1a0b26a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:05.323151 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee30b09-84ae-4a21-bf5e-b12f1a0b26a6 None admin] RBAC: Adding query filter params (role.id=106aa464a69a49b09de7de5417083d3c, scope.project.id=8935dc925ceb4fbc8b07442a34045d82, user.id=b2914eda748a4741b601fb7eb9059e25) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:05.323461 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee30b09-84ae-4a21-bf5e-b12f1a0b26a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:05.324920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee30b09-84ae-4a21-bf5e-b12f1a0b26a6 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:05.330282 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9d845-32c9-4c73-aee6-ac89a2247b70 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:05.340476 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 135/266] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 09:59:05 2022] GET /identity/v3/role_assignments?user.id=b2914eda748a4741b601fb7eb9059e25&scope.project.id=8935dc925ceb4fbc8b07442a34045d82&role.id=106aa464a69a49b09de7de5417083d3c => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:05.341799 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a8b2f-2d20-4289-8e32-29a191815fe7 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:05.342086 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a8b2f-2d20-4289-8e32-29a191815fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:05.342363 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a8b2f-2d20-4289-8e32-29a191815fe7 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:05.343622 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 136/267] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:05.351777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62649b12-a396-4819-aa15-7a2f975dd8a8 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:05.352085 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62649b12-a396-4819-aa15-7a2f975dd8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:05.352336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62649b12-a396-4819-aa15-7a2f975dd8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:05.390620 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abedc9b1-1c94-4f53-b0ac-a1d60080e7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:05.391668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedc9b1-1c94-4f53-b0ac-a1d60080e7cd None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:05.392211 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedc9b1-1c94-4f53-b0ac-a1d60080e7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:05.392714 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedc9b1-1c94-4f53-b0ac-a1d60080e7cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:05.393920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-62649b12-a396-4819-aa15-7a2f975dd8a8 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:05.395144 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-62649b12-a396-4819-aa15-7a2f975dd8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:05.406071 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:05.526388 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abedc9b1-1c94-4f53-b0ac-a1d60080e7cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:05.528245 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abedc9b1-1c94-4f53-b0ac-a1d60080e7cd None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:05.554532 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 137/268] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 09:59:05.574012 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:05.586293 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef127c-d526-45e9-a323-643b4767749c None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:05.586581 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef127c-d526-45e9-a323-643b4767749c None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:05.586864 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef127c-d526-45e9-a323-643b4767749c None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:05.592788 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 138/269] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 09:59:05.594469 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc2d65-f8d8-4f16-ba1f-c6ef7dad8ac4 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:05.594831 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc2d65-f8d8-4f16-ba1f-c6ef7dad8ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:05.595183 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc2d65-f8d8-4f16-ba1f-c6ef7dad8ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:05.613502 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-26fc2d65-f8d8-4f16-ba1f-c6ef7dad8ac4 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:05.614795 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-26fc2d65-f8d8-4f16-ba1f-c6ef7dad8ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:05.687900 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 132/270] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:59:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 09:59:05.687900 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f0ac3-b041-47ea-93dc-25f9ce603966 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:05.687900 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f0ac3-b041-47ea-93dc-25f9ce603966 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:05.687900 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f0ac3-b041-47ea-93dc-25f9ce603966 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:05.688939 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 133/271] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:05.689679 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f0ac3-b041-47ea-93dc-25f9ce603966 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:05.704403 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 139/272] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:05.705123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc2d65-f8d8-4f16-ba1f-c6ef7dad8ac4 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:05.793593 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:05.821418 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f0ac3-b041-47ea-93dc-25f9ce603966 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:05.834516 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc2d65-f8d8-4f16-ba1f-c6ef7dad8ac4 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:05.845579 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:05.858783 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f5c85-cecd-4dab-85c4-b2b4182875f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:05.859590 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f5c85-cecd-4dab-85c4-b2b4182875f8 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:05.859876 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f5c85-cecd-4dab-85c4-b2b4182875f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:05.860154 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f5c85-cecd-4dab-85c4-b2b4182875f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:05.861372 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f5c85-cecd-4dab-85c4-b2b4182875f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:05.862934 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f5c85-cecd-4dab-85c4-b2b4182875f8 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:05.865105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 134/273] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:05.865804 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31cc83-271e-4ef1-8747-e96571eab148 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:05.866994 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31cc83-271e-4ef1-8747-e96571eab148 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:05.866994 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31cc83-271e-4ef1-8747-e96571eab148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:05.881547 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc649d-a24d-4b96-a90f-47adb74d8313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:05.882416 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc649d-a24d-4b96-a90f-47adb74d8313 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:05.882695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc649d-a24d-4b96-a90f-47adb74d8313 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:05.882966 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc649d-a24d-4b96-a90f-47adb74d8313 None admin] PATH_INFO: `/v3/projects/8935dc925ceb4fbc8b07442a34045d82` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:05.883078 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-0b31cc83-271e-4ef1-8747-e96571eab148 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:05.884162 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-0b31cc83-271e-4ef1-8747-e96571eab148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:05.884346 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc649d-a24d-4b96-a90f-47adb74d8313 None admin] RBAC: Authorizing `identity:get_project(project_id=8935dc925ceb4fbc8b07442a34045d82)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:05.885671 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc649d-a24d-4b96-a90f-47adb74d8313 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:05.892080 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 140/274] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:59:05 2022] GET /identity/v3/projects/8935dc925ceb4fbc8b07442a34045d82 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:05.892948 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc649d-a24d-4b96-a90f-47adb74d8313 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:05.964843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 135/275] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:05.964843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31cc83-271e-4ef1-8747-e96571eab148 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:06.011644 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc649d-a24d-4b96-a90f-47adb74d8313 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:06.047496 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd18dc-4db5-4cf4-8c7f-ff43ffb260ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:06.048562 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd18dc-4db5-4cf4-8c7f-ff43ffb260ce None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:06.048867 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd18dc-4db5-4cf4-8c7f-ff43ffb260ce None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:06.049145 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd18dc-4db5-4cf4-8c7f-ff43ffb260ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:06.056379 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:06.060177 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd18dc-4db5-4cf4-8c7f-ff43ffb260ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:06.068019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-defd18dc-4db5-4cf4-8c7f-ff43ffb260ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:59:06.068019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:06.068019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:06.068019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:06.068019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:06.068019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:06.068019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:06.068019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:06.068019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:06.068019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:06.068019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:06.068019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:06.068019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:06.068019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:06.068019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:06.068019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:06.068926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:06.068926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:06.068926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:06.068926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:06.068926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:06.068926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:06.068926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:06.068926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:06.068926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:06.068926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:06.068926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:06.068926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:06.068926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:06.068926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:06.068926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:06.068926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:06.069843 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:06.069843 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:06.069843 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:06.069843 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:06.069843 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:06.069843 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:06.069843 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:06.069843 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:06.069843 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:06.069843 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:06.069843 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:59:06.069843 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:06.069843 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 141/276] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:59:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:06.070485 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd18dc-4db5-4cf4-8c7f-ff43ffb260ce None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:06.075837 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31cc83-271e-4ef1-8747-e96571eab148 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:06.098139 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:06.114158 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808adff-475d-4e39-8ac5-a6fc04633dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:06.115244 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808adff-475d-4e39-8ac5-a6fc04633dca None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:06.115244 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808adff-475d-4e39-8ac5-a6fc04633dca None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:06.115466 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808adff-475d-4e39-8ac5-a6fc04633dca None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:06.130399 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808adff-475d-4e39-8ac5-a6fc04633dca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:06.130399 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808adff-475d-4e39-8ac5-a6fc04633dca None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:06.179959 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd18dc-4db5-4cf4-8c7f-ff43ffb260ce None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:06.213760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2497ae-2676-48ae-93a2-6e4f25303b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:06.214407 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2497ae-2676-48ae-93a2-6e4f25303b81 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:06.214686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2497ae-2676-48ae-93a2-6e4f25303b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:06.214959 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2497ae-2676-48ae-93a2-6e4f25303b81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:06.215780 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2497ae-2676-48ae-93a2-6e4f25303b81 None admin] RBAC: Adding query filter params (role.id=7783830649d941ea9507439a113fc5d9, scope.project.id=8935dc925ceb4fbc8b07442a34045d82, user.id=b2914eda748a4741b601fb7eb9059e25) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:06.216087 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2497ae-2676-48ae-93a2-6e4f25303b81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:06.217551 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2497ae-2676-48ae-93a2-6e4f25303b81 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:06.223678 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 142/277] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 09:59:06 2022] GET /identity/v3/role_assignments?user.id=b2914eda748a4741b601fb7eb9059e25&scope.project.id=8935dc925ceb4fbc8b07442a34045d82&role.id=7783830649d941ea9507439a113fc5d9 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:06.224480 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2497ae-2676-48ae-93a2-6e4f25303b81 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:06.263407 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 136/278] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 22 09:59:05 2022] POST /identity/v3/users => generated 293 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:59:06.264268 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808adff-475d-4e39-8ac5-a6fc04633dca None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:06.310687 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:06.362144 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2497ae-2676-48ae-93a2-6e4f25303b81 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:06.409868 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944eb6a-c08b-436e-9ec4-509c19693dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:06.410678 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944eb6a-c08b-436e-9ec4-509c19693dcb None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:06.410960 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944eb6a-c08b-436e-9ec4-509c19693dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:06.411343 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944eb6a-c08b-436e-9ec4-509c19693dcb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:06.425227 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944eb6a-c08b-436e-9ec4-509c19693dcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:06.430787 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808adff-475d-4e39-8ac5-a6fc04633dca None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:06.435182 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-c944eb6a-c08b-436e-9ec4-509c19693dcb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 09:59:06.435182 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:06.435182 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:06.435182 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:06.435182 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:06.435182 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:06.435182 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:06.435182 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:06.435182 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:06.435182 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:06.435182 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:06.435182 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:06.435182 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:06.435182 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:06.435182 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:06.435182 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:06.436090 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:06.436090 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:06.436090 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:06.436090 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:06.436090 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:06.436090 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:06.436090 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:06.436090 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:06.436090 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:06.436090 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:06.436090 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:06.436090 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:06.436090 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:06.436090 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:06.436090 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:06.436090 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:06.436893 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:06.436893 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:06.436893 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:06.436893 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:06.436893 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:06.436893 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:06.436893 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:06.436893 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:06.436893 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:06.436893 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:06.436893 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 09:59:06.436893 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:06.436893 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 143/279] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:59:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:06.442269 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2c602-b431-4585-8c59-4f9570356083 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:06.442570 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2c602-b431-4585-8c59-4f9570356083 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:06.442853 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2c602-b431-4585-8c59-4f9570356083 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:06.444577 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 144/280] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:06.448018 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2c602-b431-4585-8c59-4f9570356083 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:06.478899 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a28e4b-9f1f-433f-8235-c27c41c1d366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:06.479588 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a28e4b-9f1f-433f-8235-c27c41c1d366 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:06.479922 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a28e4b-9f1f-433f-8235-c27c41c1d366 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:06.480217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a28e4b-9f1f-433f-8235-c27c41c1d366 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:06.481148 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a28e4b-9f1f-433f-8235-c27c41c1d366 None admin] RBAC: Adding query filter params (name=member) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:06.481467 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a28e4b-9f1f-433f-8235-c27c41c1d366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:06.482862 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a28e4b-9f1f-433f-8235-c27c41c1d366 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:06.494525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 137/281] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 22 09:59:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:06.497094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b434492-8f35-431b-b51f-0329006ed742 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:06.497473 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b434492-8f35-431b-b51f-0329006ed742 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:06.497949 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b434492-8f35-431b-b51f-0329006ed742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:06.518778 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-5b434492-8f35-431b-b51f-0329006ed742 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:06.520499 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-5b434492-8f35-431b-b51f-0329006ed742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:06.565945 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:06.591314 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2c602-b431-4585-8c59-4f9570356083 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:06.609722 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 138/282] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:06.610594 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b434492-8f35-431b-b51f-0329006ed742 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:06.617753 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:06.636742 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b717ca3-c3a5-44bd-abcb-2836142d321d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:06.637762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b717ca3-c3a5-44bd-abcb-2836142d321d None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:06.638604 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b717ca3-c3a5-44bd-abcb-2836142d321d None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:06.638604 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b717ca3-c3a5-44bd-abcb-2836142d321d None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:06.639105 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b717ca3-c3a5-44bd-abcb-2836142d321d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:06.640051 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b717ca3-c3a5-44bd-abcb-2836142d321d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:06.640805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b717ca3-c3a5-44bd-abcb-2836142d321d None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:06.652611 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 145/283] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 22 09:59:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:06.660081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b717ca3-c3a5-44bd-abcb-2836142d321d None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:06.747251 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b434492-8f35-431b-b51f-0329006ed742 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:06.781825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b717ca3-c3a5-44bd-abcb-2836142d321d None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:06.808295 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d351f-9d99-4e5c-a70a-3904916ca4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:06.809751 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d351f-9d99-4e5c-a70a-3904916ca4f2 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:06.810035 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d351f-9d99-4e5c-a70a-3904916ca4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:06.810319 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d351f-9d99-4e5c-a70a-3904916ca4f2 None admin] PATH_INFO: `/v3/users/1b52e2ad9a1549d096d54e2b99cc3b9f` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:06.839122 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d351f-9d99-4e5c-a70a-3904916ca4f2 None admin] RBAC: Authorizing `identity:get_user(user_id=1b52e2ad9a1549d096d54e2b99cc3b9f)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:06.839942 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7ef20-c783-4ff0-9b46-42e5301f422a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:06.840556 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d351f-9d99-4e5c-a70a-3904916ca4f2 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:06.841538 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7ef20-c783-4ff0-9b46-42e5301f422a None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:06.841980 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7ef20-c783-4ff0-9b46-42e5301f422a None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:06.842492 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7ef20-c783-4ff0-9b46-42e5301f422a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:06.842812 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 139/284] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:59:06 2022] GET /identity/v3/users/1b52e2ad9a1549d096d54e2b99cc3b9f => generated 293 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:06.843605 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d351f-9d99-4e5c-a70a-3904916ca4f2 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:06.883372 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7ef20-c783-4ff0-9b46-42e5301f422a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:06.897313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-09f7ef20-c783-4ff0-9b46-42e5301f422a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:59:06.897313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:06.897313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:06.897313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:06.897313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:06.897313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:06.897313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:06.897313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:06.897313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:06.897313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:06.897313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:06.897313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:06.897313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:06.897313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:06.897313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:06.897313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:06.898234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:06.898234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:06.898234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:06.898234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:06.898234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:06.898234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:06.898234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:06.898234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:06.898234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:06.898234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:06.898234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:06.898234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:06.898234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:06.898234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:06.898234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:06.898234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:06.899001 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:06.899001 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:06.899001 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:06.899001 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:06.899001 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:06.899001 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:06.899001 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:06.899001 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:06.899001 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:06.899001 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:06.899001 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:59:06.899001 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:06.903184 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:06.910905 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 146/285] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:59:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:06.912178 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7ef20-c783-4ff0-9b46-42e5301f422a None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:06.985566 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d351f-9d99-4e5c-a70a-3904916ca4f2 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:07.024318 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b9d95-77c9-401b-8ce5-064f30cb1472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:07.025844 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b9d95-77c9-401b-8ce5-064f30cb1472 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:07.026458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b9d95-77c9-401b-8ce5-064f30cb1472 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:07.026945 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b9d95-77c9-401b-8ce5-064f30cb1472 None admin] PATH_INFO: `/v3/users/8e78bc843cd94cc58adbc3e37ab57ca7` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:07.028616 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b9d95-77c9-401b-8ce5-064f30cb1472 None admin] RBAC: Authorizing `identity:get_user(user_id=8e78bc843cd94cc58adbc3e37ab57ca7)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:07.030323 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b9d95-77c9-401b-8ce5-064f30cb1472 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:07.032554 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 140/286] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:59:06 2022] GET /identity/v3/users/8e78bc843cd94cc58adbc3e37ab57ca7 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:07.033659 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b9d95-77c9-401b-8ce5-064f30cb1472 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:07.045126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:07.139462 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7ef20-c783-4ff0-9b46-42e5301f422a None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:07.218063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa30ce1-4438-47ab-b55d-d6fb3780b0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:07.219155 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa30ce1-4438-47ab-b55d-d6fb3780b0ab None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:07.220538 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa30ce1-4438-47ab-b55d-d6fb3780b0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:07.222378 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa30ce1-4438-47ab-b55d-d6fb3780b0ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:07.223476 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa30ce1-4438-47ab-b55d-d6fb3780b0ab None admin] RBAC: Adding query filter params (role.id=b8f82737ef614907a0d320c6e1f2facf, user.id=1b52e2ad9a1549d096d54e2b99cc3b9f, scope.system=all) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:07.224618 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa30ce1-4438-47ab-b55d-d6fb3780b0ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:07.225507 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:07.226138 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa30ce1-4438-47ab-b55d-d6fb3780b0ab None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:07.232738 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 147/287] 10.222.0.46 () {56 vars in 1308 bytes} [Wed Jun 22 09:59:06 2022] GET /identity/v3/role_assignments?user.id=1b52e2ad9a1549d096d54e2b99cc3b9f&scope.system=all&role.id=b8f82737ef614907a0d320c6e1f2facf => generated 226 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:07.238567 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa30ce1-4438-47ab-b55d-d6fb3780b0ab None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:07.238732 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b9d95-77c9-401b-8ce5-064f30cb1472 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:07.276936 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6390e7-41d3-48f3-ad2a-f53cc804c0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:07.278043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6390e7-41d3-48f3-ad2a-f53cc804c0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:07.278635 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6390e7-41d3-48f3-ad2a-f53cc804c0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:07.279110 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6390e7-41d3-48f3-ad2a-f53cc804c0e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:07.280203 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6390e7-41d3-48f3-ad2a-f53cc804c0e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:07.280737 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6390e7-41d3-48f3-ad2a-f53cc804c0e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:07.282472 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6390e7-41d3-48f3-ad2a-f53cc804c0e3 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:07.294723 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 141/288] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 22 09:59:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:07.305924 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6390e7-41d3-48f3-ad2a-f53cc804c0e3 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:07.418213 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa30ce1-4438-47ab-b55d-d6fb3780b0ab None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:07.424624 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6390e7-41d3-48f3-ad2a-f53cc804c0e3 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:07.428209 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:07.460051 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294befc0-d402-4147-8853-0d96d2df443f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:07.460938 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294befc0-d402-4147-8853-0d96d2df443f None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:07.461229 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294befc0-d402-4147-8853-0d96d2df443f None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:07.461508 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294befc0-d402-4147-8853-0d96d2df443f None admin] PATH_INFO: `/v3/projects/8935dc925ceb4fbc8b07442a34045d82` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:07.463269 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294befc0-d402-4147-8853-0d96d2df443f None admin] RBAC: Authorizing `identity:get_project(project_id=8935dc925ceb4fbc8b07442a34045d82)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:07.464711 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294befc0-d402-4147-8853-0d96d2df443f None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:07.465154 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b09031-549e-4dfd-b8af-082e4b46f8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:07.466566 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b09031-549e-4dfd-b8af-082e4b46f8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:07.466786 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 148/289] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:59:07 2022] GET /identity/v3/projects/8935dc925ceb4fbc8b07442a34045d82 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:07.467260 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b09031-549e-4dfd-b8af-082e4b46f8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:07.467748 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b09031-549e-4dfd-b8af-082e4b46f8d8 None admin] PATH_INFO: `/v3/users/0a727a87e45041b986a6279a2130d4d0` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:07.469361 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b09031-549e-4dfd-b8af-082e4b46f8d8 None admin] RBAC: Authorizing `identity:get_user(user_id=0a727a87e45041b986a6279a2130d4d0)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:07.471024 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b09031-549e-4dfd-b8af-082e4b46f8d8 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:07.472341 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294befc0-d402-4147-8853-0d96d2df443f None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:07.473260 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 142/290] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:59:07 2022] GET /identity/v3/users/0a727a87e45041b986a6279a2130d4d0 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:07.481911 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b09031-549e-4dfd-b8af-082e4b46f8d8 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:07.528386 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:07.613632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b09031-549e-4dfd-b8af-082e4b46f8d8 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:07.652150 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50a72b-e6d6-4b6c-a76f-b217afe75784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:07.653200 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50a72b-e6d6-4b6c-a76f-b217afe75784 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:07.653736 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50a72b-e6d6-4b6c-a76f-b217afe75784 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:07.654215 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50a72b-e6d6-4b6c-a76f-b217afe75784 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:07.734699 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a50a72b-e6d6-4b6c-a76f-b217afe75784 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:07.734699 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a50a72b-e6d6-4b6c-a76f-b217afe75784 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:07.734930 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294befc0-d402-4147-8853-0d96d2df443f None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:07.755367 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:07.804210 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c4071-2533-4d4a-8232-9b0e87608327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:07.805167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c4071-2533-4d4a-8232-9b0e87608327 None admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:07.805497 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c4071-2533-4d4a-8232-9b0e87608327 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:07.805822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c4071-2533-4d4a-8232-9b0e87608327 None admin] PATH_INFO: `/v3/projects/8935dc925ceb4fbc8b07442a34045d82/users/8e78bc843cd94cc58adbc3e37ab57ca7/roles/e744213e97f341cd862b25d2c45af211` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:07.814542 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c4071-2533-4d4a-8232-9b0e87608327 None admin] RBAC: Authorizing `identity:create_grant(project_id=8935dc925ceb4fbc8b07442a34045d82, user_id=8e78bc843cd94cc58adbc3e37ab57ca7, role_id=e744213e97f341cd862b25d2c45af211)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:07.816009 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c4071-2533-4d4a-8232-9b0e87608327 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:07.840937 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 143/291] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:59:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 09:59:07.846637 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50a72b-e6d6-4b6c-a76f-b217afe75784 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:07.927405 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 149/292] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 22 09:59:07 2022] PUT /identity/v3/projects/8935dc925ceb4fbc8b07442a34045d82/users/8e78bc843cd94cc58adbc3e37ab57ca7/roles/e744213e97f341cd862b25d2c45af211 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:59:07.967233 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50a72b-e6d6-4b6c-a76f-b217afe75784 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:08.003887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:08.016658 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cdbc7-adfa-4f87-a6a1-3e72dd9ae296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:08.017612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cdbc7-adfa-4f87-a6a1-3e72dd9ae296 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:08.017898 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cdbc7-adfa-4f87-a6a1-3e72dd9ae296 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:08.021061 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cdbc7-adfa-4f87-a6a1-3e72dd9ae296 None admin] PATH_INFO: `/v3/projects/8935dc925ceb4fbc8b07442a34045d82` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:08.021061 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23cdbc7-adfa-4f87-a6a1-3e72dd9ae296 None admin] RBAC: Authorizing `identity:get_project(project_id=8935dc925ceb4fbc8b07442a34045d82)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:08.021061 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23cdbc7-adfa-4f87-a6a1-3e72dd9ae296 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:08.023357 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 144/293] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:59:07 2022] GET /identity/v3/projects/8935dc925ceb4fbc8b07442a34045d82 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:08.029308 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c4071-2533-4d4a-8232-9b0e87608327 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:08.093970 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:08.184449 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c4071-2533-4d4a-8232-9b0e87608327 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:08.222363 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cac9f8-52dc-4a03-a163-7e5d236250f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:08.223773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cac9f8-52dc-4a03-a163-7e5d236250f0 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:08.224526 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cac9f8-52dc-4a03-a163-7e5d236250f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:08.225179 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cac9f8-52dc-4a03-a163-7e5d236250f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:08.226225 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cac9f8-52dc-4a03-a163-7e5d236250f0 None admin] RBAC: Adding query filter params (role.id=b8f82737ef614907a0d320c6e1f2facf, scope.project.id=8935dc925ceb4fbc8b07442a34045d82, user.id=0a727a87e45041b986a6279a2130d4d0) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:08.226734 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cac9f8-52dc-4a03-a163-7e5d236250f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:08.228901 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cac9f8-52dc-4a03-a163-7e5d236250f0 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:08.235999 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 150/294] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 09:59:08 2022] GET /identity/v3/role_assignments?user.id=0a727a87e45041b986a6279a2130d4d0&scope.project.id=8935dc925ceb4fbc8b07442a34045d82&role.id=b8f82737ef614907a0d320c6e1f2facf => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:08.872845 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7d145-5f72-40eb-b015-87d8b81a8be3 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:08.873339 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7d145-5f72-40eb-b015-87d8b81a8be3 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:08.873409 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7d145-5f72-40eb-b015-87d8b81a8be3 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:08.878621 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 145/295] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:08.882276 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953de973-2b7c-44c8-8f23-2fc20e0392da None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:08.882563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953de973-2b7c-44c8-8f23-2fc20e0392da None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:08.882841 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953de973-2b7c-44c8-8f23-2fc20e0392da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:08.904358 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-953de973-2b7c-44c8-8f23-2fc20e0392da None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:08.905591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-953de973-2b7c-44c8-8f23-2fc20e0392da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:08.976903 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 151/296] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 09:59:08.977494 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239cadd-2462-4f0c-9449-4c0df7df2ea0 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:08.977494 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239cadd-2462-4f0c-9449-4c0df7df2ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:08.977766 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239cadd-2462-4f0c-9449-4c0df7df2ea0 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:08.980416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 146/297] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:08.984778 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892e8c6-cc3b-47a3-b9f1-c3253548dc11 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:08.985098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892e8c6-cc3b-47a3-b9f1-c3253548dc11 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:08.985381 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892e8c6-cc3b-47a3-b9f1-c3253548dc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:09.002429 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239cadd-2462-4f0c-9449-4c0df7df2ea0 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:09.002605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-4892e8c6-cc3b-47a3-b9f1-c3253548dc11 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:09.003651 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-4892e8c6-cc3b-47a3-b9f1-c3253548dc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:09.031680 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:09.088371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 152/298] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:09.110615 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892e8c6-cc3b-47a3-b9f1-c3253548dc11 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:09.139525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239cadd-2462-4f0c-9449-4c0df7df2ea0 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:09.176486 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c1da9-aba6-4239-a30d-7bb43134b13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:09.177406 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c1da9-aba6-4239-a30d-7bb43134b13d None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:09.177762 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c1da9-aba6-4239-a30d-7bb43134b13d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:09.178114 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c1da9-aba6-4239-a30d-7bb43134b13d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:09.188960 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c1da9-aba6-4239-a30d-7bb43134b13d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:09.197364 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-ed3c1da9-aba6-4239-a30d-7bb43134b13d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 09:59:09.197364 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:09.197364 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:09.197364 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:09.197364 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:09.197364 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:09.197364 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:09.197364 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:09.197364 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:09.197364 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:09.197364 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:09.197364 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:09.197364 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:09.197364 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:09.197364 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:09.197364 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:09.198257 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:09.198257 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:09.198257 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:09.198257 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:09.198257 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:09.198257 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:09.198257 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:09.198257 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:09.198257 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:09.198257 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:09.198257 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:09.198257 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:09.198257 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:09.198257 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:09.198257 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:09.198257 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:09.199180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:09.199180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:09.199180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:09.199180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:09.199180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:09.199180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:09.199180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:09.199180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:09.199180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:09.199180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:09.199180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 09:59:09.199180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:09.199180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 147/299] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:59:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 09:59:09.210868 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c1da9-aba6-4239-a30d-7bb43134b13d None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:09.230218 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892e8c6-cc3b-47a3-b9f1-c3253548dc11 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:09.268731 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee3a84-6eda-476c-9613-32b4c36792f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:09.269949 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee3a84-6eda-476c-9613-32b4c36792f9 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:09.270521 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee3a84-6eda-476c-9613-32b4c36792f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:09.270805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee3a84-6eda-476c-9613-32b4c36792f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:09.271987 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee3a84-6eda-476c-9613-32b4c36792f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:09.273615 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee3a84-6eda-476c-9613-32b4c36792f9 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:09.280579 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 153/300] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:09.281434 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:09.282765 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee3a84-6eda-476c-9613-32b4c36792f9 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:09.312442 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:09.334310 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c1da9-aba6-4239-a30d-7bb43134b13d None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:09.385014 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a24270-58b0-434c-a831-f59fcc83eb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:09.385971 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a24270-58b0-434c-a831-f59fcc83eb03 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:09.386411 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a24270-58b0-434c-a831-f59fcc83eb03 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:09.387301 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a24270-58b0-434c-a831-f59fcc83eb03 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:09.388209 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a24270-58b0-434c-a831-f59fcc83eb03 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:09.388940 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a24270-58b0-434c-a831-f59fcc83eb03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:09.390955 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a24270-58b0-434c-a831-f59fcc83eb03 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:09.401524 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee3a84-6eda-476c-9613-32b4c36792f9 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:09.402051 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 148/301] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 22 09:59:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:09.408927 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a24270-58b0-434c-a831-f59fcc83eb03 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:09.441634 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5a6d9-ec47-4dc5-8a5a-f97453a4bc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:09.442468 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5a6d9-ec47-4dc5-8a5a-f97453a4bc09 None admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:09.442850 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5a6d9-ec47-4dc5-8a5a-f97453a4bc09 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:09.443239 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5a6d9-ec47-4dc5-8a5a-f97453a4bc09 None admin] PATH_INFO: `/v3/groups` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:09.444071 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5a6d9-ec47-4dc5-8a5a-f97453a4bc09 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:09.445637 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5a6d9-ec47-4dc5-8a5a-f97453a4bc09 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:09.524705 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 154/302] 10.222.0.46 () {60 vars in 1134 bytes} [Wed Jun 22 09:59:09 2022] POST /identity/v3/groups => generated 229 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:59:09.533147 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a24270-58b0-434c-a831-f59fcc83eb03 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:09.557060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:09.574354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781858c-4e07-49f1-8e3f-47bd33b3e056 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:09.574662 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781858c-4e07-49f1-8e3f-47bd33b3e056 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:09.574919 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781858c-4e07-49f1-8e3f-47bd33b3e056 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:09.576638 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 155/303] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 09:59:09.580733 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159c2b8-a1c1-4f57-bb20-4af3d5387fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:09.581755 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159c2b8-a1c1-4f57-bb20-4af3d5387fbc None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:09.582138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159c2b8-a1c1-4f57-bb20-4af3d5387fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:09.582420 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159c2b8-a1c1-4f57-bb20-4af3d5387fbc None admin] PATH_INFO: `/v3/users/af4422cd7a924dd08cf56629fd1c979b` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:09.583509 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc8552-e210-4a35-9bf1-719e2c3e01ab None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:09.583908 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc8552-e210-4a35-9bf1-719e2c3e01ab None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:09.584293 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc8552-e210-4a35-9bf1-719e2c3e01ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:09.599124 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159c2b8-a1c1-4f57-bb20-4af3d5387fbc None admin] RBAC: Authorizing `identity:get_user(user_id=af4422cd7a924dd08cf56629fd1c979b)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:09.600885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159c2b8-a1c1-4f57-bb20-4af3d5387fbc None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:09.602199 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-86dc8552-e210-4a35-9bf1-719e2c3e01ab None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:09.603572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 149/304] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:59:09 2022] GET /identity/v3/users/af4422cd7a924dd08cf56629fd1c979b => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:09.603695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-86dc8552-e210-4a35-9bf1-719e2c3e01ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:09.610259 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159c2b8-a1c1-4f57-bb20-4af3d5387fbc None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:09.690844 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 156/305] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:09.713462 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc8552-e210-4a35-9bf1-719e2c3e01ab None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:09.724531 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159c2b8-a1c1-4f57-bb20-4af3d5387fbc None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:09.734966 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:09.768020 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c88c6-420c-4102-869f-e25846d206e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:09.768683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c88c6-420c-4102-869f-e25846d206e6 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:09.769013 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c88c6-420c-4102-869f-e25846d206e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:09.769296 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c88c6-420c-4102-869f-e25846d206e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:09.771410 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c88c6-420c-4102-869f-e25846d206e6 None admin] RBAC: Adding query filter params (role.id=e744213e97f341cd862b25d2c45af211, user.id=af4422cd7a924dd08cf56629fd1c979b, scope.system=all) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:09.771410 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c88c6-420c-4102-869f-e25846d206e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:09.772315 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c88c6-420c-4102-869f-e25846d206e6 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:09.780922 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 150/306] 10.222.0.46 () {56 vars in 1308 bytes} [Wed Jun 22 09:59:09 2022] GET /identity/v3/role_assignments?user.id=af4422cd7a924dd08cf56629fd1c979b&scope.system=all&role.id=e744213e97f341cd862b25d2c45af211 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:09.836586 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc8552-e210-4a35-9bf1-719e2c3e01ab None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:09.884528 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec836da-33d5-41b0-be57-090cebecf196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:09.885767 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec836da-33d5-41b0-be57-090cebecf196 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:09.886282 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec836da-33d5-41b0-be57-090cebecf196 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:09.886759 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec836da-33d5-41b0-be57-090cebecf196 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:09.899503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec836da-33d5-41b0-be57-090cebecf196 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:09.908069 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-fec836da-33d5-41b0-be57-090cebecf196 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:59:09.908069 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:09.908069 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:09.908069 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:09.908069 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:09.908069 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:09.908069 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:09.908069 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:09.908069 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:09.908069 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:09.908069 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:09.908069 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:09.908069 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:09.908069 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:09.908069 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:09.908069 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:09.909066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:09.909066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:09.909066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:09.909066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:09.909066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:09.909066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:09.909066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:09.909066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:09.909066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:09.909066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:09.909066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:09.909066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:09.909066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:09.909066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:09.909066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:09.909066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:09.910021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:09.910021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:09.910021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:09.910021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:09.910021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:09.910021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:09.910021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:09.910021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:09.910021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:09.910021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:09.910021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:59:09.910021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:09.912192 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 157/307] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:59:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:09.919229 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c88c6-420c-4102-869f-e25846d206e6 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:09.962392 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:10.030356 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c88c6-420c-4102-869f-e25846d206e6 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:10.066708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b76ef-4a70-48a0-ae73-c82362224935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:10.067701 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b76ef-4a70-48a0-ae73-c82362224935 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:10.068140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b76ef-4a70-48a0-ae73-c82362224935 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:10.068563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b76ef-4a70-48a0-ae73-c82362224935 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:10.069511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b76ef-4a70-48a0-ae73-c82362224935 None admin] RBAC: Adding query filter params (name=member) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:10.069964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b76ef-4a70-48a0-ae73-c82362224935 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:10.071511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b76ef-4a70-48a0-ae73-c82362224935 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:10.080893 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 151/308] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 22 09:59:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:10.086794 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec836da-33d5-41b0-be57-090cebecf196 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:10.179876 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:10.203934 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec836da-33d5-41b0-be57-090cebecf196 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:10.251474 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2011f-b962-45e7-8a67-9210200e99b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:10.252371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2011f-b962-45e7-8a67-9210200e99b0 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:10.252654 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2011f-b962-45e7-8a67-9210200e99b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:10.252960 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2011f-b962-45e7-8a67-9210200e99b0 None admin] PATH_INFO: `/v3/users/1b52e2ad9a1549d096d54e2b99cc3b9f` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:10.254193 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2011f-b962-45e7-8a67-9210200e99b0 None admin] RBAC: Authorizing `identity:get_user(user_id=1b52e2ad9a1549d096d54e2b99cc3b9f)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:10.255644 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2011f-b962-45e7-8a67-9210200e99b0 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:10.257698 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 158/309] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:59:10 2022] GET /identity/v3/users/1b52e2ad9a1549d096d54e2b99cc3b9f => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:10.263126 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b76ef-4a70-48a0-ae73-c82362224935 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:10.318946 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d75e4-c52f-43c0-9053-4547fd7936a7 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:10.319249 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d75e4-c52f-43c0-9053-4547fd7936a7 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:10.319439 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d75e4-c52f-43c0-9053-4547fd7936a7 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:10.321148 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 159/310] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:10.328543 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11872990-7cdb-473a-8988-a1d3bcefc181 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:10.329028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11872990-7cdb-473a-8988-a1d3bcefc181 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:10.329495 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11872990-7cdb-473a-8988-a1d3bcefc181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:10.348499 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-11872990-7cdb-473a-8988-a1d3bcefc181 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:10.349918 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-11872990-7cdb-473a-8988-a1d3bcefc181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:10.380933 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:10.385661 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b76ef-4a70-48a0-ae73-c82362224935 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:10.431278 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96ec7d-3851-4aaa-afef-d413693febf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:10.432552 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96ec7d-3851-4aaa-afef-d413693febf9 None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:10.433362 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96ec7d-3851-4aaa-afef-d413693febf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:10.433791 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96ec7d-3851-4aaa-afef-d413693febf9 None admin] PATH_INFO: `/v3/system/users/1b52e2ad9a1549d096d54e2b99cc3b9f/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:10.435922 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96ec7d-3851-4aaa-afef-d413693febf9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1b52e2ad9a1549d096d54e2b99cc3b9f, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:10.438103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96ec7d-3851-4aaa-afef-d413693febf9 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:10.444804 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 160/311] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:10.469480 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11872990-7cdb-473a-8988-a1d3bcefc181 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:10.533643 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 152/312] 10.222.0.46 () {58 vars in 1334 bytes} [Wed Jun 22 09:59:10 2022] PUT /identity/v3/system/users/1b52e2ad9a1549d096d54e2b99cc3b9f/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:59:10.555770 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:10.586232 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11872990-7cdb-473a-8988-a1d3bcefc181 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:10.627118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2dc51-96fb-4200-b903-586d89f7cabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:10.627995 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2dc51-96fb-4200-b903-586d89f7cabb None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:10.628280 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2dc51-96fb-4200-b903-586d89f7cabb None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:10.628549 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2dc51-96fb-4200-b903-586d89f7cabb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:10.641186 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2dc51-96fb-4200-b903-586d89f7cabb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:10.649234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-0dd2dc51-96fb-4200-b903-586d89f7cabb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 09:59:10.649234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:10.649234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:10.649234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:10.649234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:10.649234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:10.649234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:10.649234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:10.649234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:10.649234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:10.649234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:10.649234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:10.649234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:10.649234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:10.649234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:10.649234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:10.650752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:10.650752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:10.650752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:10.650752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:10.650752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:10.650752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:10.650752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:10.650752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:10.650752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:10.650752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:10.650752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:10.650752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:10.650752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:10.650752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:10.650752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:10.650752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:10.651535 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:10.651535 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:10.651535 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:10.651535 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:10.651535 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:10.651535 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:10.651535 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:10.651535 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:10.651535 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:10.651535 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:10.651535 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 09:59:10.651535 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:10.651535 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 161/313] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:59:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 09:59:10.658038 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96ec7d-3851-4aaa-afef-d413693febf9 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:10.771127 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96ec7d-3851-4aaa-afef-d413693febf9 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:10.809208 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082dc122-4520-4550-afd0-c5da4ac7ca15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:10.809892 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dc122-4520-4550-afd0-c5da4ac7ca15 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:10.810179 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dc122-4520-4550-afd0-c5da4ac7ca15 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:10.810458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dc122-4520-4550-afd0-c5da4ac7ca15 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:10.811224 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082dc122-4520-4550-afd0-c5da4ac7ca15 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:10.811536 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082dc122-4520-4550-afd0-c5da4ac7ca15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:10.812946 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082dc122-4520-4550-afd0-c5da4ac7ca15 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:10.822635 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 153/314] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 22 09:59:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:10.827826 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2dc51-96fb-4200-b903-586d89f7cabb None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:10.934821 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2dc51-96fb-4200-b903-586d89f7cabb None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:10.970243 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7dd50-e310-45a7-a729-8e87b0a7e097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:10.971508 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7dd50-e310-45a7-a729-8e87b0a7e097 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:10.971986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7dd50-e310-45a7-a729-8e87b0a7e097 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:10.972452 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7dd50-e310-45a7-a729-8e87b0a7e097 None admin] PATH_INFO: `/v3/users/8e78bc843cd94cc58adbc3e37ab57ca7` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:10.973910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7dd50-e310-45a7-a729-8e87b0a7e097 None admin] RBAC: Authorizing `identity:get_user(user_id=8e78bc843cd94cc58adbc3e37ab57ca7)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:10.975565 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7dd50-e310-45a7-a729-8e87b0a7e097 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:10.977751 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 162/315] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:59:10 2022] GET /identity/v3/users/8e78bc843cd94cc58adbc3e37ab57ca7 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:10.988877 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082dc122-4520-4550-afd0-c5da4ac7ca15 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:11.014646 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:11.094184 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082dc122-4520-4550-afd0-c5da4ac7ca15 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:11.129222 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8ee68-6c5e-43c9-9cda-1077c384a62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:11.129924 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8ee68-6c5e-43c9-9cda-1077c384a62a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:11.130810 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8ee68-6c5e-43c9-9cda-1077c384a62a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:11.131125 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8ee68-6c5e-43c9-9cda-1077c384a62a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:11.203613 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf8ee68-6c5e-43c9-9cda-1077c384a62a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:11.205037 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf8ee68-6c5e-43c9-9cda-1077c384a62a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:11.231149 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:11.310107 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 154/316] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:59:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 09:59:11.315612 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7dd50-e310-45a7-a729-8e87b0a7e097 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:11.319466 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:11.422322 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7dd50-e310-45a7-a729-8e87b0a7e097 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:11.457526 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21be0d-b5f4-4f5d-8f2e-6703f176b732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:11.459001 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21be0d-b5f4-4f5d-8f2e-6703f176b732 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:11.459478 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21be0d-b5f4-4f5d-8f2e-6703f176b732 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:11.459944 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21be0d-b5f4-4f5d-8f2e-6703f176b732 None admin] PATH_INFO: `/v3/projects/8935dc925ceb4fbc8b07442a34045d82` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:11.461432 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21be0d-b5f4-4f5d-8f2e-6703f176b732 None admin] RBAC: Authorizing `identity:get_project(project_id=8935dc925ceb4fbc8b07442a34045d82)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:11.463200 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21be0d-b5f4-4f5d-8f2e-6703f176b732 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:11.465448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 163/317] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:59:11 2022] GET /identity/v3/projects/8935dc925ceb4fbc8b07442a34045d82 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:11.473038 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8ee68-6c5e-43c9-9cda-1077c384a62a None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:11.577487 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8ee68-6c5e-43c9-9cda-1077c384a62a None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:11.601533 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:11.612071 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e377d3e-47e7-4c5f-8eac-fe88bfce3ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:11.618988 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e377d3e-47e7-4c5f-8eac-fe88bfce3ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:11.618988 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e377d3e-47e7-4c5f-8eac-fe88bfce3ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:11.618988 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e377d3e-47e7-4c5f-8eac-fe88bfce3ab1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:11.618988 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e377d3e-47e7-4c5f-8eac-fe88bfce3ab1 None admin] RBAC: Adding query filter params (role.id=e744213e97f341cd862b25d2c45af211, scope.project.id=8935dc925ceb4fbc8b07442a34045d82, user.id=8e78bc843cd94cc58adbc3e37ab57ca7) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:11.618988 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e377d3e-47e7-4c5f-8eac-fe88bfce3ab1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:11.618988 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e377d3e-47e7-4c5f-8eac-fe88bfce3ab1 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:11.623090 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 155/318] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 09:59:11 2022] GET /identity/v3/role_assignments?user.id=8e78bc843cd94cc58adbc3e37ab57ca7&scope.project.id=8935dc925ceb4fbc8b07442a34045d82&role.id=e744213e97f341cd862b25d2c45af211 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:11.779438 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf3d39-7976-4462-b0ce-fa7b90f9175c None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:11.779733 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf3d39-7976-4462-b0ce-fa7b90f9175c None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:11.779911 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf3d39-7976-4462-b0ce-fa7b90f9175c None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:11.781472 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 164/319] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:11.786546 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae29278-bb4f-49f7-b21e-d5d44ecc681f None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:11.786833 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae29278-bb4f-49f7-b21e-d5d44ecc681f None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:11.787110 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae29278-bb4f-49f7-b21e-d5d44ecc681f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:11.804533 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-8ae29278-bb4f-49f7-b21e-d5d44ecc681f None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:11.805819 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-8ae29278-bb4f-49f7-b21e-d5d44ecc681f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:11.881417 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 156/320] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:11.905073 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf3d39-7976-4462-b0ce-fa7b90f9175c None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:11.982489 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:12.000180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bbb81-51d5-475a-a5ac-6d7de8d8c238 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:12.000724 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bbb81-51d5-475a-a5ac-6d7de8d8c238 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:12.000724 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bbb81-51d5-475a-a5ac-6d7de8d8c238 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:12.002695 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 157/321] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:12.008326 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fe0d7-024f-453e-8d8c-7adcdfbef9fd None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:12.008663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fe0d7-024f-453e-8d8c-7adcdfbef9fd None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:12.008977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fe0d7-024f-453e-8d8c-7adcdfbef9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:12.016681 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf3d39-7976-4462-b0ce-fa7b90f9175c None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:12.028078 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-505fe0d7-024f-453e-8d8c-7adcdfbef9fd None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:12.029304 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-505fe0d7-024f-453e-8d8c-7adcdfbef9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:12.051841 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cfa68-fd95-4d3a-8306-98406c7f971c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:12.053239 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cfa68-fd95-4d3a-8306-98406c7f971c None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:12.054092 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cfa68-fd95-4d3a-8306-98406c7f971c None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:12.054801 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cfa68-fd95-4d3a-8306-98406c7f971c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:12.057068 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1cfa68-fd95-4d3a-8306-98406c7f971c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:12.059337 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1cfa68-fd95-4d3a-8306-98406c7f971c None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:12.061512 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 165/322] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:12.067004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cfa68-fd95-4d3a-8306-98406c7f971c None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:12.104963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 158/323] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:12.126981 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505fe0d7-024f-453e-8d8c-7adcdfbef9fd None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:12.169958 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cfa68-fd95-4d3a-8306-98406c7f971c None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:12.178880 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:12.203321 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4199423-4578-4bf2-8f59-f4bdb377aae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:12.203947 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4199423-4578-4bf2-8f59-f4bdb377aae9 None admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:12.204231 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4199423-4578-4bf2-8f59-f4bdb377aae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:12.204510 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4199423-4578-4bf2-8f59-f4bdb377aae9 None admin] PATH_INFO: `/v3/groups` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:12.205240 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4199423-4578-4bf2-8f59-f4bdb377aae9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:12.206682 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4199423-4578-4bf2-8f59-f4bdb377aae9 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:12.229117 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505fe0d7-024f-453e-8d8c-7adcdfbef9fd None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:12.261465 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a371c43-8067-4d56-979a-ff4d3a833161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:12.262261 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a371c43-8067-4d56-979a-ff4d3a833161 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:12.262545 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a371c43-8067-4d56-979a-ff4d3a833161 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:12.262818 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a371c43-8067-4d56-979a-ff4d3a833161 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:12.272687 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a371c43-8067-4d56-979a-ff4d3a833161 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:12.280895 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-0a371c43-8067-4d56-979a-ff4d3a833161 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 09:59:12.280895 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:12.280895 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:12.280895 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:12.280895 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:12.280895 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:12.280895 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:12.280895 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:12.280895 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:12.280895 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:12.280895 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:12.280895 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:12.280895 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:12.280895 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:12.280895 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:12.280895 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:12.282028 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:12.282028 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:12.282028 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:12.282028 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:12.282028 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:12.282028 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:12.282028 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:12.282028 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:12.282028 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:12.282028 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:12.282028 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:12.282028 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:12.282028 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:12.282028 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:12.282028 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:12.282028 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:12.282994 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:12.282994 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:12.282994 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:12.282994 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:12.282994 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:12.282994 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:12.282994 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:12.282994 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:12.282994 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:12.282994 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:12.282994 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 09:59:12.282994 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:12.282994 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 159/324] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:59:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 09:59:12.288231 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a371c43-8067-4d56-979a-ff4d3a833161 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:12.384251 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a371c43-8067-4d56-979a-ff4d3a833161 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:12.414332 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:12.419491 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 166/325] 10.222.0.46 () {60 vars in 1134 bytes} [Wed Jun 22 09:59:12 2022] POST /identity/v3/groups => generated 226 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:59:12.425523 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92eb614-8b06-4ca9-bb50-7298891cc997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:12.425523 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92eb614-8b06-4ca9-bb50-7298891cc997 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:12.425523 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92eb614-8b06-4ca9-bb50-7298891cc997 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:12.425965 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92eb614-8b06-4ca9-bb50-7298891cc997 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:12.426896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92eb614-8b06-4ca9-bb50-7298891cc997 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:12.427209 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92eb614-8b06-4ca9-bb50-7298891cc997 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:12.428741 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92eb614-8b06-4ca9-bb50-7298891cc997 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:12.438226 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 160/326] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 22 09:59:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:12.443983 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4199423-4578-4bf2-8f59-f4bdb377aae9 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:12.458838 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:12.556834 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4199423-4578-4bf2-8f59-f4bdb377aae9 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:12.595463 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1376b6c-a71f-4af6-ae47-29d07d171053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:12.596337 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1376b6c-a71f-4af6-ae47-29d07d171053 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:12.596618 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1376b6c-a71f-4af6-ae47-29d07d171053 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:12.597046 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1376b6c-a71f-4af6-ae47-29d07d171053 None admin] PATH_INFO: `/v3/users/af4422cd7a924dd08cf56629fd1c979b` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:12.598367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1376b6c-a71f-4af6-ae47-29d07d171053 None admin] RBAC: Authorizing `identity:get_user(user_id=af4422cd7a924dd08cf56629fd1c979b)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:12.599823 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1376b6c-a71f-4af6-ae47-29d07d171053 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:12.601804 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 167/327] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:59:12 2022] GET /identity/v3/users/af4422cd7a924dd08cf56629fd1c979b => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:12.607368 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92eb614-8b06-4ca9-bb50-7298891cc997 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:12.651258 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c48dcc-7524-4168-a3f3-e936dfd7d0e6 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:12.651544 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c48dcc-7524-4168-a3f3-e936dfd7d0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:12.651746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c48dcc-7524-4168-a3f3-e936dfd7d0e6 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:12.654795 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 168/328] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 09:59:12.658917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9a788-ee0d-4ec6-883b-3708b1288ddf None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:12.659204 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9a788-ee0d-4ec6-883b-3708b1288ddf None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:12.659482 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9a788-ee0d-4ec6-883b-3708b1288ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:12.683085 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-99d9a788-ee0d-4ec6-883b-3708b1288ddf None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:12.684303 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-99d9a788-ee0d-4ec6-883b-3708b1288ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:12.746084 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92eb614-8b06-4ca9-bb50-7298891cc997 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:12.767275 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:12.779992 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 169/329] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 09:59:12.801249 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9a788-ee0d-4ec6-883b-3708b1288ddf None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:12.805419 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72785dd-3004-440f-af65-865a5f881abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:12.807149 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72785dd-3004-440f-af65-865a5f881abe None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:12.807444 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72785dd-3004-440f-af65-865a5f881abe None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:12.807716 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72785dd-3004-440f-af65-865a5f881abe None admin] PATH_INFO: `/v3/system/users/af4422cd7a924dd08cf56629fd1c979b/roles/e744213e97f341cd862b25d2c45af211` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:12.810043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72785dd-3004-440f-af65-865a5f881abe None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=af4422cd7a924dd08cf56629fd1c979b, role_id=e744213e97f341cd862b25d2c45af211)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:12.811917 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72785dd-3004-440f-af65-865a5f881abe None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:12.887803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 161/330] 10.222.0.46 () {58 vars in 1334 bytes} [Wed Jun 22 09:59:12 2022] PUT /identity/v3/system/users/af4422cd7a924dd08cf56629fd1c979b/roles/e744213e97f341cd862b25d2c45af211 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:59:12.927662 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9a788-ee0d-4ec6-883b-3708b1288ddf None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:12.974211 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aab226-0541-47c7-aa96-e6597b5a2f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:12.975489 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aab226-0541-47c7-aa96-e6597b5a2f6e None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:12.976044 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aab226-0541-47c7-aa96-e6597b5a2f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:12.976598 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aab226-0541-47c7-aa96-e6597b5a2f6e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:12.990021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aab226-0541-47c7-aa96-e6597b5a2f6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:12.999295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-f6aab226-0541-47c7-aa96-e6597b5a2f6e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:59:12.999295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:12.999295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:12.999295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:12.999295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:12.999295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:12.999295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:12.999295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:12.999295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:12.999295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:12.999295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:12.999295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:12.999295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:12.999295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:12.999295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:12.999295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:13.000252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:13.000252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:13.000252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:13.000252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:13.000252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:13.000252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:13.000252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:13.000252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:13.000252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:13.000252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:13.000252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:13.000252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:13.000252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:13.000252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:13.000252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:13.000252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:13.001098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:13.001098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:13.001098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:13.001098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:13.001098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:13.001098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:13.001098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:13.001098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:13.001098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:13.001098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:13.001098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:59:13.001098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:13.003687 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 170/331] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:59:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 09:59:13.010552 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72785dd-3004-440f-af65-865a5f881abe None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:13.056313 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:13.133830 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72785dd-3004-440f-af65-865a5f881abe None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:13.181608 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320483b-0a42-4f76-aa98-a1bd84d7a69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:13.182271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320483b-0a42-4f76-aa98-a1bd84d7a69d None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:13.182559 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320483b-0a42-4f76-aa98-a1bd84d7a69d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:13.182837 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320483b-0a42-4f76-aa98-a1bd84d7a69d None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:13.183604 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320483b-0a42-4f76-aa98-a1bd84d7a69d None admin] RBAC: Adding query filter params (name=member) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:13.183918 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320483b-0a42-4f76-aa98-a1bd84d7a69d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:13.185349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320483b-0a42-4f76-aa98-a1bd84d7a69d None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:13.194596 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 162/332] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 22 09:59:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:13.200939 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aab226-0541-47c7-aa96-e6597b5a2f6e None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:13.280610 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:13.338271 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aab226-0541-47c7-aa96-e6597b5a2f6e None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:13.386508 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237d2a7-8194-48a0-aee0-ce536091753d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:13.387808 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237d2a7-8194-48a0-aee0-ce536091753d None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:13.388302 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237d2a7-8194-48a0-aee0-ce536091753d None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:13.388775 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237d2a7-8194-48a0-aee0-ce536091753d None admin] PATH_INFO: `/v3/users/1b52e2ad9a1549d096d54e2b99cc3b9f` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:13.393560 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237d2a7-8194-48a0-aee0-ce536091753d None admin] RBAC: Authorizing `identity:get_user(user_id=1b52e2ad9a1549d096d54e2b99cc3b9f)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:13.395286 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237d2a7-8194-48a0-aee0-ce536091753d None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:13.397224 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 171/333] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:59:13 2022] GET /identity/v3/users/1b52e2ad9a1549d096d54e2b99cc3b9f => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:13.403905 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320483b-0a42-4f76-aa98-a1bd84d7a69d None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:13.543322 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:13.550612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320483b-0a42-4f76-aa98-a1bd84d7a69d None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:13.603774 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14284663-e029-4e64-82ab-b6873334cf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:13.604453 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14284663-e029-4e64-82ab-b6873334cf4f None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:13.604737 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14284663-e029-4e64-82ab-b6873334cf4f None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:13.605039 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14284663-e029-4e64-82ab-b6873334cf4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:13.605893 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14284663-e029-4e64-82ab-b6873334cf4f None admin] RBAC: Adding query filter params (role.id=b8f82737ef614907a0d320c6e1f2facf, user.id=1b52e2ad9a1549d096d54e2b99cc3b9f, scope.system=all) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:13.606207 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14284663-e029-4e64-82ab-b6873334cf4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:13.607651 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14284663-e029-4e64-82ab-b6873334cf4f None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:13.620199 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 163/334] 10.222.0.46 () {56 vars in 1308 bytes} [Wed Jun 22 09:59:13 2022] GET /identity/v3/role_assignments?user.id=1b52e2ad9a1549d096d54e2b99cc3b9f&scope.system=all&role.id=b8f82737ef614907a0d320c6e1f2facf => generated 510 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:15.128682 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb97bca-51f3-4d79-bd12-29e94df94bac None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:15.129282 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb97bca-51f3-4d79-bd12-29e94df94bac None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:15.129282 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb97bca-51f3-4d79-bd12-29e94df94bac None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:15.130945 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 172/335] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:15.135230 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d4115-2602-4698-89c8-da20ade5a162 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:15.135628 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d4115-2602-4698-89c8-da20ade5a162 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:15.135827 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d4115-2602-4698-89c8-da20ade5a162 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:15.138418 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f99d0d-34ff-4c0b-be23-2320ad655d8e None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:15.138708 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f99d0d-34ff-4c0b-be23-2320ad655d8e None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:15.138983 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f99d0d-34ff-4c0b-be23-2320ad655d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:15.140569 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 164/336] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:15.150436 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a63a6-cccd-4ef3-b9a5-59c6add8e1ee None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:15.150712 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a63a6-cccd-4ef3-b9a5-59c6add8e1ee None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:15.151232 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a63a6-cccd-4ef3-b9a5-59c6add8e1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:15.179657 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-761a63a6-cccd-4ef3-b9a5-59c6add8e1ee None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:15.180936 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-761a63a6-cccd-4ef3-b9a5-59c6add8e1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:15.183926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-b8f99d0d-34ff-4c0b-be23-2320ad655d8e None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:15.185132 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-b8f99d0d-34ff-4c0b-be23-2320ad655d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:15.308749 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 173/337] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:15.309291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 165/338] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 09:59:15.333671 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f99d0d-34ff-4c0b-be23-2320ad655d8e None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:15.350482 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a63a6-cccd-4ef3-b9a5-59c6add8e1ee None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:15.431553 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:15.497569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f99d0d-34ff-4c0b-be23-2320ad655d8e None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:15.514304 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:15.536670 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a63a6-cccd-4ef3-b9a5-59c6add8e1ee None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:15.574521 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d6d8f-9766-48f7-8273-cb3f625872f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:15.575851 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d6d8f-9766-48f7-8273-cb3f625872f1 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:15.576624 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d6d8f-9766-48f7-8273-cb3f625872f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:15.577006 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d6d8f-9766-48f7-8273-cb3f625872f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:15.586889 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9830c-027a-4fc3-91be-e0e702ff7930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:15.588027 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9830c-027a-4fc3-91be-e0e702ff7930 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:15.588435 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9830c-027a-4fc3-91be-e0e702ff7930 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:15.589112 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9830c-027a-4fc3-91be-e0e702ff7930 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:15.596599 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d6d8f-9766-48f7-8273-cb3f625872f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:15.606920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-453d6d8f-9766-48f7-8273-cb3f625872f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:59:15.606920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:15.606920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:15.606920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:15.606920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:15.606920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:15.606920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:15.606920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:15.606920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:15.606920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:15.606920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:15.606920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:15.606920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:15.606920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:15.606920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:15.606920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:15.607821 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:15.607821 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:15.607821 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:15.607821 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:15.607821 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:15.607821 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:15.607821 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:15.607821 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:15.607821 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:15.607821 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:15.607821 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:15.607821 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:15.607821 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:15.607821 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:15.607821 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:15.607821 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:15.608595 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:15.608595 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:15.608595 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:15.608595 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:15.608595 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:15.608595 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:15.608595 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:15.608595 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:15.608595 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:15.608595 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:15.608595 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:59:15.608595 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:15.608595 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 174/339] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:59:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:15.609886 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf0ab6-8982-4e24-9766-0958074de047 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:15.609886 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf0ab6-8982-4e24-9766-0958074de047 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:15.610174 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf0ab6-8982-4e24-9766-0958074de047 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:15.611383 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 175/340] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:15.611888 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c9830c-027a-4fc3-91be-e0e702ff7930 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:15.614125 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf0ab6-8982-4e24-9766-0958074de047 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:15.622532 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-a4c9830c-027a-4fc3-91be-e0e702ff7930 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 09:59:15.622532 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:15.622532 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:15.622532 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:15.622532 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:15.622532 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:15.622532 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:15.622532 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:15.622532 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:15.622532 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:15.622532 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:15.622532 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:15.622532 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:15.622532 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:15.622532 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:15.622532 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:15.624600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:15.624600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:15.624600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:15.624600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:15.624600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:15.624600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:15.624600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:15.624600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:15.624600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:15.624600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:15.624600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:15.624600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:15.624600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:15.624600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:15.624600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:15.624600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:15.626513 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:15.626513 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:15.626513 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:15.626513 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:15.626513 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:15.626513 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:15.626513 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:15.626513 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:15.626513 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:15.626513 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:15.626513 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 09:59:15.626513 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:15.626513 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 166/341] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 22 09:59:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 09:59:15.626513 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb144c-4400-4766-9bab-9060a67982c3 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:15.628119 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb144c-4400-4766-9bab-9060a67982c3 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:15.628119 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb144c-4400-4766-9bab-9060a67982c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:15.652044 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-abdb144c-4400-4766-9bab-9060a67982c3 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:15.653738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-abdb144c-4400-4766-9bab-9060a67982c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:15.761732 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf0ab6-8982-4e24-9766-0958074de047 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:15.764452 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 167/342] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:15.765452 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb144c-4400-4766-9bab-9060a67982c3 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:15.784484 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:15.807836 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74bd87-bdd8-49da-9b7c-036495c8d112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:15.808520 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74bd87-bdd8-49da-9b7c-036495c8d112 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:15.808804 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74bd87-bdd8-49da-9b7c-036495c8d112 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:15.809105 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74bd87-bdd8-49da-9b7c-036495c8d112 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:15.809874 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74bd87-bdd8-49da-9b7c-036495c8d112 None admin] RBAC: Adding query filter params (name=member) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:15.810182 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74bd87-bdd8-49da-9b7c-036495c8d112 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:15.811567 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74bd87-bdd8-49da-9b7c-036495c8d112 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:15.823398 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 176/343] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 22 09:59:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:15.824258 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74bd87-bdd8-49da-9b7c-036495c8d112 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:15.859969 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:15.887803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb144c-4400-4766-9bab-9060a67982c3 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:15.926954 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208307d-4ed0-4b69-8452-a6444ab3b0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:15.927712 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208307d-4ed0-4b69-8452-a6444ab3b0ee None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:15.927988 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208307d-4ed0-4b69-8452-a6444ab3b0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:15.928294 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208307d-4ed0-4b69-8452-a6444ab3b0ee None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:15.929172 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208307d-4ed0-4b69-8452-a6444ab3b0ee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:15.929483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208307d-4ed0-4b69-8452-a6444ab3b0ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:15.930978 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208307d-4ed0-4b69-8452-a6444ab3b0ee None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:15.937413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74bd87-bdd8-49da-9b7c-036495c8d112 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:15.940273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 168/344] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 09:59:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:15.941240 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208307d-4ed0-4b69-8452-a6444ab3b0ee None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:15.975427 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a03883-38ab-42bb-90ab-220f214868c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:15.976234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a03883-38ab-42bb-90ab-220f214868c1 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:15.976520 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a03883-38ab-42bb-90ab-220f214868c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:15.976793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a03883-38ab-42bb-90ab-220f214868c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:15.988827 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a03883-38ab-42bb-90ab-220f214868c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:15.997451 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-77a03883-38ab-42bb-90ab-220f214868c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:59:15.997451 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:15.997451 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:15.997451 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:15.997451 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:15.997451 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:15.997451 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:15.997451 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:15.997451 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:15.997451 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:15.997451 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:15.997451 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:15.997451 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:15.997451 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:15.997451 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:15.997451 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:15.998368 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:15.998368 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:15.998368 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:15.998368 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:15.998368 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:15.998368 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:15.998368 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:15.998368 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:15.998368 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:15.998368 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:15.998368 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:15.998368 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:15.998368 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:15.998368 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:15.998368 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:15.998368 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:15.999235 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:15.999235 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:15.999235 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:15.999235 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:15.999235 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:15.999235 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:15.999235 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:15.999235 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:15.999235 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:15.999235 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:15.999235 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:59:15.999235 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:15.999235 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 177/345] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:59:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:15.999889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a03883-38ab-42bb-90ab-220f214868c1 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:16.045536 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:16.068136 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208307d-4ed0-4b69-8452-a6444ab3b0ee None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:16.104110 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f79b6-7eac-4734-958c-d4732259e66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:16.104773 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f79b6-7eac-4734-958c-d4732259e66b None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:16.105099 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f79b6-7eac-4734-958c-d4732259e66b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:16.105377 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f79b6-7eac-4734-958c-d4732259e66b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:16.109333 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:16.109898 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a03883-38ab-42bb-90ab-220f214868c1 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:16.143999 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f143b-1c8b-47dd-9e33-61443a0a487e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:16.144765 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f143b-1c8b-47dd-9e33-61443a0a487e None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:16.144971 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f143b-1c8b-47dd-9e33-61443a0a487e None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:16.145223 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f143b-1c8b-47dd-9e33-61443a0a487e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:16.177553 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f79b6-7eac-4734-958c-d4732259e66b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:16.179090 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f79b6-7eac-4734-958c-d4732259e66b None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:16.219659 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f143b-1c8b-47dd-9e33-61443a0a487e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:16.221158 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f143b-1c8b-47dd-9e33-61443a0a487e None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:16.267313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:16.319308 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 169/346] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:59:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 09:59:16.321427 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f79b6-7eac-4734-958c-d4732259e66b None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:16.330503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 178/347] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:59:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 09:59:16.331356 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f143b-1c8b-47dd-9e33-61443a0a487e None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:16.374115 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:16.443869 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f143b-1c8b-47dd-9e33-61443a0a487e None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:16.460478 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f79b6-7eac-4734-958c-d4732259e66b None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:16.497182 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0aec9-6f92-48ca-978e-947c81ae67f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:16.498062 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0aec9-6f92-48ca-978e-947c81ae67f6 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:16.498354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0aec9-6f92-48ca-978e-947c81ae67f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:16.498635 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0aec9-6f92-48ca-978e-947c81ae67f6 None admin] PATH_INFO: `/v3/projects/f040c41677374080a6ee1538a7a34a54` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:16.499962 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0aec9-6f92-48ca-978e-947c81ae67f6 None admin] RBAC: Authorizing `identity:get_project(project_id=f040c41677374080a6ee1538a7a34a54)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:16.501550 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0aec9-6f92-48ca-978e-947c81ae67f6 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:16.504062 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 179/348] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:59:16 2022] GET /identity/v3/projects/f040c41677374080a6ee1538a7a34a54 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:16.505088 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0aec9-6f92-48ca-978e-947c81ae67f6 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:16.508525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa6294-0951-4d6c-b884-0a7476530f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:16.511051 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa6294-0951-4d6c-b884-0a7476530f6c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:16.511344 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa6294-0951-4d6c-b884-0a7476530f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:16.511628 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa6294-0951-4d6c-b884-0a7476530f6c None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:16.512409 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa6294-0951-4d6c-b884-0a7476530f6c None admin] RBAC: Adding query filter params (name=member) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:16.512800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa6294-0951-4d6c-b884-0a7476530f6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:16.514224 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa6294-0951-4d6c-b884-0a7476530f6c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:16.517134 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:16.527487 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 170/349] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 22 09:59:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:16.529291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebda2b-e9d8-4d3a-b353-4577eed61878 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:16.529609 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebda2b-e9d8-4d3a-b353-4577eed61878 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:16.529894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebda2b-e9d8-4d3a-b353-4577eed61878 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:16.531645 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 171/350] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:16.533627 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebda2b-e9d8-4d3a-b353-4577eed61878 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:16.629924 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0aec9-6f92-48ca-978e-947c81ae67f6 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:16.672461 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:16.686516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebda2b-e9d8-4d3a-b353-4577eed61878 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:16.686704 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d0af8-3556-4e56-a0ab-a1832b0a5531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:16.686704 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d0af8-3556-4e56-a0ab-a1832b0a5531 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:16.686704 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d0af8-3556-4e56-a0ab-a1832b0a5531 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:16.686704 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d0af8-3556-4e56-a0ab-a1832b0a5531 None admin] PATH_INFO: `/v3/projects/f040c41677374080a6ee1538a7a34a54` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:16.687044 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d0af8-3556-4e56-a0ab-a1832b0a5531 None admin] RBAC: Authorizing `identity:get_project(project_id=f040c41677374080a6ee1538a7a34a54)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:16.688020 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d0af8-3556-4e56-a0ab-a1832b0a5531 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:16.690603 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 180/351] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:59:16 2022] GET /identity/v3/projects/f040c41677374080a6ee1538a7a34a54 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:16.692622 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d0af8-3556-4e56-a0ab-a1832b0a5531 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:16.729579 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3949e-77fb-4538-aa68-ad7124856f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:16.730687 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3949e-77fb-4538-aa68-ad7124856f65 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:16.731116 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3949e-77fb-4538-aa68-ad7124856f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:16.731533 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3949e-77fb-4538-aa68-ad7124856f65 None admin] PATH_INFO: `/v3/groups/0377f4b9ea65468a843c3044b6c2dfce` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:16.738521 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac3949e-77fb-4538-aa68-ad7124856f65 None admin] RBAC: Authorizing `identity:get_group(group_id=0377f4b9ea65468a843c3044b6c2dfce)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:16.740343 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac3949e-77fb-4538-aa68-ad7124856f65 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:16.742894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 172/352] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Jun 22 09:59:16 2022] GET /identity/v3/groups/0377f4b9ea65468a843c3044b6c2dfce => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:16.745094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13e534-3c29-4afe-b539-c176dee2a189 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:16.745691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13e534-3c29-4afe-b539-c176dee2a189 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:16.746209 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13e534-3c29-4afe-b539-c176dee2a189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:16.767477 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-2b13e534-3c29-4afe-b539-c176dee2a189 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:16.769131 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-2b13e534-3c29-4afe-b539-c176dee2a189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:16.777853 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:16.806261 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d0af8-3556-4e56-a0ab-a1832b0a5531 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:16.844030 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b1d34-c4ea-444a-9f38-04710cf5a238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:16.844857 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b1d34-c4ea-444a-9f38-04710cf5a238 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:16.845152 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b1d34-c4ea-444a-9f38-04710cf5a238 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:16.845781 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b1d34-c4ea-444a-9f38-04710cf5a238 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:16.846806 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 173/353] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:16.848240 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13e534-3c29-4afe-b539-c176dee2a189 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:16.937080 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b1d34-c4ea-444a-9f38-04710cf5a238 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:16.938673 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b1d34-c4ea-444a-9f38-04710cf5a238 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:16.970171 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:16.982266 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13e534-3c29-4afe-b539-c176dee2a189 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:17.023789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:17.027401 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61d865-cf9f-42be-be04-c50abe6000a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:17.028283 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61d865-cf9f-42be-be04-c50abe6000a7 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:17.028567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61d865-cf9f-42be-be04-c50abe6000a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:17.028868 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61d865-cf9f-42be-be04-c50abe6000a7 None admin] PATH_INFO: `/v3/groups/0377f4b9ea65468a843c3044b6c2dfce` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:17.030799 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61d865-cf9f-42be-be04-c50abe6000a7 None admin] RBAC: Authorizing `identity:get_group(group_id=0377f4b9ea65468a843c3044b6c2dfce)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:17.032266 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61d865-cf9f-42be-be04-c50abe6000a7 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:17.034154 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 174/354] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Jun 22 09:59:16 2022] GET /identity/v3/groups/0377f4b9ea65468a843c3044b6c2dfce => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:17.034841 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61d865-cf9f-42be-be04-c50abe6000a7 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:17.063249 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 181/355] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:59:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 09:59:17.064729 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b1d34-c4ea-444a-9f38-04710cf5a238 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:17.173567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61d865-cf9f-42be-be04-c50abe6000a7 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:17.203105 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b1d34-c4ea-444a-9f38-04710cf5a238 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:17.219533 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592df677-06ec-4458-881c-e3ec217fbbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:17.220025 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592df677-06ec-4458-881c-e3ec217fbbf7 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:17.220631 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592df677-06ec-4458-881c-e3ec217fbbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:17.220631 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592df677-06ec-4458-881c-e3ec217fbbf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:17.221423 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592df677-06ec-4458-881c-e3ec217fbbf7 None admin] RBAC: Adding query filter params (group.id=0377f4b9ea65468a843c3044b6c2dfce, role.id=b8f82737ef614907a0d320c6e1f2facf, scope.project.id=f040c41677374080a6ee1538a7a34a54) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:17.221667 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592df677-06ec-4458-881c-e3ec217fbbf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:17.223151 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592df677-06ec-4458-881c-e3ec217fbbf7 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:17.230616 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 175/356] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Jun 22 09:59:17 2022] GET /identity/v3/role_assignments?group.id=0377f4b9ea65468a843c3044b6c2dfce&scope.project.id=f040c41677374080a6ee1538a7a34a54&role.id=b8f82737ef614907a0d320c6e1f2facf => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:17.231901 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317b9d2-69e8-4521-9d44-e8e39a6653e3 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:17.232110 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317b9d2-69e8-4521-9d44-e8e39a6653e3 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:17.232391 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317b9d2-69e8-4521-9d44-e8e39a6653e3 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:17.233879 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 176/357] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:17.234466 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317b9d2-69e8-4521-9d44-e8e39a6653e3 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:17.255197 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154f791-d6ac-4ceb-b58b-b3b3681a09d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:17.256722 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154f791-d6ac-4ceb-b58b-b3b3681a09d7 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:17.257048 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154f791-d6ac-4ceb-b58b-b3b3681a09d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:17.257339 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154f791-d6ac-4ceb-b58b-b3b3681a09d7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:17.265185 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:17.275291 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154f791-d6ac-4ceb-b58b-b3b3681a09d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:17.285922 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-2154f791-d6ac-4ceb-b58b-b3b3681a09d7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 09:59:17.285922 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:17.285922 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:17.285922 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:17.285922 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:17.285922 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:17.285922 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:17.285922 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:17.285922 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:17.285922 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:17.285922 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:17.285922 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:17.285922 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:17.285922 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:17.285922 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:17.285922 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:17.287176 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:17.287176 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:17.287176 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:17.287176 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:17.287176 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:17.287176 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:17.287176 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:17.287176 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:17.287176 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:17.287176 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:17.287176 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:17.287176 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:17.287176 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:17.287176 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:17.287176 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:17.287176 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:17.288164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:17.288164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:17.288164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:17.288164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:17.288164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:17.288164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:17.288164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:17.288164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:17.288164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:17.288164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:17.288164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 09:59:17.288164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:17.290930 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 182/358] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:59:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:17.291693 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154f791-d6ac-4ceb-b58b-b3b3681a09d7 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:17.349632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:17.366384 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317b9d2-69e8-4521-9d44-e8e39a6653e3 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:17.409936 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd4a83-2670-4b1f-a5aa-06d7baf995f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:17.410608 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd4a83-2670-4b1f-a5aa-06d7baf995f3 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:17.410896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd4a83-2670-4b1f-a5aa-06d7baf995f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:17.411171 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd4a83-2670-4b1f-a5aa-06d7baf995f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:17.412181 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd4a83-2670-4b1f-a5aa-06d7baf995f3 None admin] RBAC: Adding query filter params (group.id=0377f4b9ea65468a843c3044b6c2dfce, role.id=7783830649d941ea9507439a113fc5d9, scope.project.id=f040c41677374080a6ee1538a7a34a54) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:17.412449 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd4a83-2670-4b1f-a5aa-06d7baf995f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:17.414949 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd4a83-2670-4b1f-a5aa-06d7baf995f3 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:17.423076 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 177/359] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Jun 22 09:59:17 2022] GET /identity/v3/role_assignments?group.id=0377f4b9ea65468a843c3044b6c2dfce&scope.project.id=f040c41677374080a6ee1538a7a34a54&role.id=7783830649d941ea9507439a113fc5d9 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:17.424287 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa6521-38cc-4f20-a339-a9be451a2889 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:17.424580 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa6521-38cc-4f20-a339-a9be451a2889 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:17.424895 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa6521-38cc-4f20-a339-a9be451a2889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:17.434581 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154f791-d6ac-4ceb-b58b-b3b3681a09d7 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:17.447651 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-88aa6521-38cc-4f20-a339-a9be451a2889 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:17.448900 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-88aa6521-38cc-4f20-a339-a9be451a2889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:17.480373 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a65ef5-6cfc-4a3a-a228-3221281bcc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:17.481373 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a65ef5-6cfc-4a3a-a228-3221281bcc39 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:17.481662 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a65ef5-6cfc-4a3a-a228-3221281bcc39 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:17.482344 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a65ef5-6cfc-4a3a-a228-3221281bcc39 None admin] PATH_INFO: `/v3/projects/8935dc925ceb4fbc8b07442a34045d82` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:17.483896 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a65ef5-6cfc-4a3a-a228-3221281bcc39 None admin] RBAC: Authorizing `identity:get_project(project_id=8935dc925ceb4fbc8b07442a34045d82)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:17.486234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a65ef5-6cfc-4a3a-a228-3221281bcc39 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:17.488727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 183/360] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:59:17 2022] GET /identity/v3/projects/8935dc925ceb4fbc8b07442a34045d82 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:17.489865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a65ef5-6cfc-4a3a-a228-3221281bcc39 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:17.574058 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 178/361] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:17.574764 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa6521-38cc-4f20-a339-a9be451a2889 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:17.616880 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a65ef5-6cfc-4a3a-a228-3221281bcc39 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:17.617731 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:17.637174 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:17.659649 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cd3a8-19d5-4e67-a7fc-44115a501114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:17.660317 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cd3a8-19d5-4e67-a7fc-44115a501114 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:17.660601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cd3a8-19d5-4e67-a7fc-44115a501114 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:17.660909 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cd3a8-19d5-4e67-a7fc-44115a501114 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:17.664126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946cd3a8-19d5-4e67-a7fc-44115a501114 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:17.664126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946cd3a8-19d5-4e67-a7fc-44115a501114 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:17.664126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946cd3a8-19d5-4e67-a7fc-44115a501114 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:17.673130 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 184/362] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 22 09:59:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:17.674098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cd3a8-19d5-4e67-a7fc-44115a501114 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:17.761574 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa6521-38cc-4f20-a339-a9be451a2889 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:17.792316 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cd3a8-19d5-4e67-a7fc-44115a501114 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:17.822244 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0270e8-a7d0-4fc2-b8c9-0517888df56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:17.822665 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0270e8-a7d0-4fc2-b8c9-0517888df56a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:17.822945 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0270e8-a7d0-4fc2-b8c9-0517888df56a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:17.823217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0270e8-a7d0-4fc2-b8c9-0517888df56a None admin] PATH_INFO: `/v3/groups/0377f4b9ea65468a843c3044b6c2dfce` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:17.824971 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0270e8-a7d0-4fc2-b8c9-0517888df56a None admin] RBAC: Authorizing `identity:get_group(group_id=0377f4b9ea65468a843c3044b6c2dfce)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:17.826761 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0270e8-a7d0-4fc2-b8c9-0517888df56a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:17.829159 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 179/363] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Jun 22 09:59:17 2022] GET /identity/v3/groups/0377f4b9ea65468a843c3044b6c2dfce => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:17.832841 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0270e8-a7d0-4fc2-b8c9-0517888df56a None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:17.848721 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b443189-d348-4e25-8483-2a251ad6f751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:17.849922 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b443189-d348-4e25-8483-2a251ad6f751 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:17.850576 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b443189-d348-4e25-8483-2a251ad6f751 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:17.851453 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b443189-d348-4e25-8483-2a251ad6f751 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:17.865802 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b443189-d348-4e25-8483-2a251ad6f751 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:17.877356 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-6b443189-d348-4e25-8483-2a251ad6f751 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 09:59:17.877356 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:17.877356 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:17.877356 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:17.877356 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:17.877356 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:17.877356 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:17.877356 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:17.877356 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:17.877356 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:17.877356 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:17.877356 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:17.877356 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:17.877356 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:17.877356 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:17.877356 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:17.878246 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:17.878246 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:17.878246 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:17.878246 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:17.878246 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:17.878246 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:17.878246 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:17.878246 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:17.878246 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:17.878246 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:17.878246 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:17.878246 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:17.878246 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:17.878246 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:17.878246 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:17.878246 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:17.879021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:17.879021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:17.879021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:17.879021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:17.879021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:17.879021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:17.879021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:17.879021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:17.879021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:17.879021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:17.879021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 09:59:17.879021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:17.881851 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 185/364] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 22 09:59:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:17.883374 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d76cf-d0d8-46fc-8f39-0e50f187074c None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:17.884457 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d76cf-d0d8-46fc-8f39-0e50f187074c None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:17.884982 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d76cf-d0d8-46fc-8f39-0e50f187074c None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:17.887188 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 186/365] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:17.888442 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d76cf-d0d8-46fc-8f39-0e50f187074c None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:17.922478 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:17.939939 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:17.957270 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0270e8-a7d0-4fc2-b8c9-0517888df56a None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:17.994562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d7211-f12f-4545-b7df-10ef225d1a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:17.995442 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d7211-f12f-4545-b7df-10ef225d1a7a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:17.995730 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d7211-f12f-4545-b7df-10ef225d1a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:17.996006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d7211-f12f-4545-b7df-10ef225d1a7a None admin] PATH_INFO: `/v3/users/af4422cd7a924dd08cf56629fd1c979b` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:17.997287 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d7211-f12f-4545-b7df-10ef225d1a7a None admin] RBAC: Authorizing `identity:get_user(user_id=af4422cd7a924dd08cf56629fd1c979b)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:17.998726 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d7211-f12f-4545-b7df-10ef225d1a7a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:18.000688 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 180/366] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 09:59:17 2022] GET /identity/v3/users/af4422cd7a924dd08cf56629fd1c979b => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:18.001637 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d7211-f12f-4545-b7df-10ef225d1a7a None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:18.008247 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d76cf-d0d8-46fc-8f39-0e50f187074c None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:18.044621 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f9096-0bdc-43af-ba4c-feee80ff558c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:18.045321 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f9096-0bdc-43af-ba4c-feee80ff558c None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:18.045609 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f9096-0bdc-43af-ba4c-feee80ff558c None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:18.045890 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f9096-0bdc-43af-ba4c-feee80ff558c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:18.046738 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f9096-0bdc-43af-ba4c-feee80ff558c None admin] RBAC: Adding query filter params (group.id=0377f4b9ea65468a843c3044b6c2dfce, role.id=b8f82737ef614907a0d320c6e1f2facf, scope.project.id=8935dc925ceb4fbc8b07442a34045d82) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:18.047057 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f9096-0bdc-43af-ba4c-feee80ff558c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:18.048506 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f9096-0bdc-43af-ba4c-feee80ff558c None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:18.055024 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 187/367] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Jun 22 09:59:17 2022] GET /identity/v3/role_assignments?group.id=0377f4b9ea65468a843c3044b6c2dfce&scope.project.id=8935dc925ceb4fbc8b07442a34045d82&role.id=b8f82737ef614907a0d320c6e1f2facf => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:18.056463 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3060da5-1c71-4bf8-a1bf-b679617ac0d8 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:18.056755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3060da5-1c71-4bf8-a1bf-b679617ac0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:18.057060 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3060da5-1c71-4bf8-a1bf-b679617ac0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:18.122590 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-d3060da5-1c71-4bf8-a1bf-b679617ac0d8 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:18.123644 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d7211-f12f-4545-b7df-10ef225d1a7a None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:18.124344 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-d3060da5-1c71-4bf8-a1bf-b679617ac0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:18.164532 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210aec0-2aac-4e21-af90-b2f7439e15bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:18.165348 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210aec0-2aac-4e21-af90-b2f7439e15bc None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:18.165645 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210aec0-2aac-4e21-af90-b2f7439e15bc None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:18.165930 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210aec0-2aac-4e21-af90-b2f7439e15bc None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:18.166711 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210aec0-2aac-4e21-af90-b2f7439e15bc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:18.167027 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210aec0-2aac-4e21-af90-b2f7439e15bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:18.168464 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210aec0-2aac-4e21-af90-b2f7439e15bc None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:18.178166 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 181/368] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 09:59:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:18.179182 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210aec0-2aac-4e21-af90-b2f7439e15bc None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:18.217286 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:18.321774 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210aec0-2aac-4e21-af90-b2f7439e15bc None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:18.324946 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 188/369] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:18.325922 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3060da5-1c71-4bf8-a1bf-b679617ac0d8 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:18.364705 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:18.406080 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ae390-540e-4b2d-9be8-d159a01fb0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:18.407136 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ae390-540e-4b2d-9be8-d159a01fb0eb None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:18.407644 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ae390-540e-4b2d-9be8-d159a01fb0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:18.408132 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ae390-540e-4b2d-9be8-d159a01fb0eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:18.409239 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ae390-540e-4b2d-9be8-d159a01fb0eb None admin] RBAC: Adding query filter params (role.id=e744213e97f341cd862b25d2c45af211, user.id=af4422cd7a924dd08cf56629fd1c979b, scope.system=all) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:18.409788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ae390-540e-4b2d-9be8-d159a01fb0eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:18.411329 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ae390-540e-4b2d-9be8-d159a01fb0eb None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:18.426269 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 182/370] 10.222.0.46 () {56 vars in 1308 bytes} [Wed Jun 22 09:59:18 2022] GET /identity/v3/role_assignments?user.id=af4422cd7a924dd08cf56629fd1c979b&scope.system=all&role.id=e744213e97f341cd862b25d2c45af211 => generated 510 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:18.427219 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ae390-540e-4b2d-9be8-d159a01fb0eb None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:18.510255 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3060da5-1c71-4bf8-a1bf-b679617ac0d8 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:18.564304 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:18.597876 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ae390-540e-4b2d-9be8-d159a01fb0eb None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:18.614632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff1bcc-5869-4491-bcfd-49fb54be3939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:18.615634 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff1bcc-5869-4491-bcfd-49fb54be3939 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:18.616114 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff1bcc-5869-4491-bcfd-49fb54be3939 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:18.616860 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff1bcc-5869-4491-bcfd-49fb54be3939 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:18.648695 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf134a-4ae6-43d0-99e2-f1c7e21c520e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:18.649570 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf134a-4ae6-43d0-99e2-f1c7e21c520e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:18.649852 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf134a-4ae6-43d0-99e2-f1c7e21c520e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:18.650127 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf134a-4ae6-43d0-99e2-f1c7e21c520e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:18.672131 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf134a-4ae6-43d0-99e2-f1c7e21c520e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:18.690235 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-c6cf134a-4ae6-43d0-99e2-f1c7e21c520e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 09:59:18.690235 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:18.690235 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:18.690235 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:18.690235 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:18.690235 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:18.690235 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:18.690235 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:18.690235 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:18.690235 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:18.690235 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:18.690235 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:18.690235 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:18.690235 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:18.690235 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:18.690235 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:18.691262 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:18.691262 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:18.691262 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:18.691262 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:18.691262 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:18.691262 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:18.691262 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:18.691262 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:18.691262 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:18.691262 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:18.691262 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:18.691262 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:18.691262 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:18.691262 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:18.691262 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:18.691262 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:18.692026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:18.692026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:18.692026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:18.692026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:18.692026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:18.692026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:18.692026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:18.692026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:18.692026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:18.692026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:18.692026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 09:59:18.692026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:18.694506 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 183/371] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 09:59:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:18.700955 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf134a-4ae6-43d0-99e2-f1c7e21c520e None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:18.743748 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff1bcc-5869-4491-bcfd-49fb54be3939 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:18.745680 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff1bcc-5869-4491-bcfd-49fb54be3939 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:18.809244 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:18.815820 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf134a-4ae6-43d0-99e2-f1c7e21c520e None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:18.853495 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c5253-cbe6-44f3-a00f-8530bdb9f85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:18.854526 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c5253-cbe6-44f3-a00f-8530bdb9f85c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:18.855002 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c5253-cbe6-44f3-a00f-8530bdb9f85c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:18.855466 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c5253-cbe6-44f3-a00f-8530bdb9f85c None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:18.856409 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c5253-cbe6-44f3-a00f-8530bdb9f85c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:18.856937 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c5253-cbe6-44f3-a00f-8530bdb9f85c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:18.858557 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c5253-cbe6-44f3-a00f-8530bdb9f85c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:18.860439 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:18.862812 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 189/372] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:59:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 09:59:18.868883 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff1bcc-5869-4491-bcfd-49fb54be3939 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:18.872249 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 184/373] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:59:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:18.882256 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c5253-cbe6-44f3-a00f-8530bdb9f85c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:18.985715 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff1bcc-5869-4491-bcfd-49fb54be3939 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:18.990765 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c5253-cbe6-44f3-a00f-8530bdb9f85c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:19.014505 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:19.046722 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ad59e-796c-4ed3-9695-360de6380991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:19.048320 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ad59e-796c-4ed3-9695-360de6380991 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:19.048798 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ad59e-796c-4ed3-9695-360de6380991 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:19.051004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ad59e-796c-4ed3-9695-360de6380991 None admin] PATH_INFO: `/v3/projects/8935dc925ceb4fbc8b07442a34045d82` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:19.052344 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ad59e-796c-4ed3-9695-360de6380991 None admin] RBAC: Authorizing `identity:get_project(project_id=8935dc925ceb4fbc8b07442a34045d82)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:19.053191 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e44a94-cc29-4185-9de0-18535635484f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:19.053886 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ad59e-796c-4ed3-9695-360de6380991 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:19.054311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e44a94-cc29-4185-9de0-18535635484f None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:19.054780 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e44a94-cc29-4185-9de0-18535635484f None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:19.055329 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e44a94-cc29-4185-9de0-18535635484f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:19.056786 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 190/374] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:59:18 2022] GET /identity/v3/projects/8935dc925ceb4fbc8b07442a34045d82 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:19.063750 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ad59e-796c-4ed3-9695-360de6380991 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:19.143044 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:19.154361 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e44a94-cc29-4185-9de0-18535635484f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:19.156133 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e44a94-cc29-4185-9de0-18535635484f None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:19.211164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ad59e-796c-4ed3-9695-360de6380991 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:19.255362 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058cb98b-b41e-445e-be99-17531c2993d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:19.256579 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cb98b-b41e-445e-be99-17531c2993d7 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:19.257072 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cb98b-b41e-445e-be99-17531c2993d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:19.257620 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cb98b-b41e-445e-be99-17531c2993d7 None admin] PATH_INFO: `/v3/groups/0377f4b9ea65468a843c3044b6c2dfce` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:19.259159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058cb98b-b41e-445e-be99-17531c2993d7 None admin] RBAC: Authorizing `identity:get_group(group_id=0377f4b9ea65468a843c3044b6c2dfce)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:19.260961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058cb98b-b41e-445e-be99-17531c2993d7 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:19.263235 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 191/375] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Jun 22 09:59:19 2022] GET /identity/v3/groups/0377f4b9ea65468a843c3044b6c2dfce => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:19.282366 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 185/376] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:59:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 09:59:19.284268 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058cb98b-b41e-445e-be99-17531c2993d7 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:19.287556 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e44a94-cc29-4185-9de0-18535635484f None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:19.403123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:19.452804 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:19.459307 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e44a94-cc29-4185-9de0-18535635484f None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:19.496709 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058cb98b-b41e-445e-be99-17531c2993d7 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:19.506354 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bf69f-d267-4ebf-ad8f-cd26a2e966bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:19.507279 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bf69f-d267-4ebf-ad8f-cd26a2e966bd None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:19.507565 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bf69f-d267-4ebf-ad8f-cd26a2e966bd None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:19.507840 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bf69f-d267-4ebf-ad8f-cd26a2e966bd None admin] PATH_INFO: `/v3/projects/40e8688682434d2c9756b8751cda6e48` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:19.511966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526bf69f-d267-4ebf-ad8f-cd26a2e966bd None admin] RBAC: Authorizing `identity:get_project(project_id=40e8688682434d2c9756b8751cda6e48)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:19.513627 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526bf69f-d267-4ebf-ad8f-cd26a2e966bd None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:19.520875 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 186/377] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:59:19 2022] GET /identity/v3/projects/40e8688682434d2c9756b8751cda6e48 => generated 344 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:19.521588 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bf69f-d267-4ebf-ad8f-cd26a2e966bd None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:19.585554 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57208e3f-5033-4aa8-bc3b-eeb33714db85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:19.587087 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57208e3f-5033-4aa8-bc3b-eeb33714db85 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:19.587555 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57208e3f-5033-4aa8-bc3b-eeb33714db85 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:19.588014 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57208e3f-5033-4aa8-bc3b-eeb33714db85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:19.589091 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57208e3f-5033-4aa8-bc3b-eeb33714db85 None admin] RBAC: Adding query filter params (group.id=0377f4b9ea65468a843c3044b6c2dfce, role.id=7783830649d941ea9507439a113fc5d9, scope.project.id=8935dc925ceb4fbc8b07442a34045d82) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:19.589587 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57208e3f-5033-4aa8-bc3b-eeb33714db85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:19.591212 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57208e3f-5033-4aa8-bc3b-eeb33714db85 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:19.597845 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 192/378] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Jun 22 09:59:19 2022] GET /identity/v3/role_assignments?group.id=0377f4b9ea65468a843c3044b6c2dfce&scope.project.id=8935dc925ceb4fbc8b07442a34045d82&role.id=7783830649d941ea9507439a113fc5d9 => generated 260 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:19.646331 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bf69f-d267-4ebf-ad8f-cd26a2e966bd None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:19.688098 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c6d74-3205-4bc4-abee-ca7ad89baeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:19.689026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c6d74-3205-4bc4-abee-ca7ad89baeea None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:19.689312 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c6d74-3205-4bc4-abee-ca7ad89baeea None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:19.689590 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c6d74-3205-4bc4-abee-ca7ad89baeea None admin] PATH_INFO: `/v3/groups/e37d72658c1245e1b8df2543f61ab761` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:19.696303 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c6d74-3205-4bc4-abee-ca7ad89baeea None admin] RBAC: Authorizing `identity:get_group(group_id=e37d72658c1245e1b8df2543f61ab761)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:19.697874 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c6d74-3205-4bc4-abee-ca7ad89baeea None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:19.700038 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 187/379] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Jun 22 09:59:19 2022] GET /identity/v3/groups/e37d72658c1245e1b8df2543f61ab761 => generated 229 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:19.705616 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57208e3f-5033-4aa8-bc3b-eeb33714db85 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:19.847378 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57208e3f-5033-4aa8-bc3b-eeb33714db85 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:19.872523 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:19.890200 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e43a1-d579-48bc-993e-29e191df2a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:19.890926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e43a1-d579-48bc-993e-29e191df2a75 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:19.891213 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e43a1-d579-48bc-993e-29e191df2a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:19.891495 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e43a1-d579-48bc-993e-29e191df2a75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:19.892345 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e43a1-d579-48bc-993e-29e191df2a75 None admin] RBAC: Adding query filter params (group.id=e37d72658c1245e1b8df2543f61ab761, role.id=106aa464a69a49b09de7de5417083d3c, scope.project.id=40e8688682434d2c9756b8751cda6e48) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:19.892660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e43a1-d579-48bc-993e-29e191df2a75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:19.894132 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e43a1-d579-48bc-993e-29e191df2a75 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:19.901927 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 193/380] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Jun 22 09:59:19 2022] GET /identity/v3/role_assignments?group.id=e37d72658c1245e1b8df2543f61ab761&scope.project.id=40e8688682434d2c9756b8751cda6e48&role.id=106aa464a69a49b09de7de5417083d3c => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:20.199494 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566a364-d8a9-4124-ae20-359bcffe17ba None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:20.199891 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566a364-d8a9-4124-ae20-359bcffe17ba None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:20.200074 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566a364-d8a9-4124-ae20-359bcffe17ba None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:20.201784 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 188/381] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:20.207128 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070baf8-506a-49cf-8f31-3ea1ae37062d None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:20.207681 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070baf8-506a-49cf-8f31-3ea1ae37062d None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:20.207966 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070baf8-506a-49cf-8f31-3ea1ae37062d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:20.225911 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-4070baf8-506a-49cf-8f31-3ea1ae37062d None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:20.228165 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-4070baf8-506a-49cf-8f31-3ea1ae37062d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:20.254866 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207ba22-2fb8-467c-bcdd-1cc2284b50cc None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:20.255318 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207ba22-2fb8-467c-bcdd-1cc2284b50cc None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:20.255579 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207ba22-2fb8-467c-bcdd-1cc2284b50cc None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:20.257180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 189/382] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:20.262758 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81a22e-8d36-4779-b916-9eda1ef7b1be None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:20.263050 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81a22e-8d36-4779-b916-9eda1ef7b1be None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:20.263328 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81a22e-8d36-4779-b916-9eda1ef7b1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:20.282749 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-bc81a22e-8d36-4779-b916-9eda1ef7b1be None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:20.283990 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-bc81a22e-8d36-4779-b916-9eda1ef7b1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:20.315544 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 194/383] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:20.318532 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:20.363894 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070baf8-506a-49cf-8f31-3ea1ae37062d None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:20.378712 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 190/384] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 09:59:20.420307 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81a22e-8d36-4779-b916-9eda1ef7b1be None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:20.497732 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070baf8-506a-49cf-8f31-3ea1ae37062d None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:20.516888 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:20.548152 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d0bb9-1f7b-44fb-926b-29bc1f8976de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:20.549162 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d0bb9-1f7b-44fb-926b-29bc1f8976de None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:20.549520 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d0bb9-1f7b-44fb-926b-29bc1f8976de None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:20.549866 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d0bb9-1f7b-44fb-926b-29bc1f8976de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:20.560754 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d0bb9-1f7b-44fb-926b-29bc1f8976de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:20.569686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-548d0bb9-1f7b-44fb-926b-29bc1f8976de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 09:59:20.569686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:20.569686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:20.569686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:20.569686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:20.569686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:20.569686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:20.569686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:20.569686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:20.569686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:20.569686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:20.569686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:20.569686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:20.569686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:20.569686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:20.569686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:20.570624 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:20.570624 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:20.570624 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:20.570624 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:20.570624 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:20.570624 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:20.570624 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:20.570624 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:20.570624 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:20.570624 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:20.570624 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:20.570624 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:20.570624 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:20.570624 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:20.570624 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:20.570624 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:20.572333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:20.572333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:20.572333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:20.572333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:20.572333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:20.572333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:20.572333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:20.572333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:20.572333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:20.572333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:20.572333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 09:59:20.572333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:20.572333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 195/385] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 22 09:59:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:20.581219 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d0bb9-1f7b-44fb-926b-29bc1f8976de None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:20.637683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81a22e-8d36-4779-b916-9eda1ef7b1be None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:20.703520 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d0bb9-1f7b-44fb-926b-29bc1f8976de None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:20.721663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893049ee-8e21-44d1-937d-a0b67b028308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:20.722632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893049ee-8e21-44d1-937d-a0b67b028308 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:20.722913 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893049ee-8e21-44d1-937d-a0b67b028308 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:20.723188 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893049ee-8e21-44d1-937d-a0b67b028308 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:20.742013 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893049ee-8e21-44d1-937d-a0b67b028308 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:20.749070 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef3329-c243-433a-b3ba-8b37813b9f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:20.749692 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef3329-c243-433a-b3ba-8b37813b9f3d None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:20.749978 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef3329-c243-433a-b3ba-8b37813b9f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:20.750256 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef3329-c243-433a-b3ba-8b37813b9f3d None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:20.750457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-893049ee-8e21-44d1-937d-a0b67b028308 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:59:20.750457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:20.750457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:20.750457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:20.750457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:20.750457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:20.750457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:20.750457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:20.750457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:20.750457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:20.750457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:20.750457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:20.750457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:20.750457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:20.750457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:20.750457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:20.751324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:20.751324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:20.751324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:20.751324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:20.751324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:20.751324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:20.751324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:20.751324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:20.751324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:20.751324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:20.751324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:20.751324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:20.751324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:20.751324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:20.751324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:20.751324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:20.752090 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:20.752090 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:20.752090 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:20.752090 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:20.752090 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:20.752090 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:20.752090 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:20.752090 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:20.752090 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:20.752090 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:20.752090 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:59:20.752090 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:20.752673 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef3329-c243-433a-b3ba-8b37813b9f3d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:20.752673 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef3329-c243-433a-b3ba-8b37813b9f3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:20.752673 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef3329-c243-433a-b3ba-8b37813b9f3d None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:20.757261 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 191/386] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:59:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:20.762430 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 196/387] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 09:59:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:20.763250 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893049ee-8e21-44d1-937d-a0b67b028308 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:20.767694 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef3329-c243-433a-b3ba-8b37813b9f3d None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:20.797253 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:20.813714 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:20.898089 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef3329-c243-433a-b3ba-8b37813b9f3d None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:20.899824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893049ee-8e21-44d1-937d-a0b67b028308 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:20.940930 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212d999-efac-4e6b-8d22-f55bcb83e20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:20.941837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212d999-efac-4e6b-8d22-f55bcb83e20d None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:20.942227 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212d999-efac-4e6b-8d22-f55bcb83e20d None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:20.942617 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212d999-efac-4e6b-8d22-f55bcb83e20d None admin] PATH_INFO: `/v3/groups/0377f4b9ea65468a843c3044b6c2dfce` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:20.943567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d56ef-4a21-41d9-b54f-282f9a77a0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:20.943839 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212d999-efac-4e6b-8d22-f55bcb83e20d None admin] RBAC: Authorizing `identity:get_group(group_id=0377f4b9ea65468a843c3044b6c2dfce)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:20.944243 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d56ef-4a21-41d9-b54f-282f9a77a0ba None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:20.944530 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d56ef-4a21-41d9-b54f-282f9a77a0ba None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:20.944805 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d56ef-4a21-41d9-b54f-282f9a77a0ba None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:20.945360 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212d999-efac-4e6b-8d22-f55bcb83e20d None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:20.945615 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d56ef-4a21-41d9-b54f-282f9a77a0ba None admin] RBAC: Adding query filter params (name=member) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:20.945925 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d56ef-4a21-41d9-b54f-282f9a77a0ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:20.947050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 197/388] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Jun 22 09:59:20 2022] GET /identity/v3/groups/0377f4b9ea65468a843c3044b6c2dfce => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:20.947345 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d56ef-4a21-41d9-b54f-282f9a77a0ba None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:20.952862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212d999-efac-4e6b-8d22-f55bcb83e20d None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:20.960335 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 192/389] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 22 09:59:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:20.970229 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d56ef-4a21-41d9-b54f-282f9a77a0ba None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:21.077273 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212d999-efac-4e6b-8d22-f55bcb83e20d None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:21.089193 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:21.094761 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:21.121783 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19ecfd-e4f4-48ce-9570-765e44b23151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:21.123003 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19ecfd-e4f4-48ce-9570-765e44b23151 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:21.123297 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19ecfd-e4f4-48ce-9570-765e44b23151 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:21.123808 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19ecfd-e4f4-48ce-9570-765e44b23151 None admin] PATH_INFO: `/v3/projects/f040c41677374080a6ee1538a7a34a54` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:21.125178 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19ecfd-e4f4-48ce-9570-765e44b23151 None admin] RBAC: Authorizing `identity:get_project(project_id=f040c41677374080a6ee1538a7a34a54)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:21.127062 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19ecfd-e4f4-48ce-9570-765e44b23151 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:21.128840 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 198/390] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:59:20 2022] GET /identity/v3/projects/f040c41677374080a6ee1538a7a34a54 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:21.137930 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19ecfd-e4f4-48ce-9570-765e44b23151 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:21.146530 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d56ef-4a21-41d9-b54f-282f9a77a0ba None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:21.227954 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725b0f5-40ce-4902-b7b8-62a8a8f4d8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:21.228841 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725b0f5-40ce-4902-b7b8-62a8a8f4d8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:21.229129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725b0f5-40ce-4902-b7b8-62a8a8f4d8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:21.229409 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725b0f5-40ce-4902-b7b8-62a8a8f4d8f9 None admin] PATH_INFO: `/v3/groups/0377f4b9ea65468a843c3044b6c2dfce` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:21.238653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725b0f5-40ce-4902-b7b8-62a8a8f4d8f9 None admin] RBAC: Authorizing `identity:get_group(group_id=0377f4b9ea65468a843c3044b6c2dfce)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:21.240141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725b0f5-40ce-4902-b7b8-62a8a8f4d8f9 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:21.241902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 193/391] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Jun 22 09:59:20 2022] GET /identity/v3/groups/0377f4b9ea65468a843c3044b6c2dfce => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:21.247859 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725b0f5-40ce-4902-b7b8-62a8a8f4d8f9 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:21.297792 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19ecfd-e4f4-48ce-9570-765e44b23151 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:21.372545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b2c70-3971-4935-b44b-13124beb5350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:21.373385 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b2c70-3971-4935-b44b-13124beb5350 None admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:21.373667 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b2c70-3971-4935-b44b-13124beb5350 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:21.373941 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b2c70-3971-4935-b44b-13124beb5350 None admin] PATH_INFO: `/v3/projects/f040c41677374080a6ee1538a7a34a54/groups/0377f4b9ea65468a843c3044b6c2dfce/roles/7783830649d941ea9507439a113fc5d9` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:21.376433 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b2c70-3971-4935-b44b-13124beb5350 None admin] RBAC: Authorizing `identity:create_grant(project_id=f040c41677374080a6ee1538a7a34a54, group_id=0377f4b9ea65468a843c3044b6c2dfce, role_id=7783830649d941ea9507439a113fc5d9)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:21.377920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b2c70-3971-4935-b44b-13124beb5350 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:21.401292 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725b0f5-40ce-4902-b7b8-62a8a8f4d8f9 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:21.442629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2be3a0-2ad9-4bf5-9856-f8c409ed0f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:21.443585 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2be3a0-2ad9-4bf5-9856-f8c409ed0f80 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:21.443896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2be3a0-2ad9-4bf5-9856-f8c409ed0f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:21.444170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2be3a0-2ad9-4bf5-9856-f8c409ed0f80 None admin] PATH_INFO: `/v3/projects/f040c41677374080a6ee1538a7a34a54` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:21.445528 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2be3a0-2ad9-4bf5-9856-f8c409ed0f80 None admin] RBAC: Authorizing `identity:get_project(project_id=f040c41677374080a6ee1538a7a34a54)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:21.447025 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2be3a0-2ad9-4bf5-9856-f8c409ed0f80 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:21.449173 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 194/392] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:59:21 2022] GET /identity/v3/projects/f040c41677374080a6ee1538a7a34a54 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:21.450512 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054227f1-71fa-44ae-be79-382167925829 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:21.450802 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054227f1-71fa-44ae-be79-382167925829 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:21.451078 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054227f1-71fa-44ae-be79-382167925829 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:21.452689 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 195/393] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:21.457767 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054227f1-71fa-44ae-be79-382167925829 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:21.478249 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:21.486473 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 199/394] 10.222.0.46 () {58 vars in 1442 bytes} [Wed Jun 22 09:59:21 2022] PUT /identity/v3/projects/f040c41677374080a6ee1538a7a34a54/groups/0377f4b9ea65468a843c3044b6c2dfce/roles/7783830649d941ea9507439a113fc5d9 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:59:21.487921 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbbdf3-32f7-43c5-ad87-238e5a2bfc66 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:21.488298 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbbdf3-32f7-43c5-ad87-238e5a2bfc66 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:21.488750 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbbdf3-32f7-43c5-ad87-238e5a2bfc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:21.509197 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-2bdbbdf3-32f7-43c5-ad87-238e5a2bfc66 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:21.513120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-2bdbbdf3-32f7-43c5-ad87-238e5a2bfc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:21.544802 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:21.616562 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 200/395] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:21.625114 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054227f1-71fa-44ae-be79-382167925829 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:21.650099 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbbdf3-32f7-43c5-ad87-238e5a2bfc66 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:21.710402 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83803ecb-7b72-4f40-a9eb-41befc7ce3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:21.711393 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83803ecb-7b72-4f40-a9eb-41befc7ce3b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:21.712190 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83803ecb-7b72-4f40-a9eb-41befc7ce3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:21.712472 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83803ecb-7b72-4f40-a9eb-41befc7ce3b1 None admin] PATH_INFO: `/v3/projects/f040c41677374080a6ee1538a7a34a54/groups/0377f4b9ea65468a843c3044b6c2dfce/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:21.714694 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83803ecb-7b72-4f40-a9eb-41befc7ce3b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=f040c41677374080a6ee1538a7a34a54, group_id=0377f4b9ea65468a843c3044b6c2dfce, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:21.716180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83803ecb-7b72-4f40-a9eb-41befc7ce3b1 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:21.764580 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbbdf3-32f7-43c5-ad87-238e5a2bfc66 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:21.800935 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf6f0d-f82c-465e-ad73-091c28908d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:21.805118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf6f0d-f82c-465e-ad73-091c28908d41 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:21.805118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf6f0d-f82c-465e-ad73-091c28908d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:21.805118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf6f0d-f82c-465e-ad73-091c28908d41 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:21.813912 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf6f0d-f82c-465e-ad73-091c28908d41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:21.823424 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-14cf6f0d-f82c-465e-ad73-091c28908d41 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:59:21.823424 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:21.823424 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:21.823424 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:21.823424 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:21.823424 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:21.823424 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:21.823424 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:21.823424 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:21.823424 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:21.823424 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:21.823424 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:21.823424 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:21.823424 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:21.823424 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:21.823424 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:21.824633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:21.824633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:21.824633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:21.824633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:21.824633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:21.824633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:21.824633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:21.824633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:21.824633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:21.824633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:21.824633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:21.824633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:21.824633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:21.824633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:21.824633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:21.824633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:21.825466 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:21.825466 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:21.825466 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:21.825466 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:21.825466 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:21.825466 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:21.825466 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:21.825466 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:21.825466 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:21.825466 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:21.825466 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:59:21.825466 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:21.825466 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 201/396] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:59:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 09:59:21.831588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf6f0d-f82c-465e-ad73-091c28908d41 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:21.844602 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 196/397] 10.222.0.46 () {58 vars in 1442 bytes} [Wed Jun 22 09:59:21 2022] PUT /identity/v3/projects/f040c41677374080a6ee1538a7a34a54/groups/0377f4b9ea65468a843c3044b6c2dfce/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:59:21.866366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:21.952965 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf6f0d-f82c-465e-ad73-091c28908d41 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:21.990401 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb6891-1dce-40e0-84eb-6ac127dc50e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:21.991147 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb6891-1dce-40e0-84eb-6ac127dc50e7 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:21.991473 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb6891-1dce-40e0-84eb-6ac127dc50e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:21.991749 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb6891-1dce-40e0-84eb-6ac127dc50e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:21.993135 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb6891-1dce-40e0-84eb-6ac127dc50e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:21.993385 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb6891-1dce-40e0-84eb-6ac127dc50e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:21.994779 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb6891-1dce-40e0-84eb-6ac127dc50e7 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:22.004699 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 202/398] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 22 09:59:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:22.013163 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83803ecb-7b72-4f40-a9eb-41befc7ce3b1 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:22.102632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:22.127610 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83803ecb-7b72-4f40-a9eb-41befc7ce3b1 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:22.169616 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65926da-f39e-4258-8970-da2a8d07996e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:22.170471 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65926da-f39e-4258-8970-da2a8d07996e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:22.170746 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65926da-f39e-4258-8970-da2a8d07996e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:22.171013 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65926da-f39e-4258-8970-da2a8d07996e None admin] PATH_INFO: `/v3/groups/0377f4b9ea65468a843c3044b6c2dfce` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:22.172211 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65926da-f39e-4258-8970-da2a8d07996e None admin] RBAC: Authorizing `identity:get_group(group_id=0377f4b9ea65468a843c3044b6c2dfce)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:22.173689 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65926da-f39e-4258-8970-da2a8d07996e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:22.175306 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 197/399] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Jun 22 09:59:22 2022] GET /identity/v3/groups/0377f4b9ea65468a843c3044b6c2dfce => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:22.184993 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb6891-1dce-40e0-84eb-6ac127dc50e7 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:22.330234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:22.350032 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb6891-1dce-40e0-84eb-6ac127dc50e7 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:22.388908 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e07876-9149-44f4-9607-41941f5c345b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:22.389785 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e07876-9149-44f4-9607-41941f5c345b None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:22.390111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e07876-9149-44f4-9607-41941f5c345b None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:22.390382 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e07876-9149-44f4-9607-41941f5c345b None admin] PATH_INFO: `/v3/projects/8935dc925ceb4fbc8b07442a34045d82` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:22.391588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e07876-9149-44f4-9607-41941f5c345b None admin] RBAC: Authorizing `identity:get_project(project_id=8935dc925ceb4fbc8b07442a34045d82)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:22.394612 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e07876-9149-44f4-9607-41941f5c345b None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:22.396794 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 203/400] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:59:22 2022] GET /identity/v3/projects/8935dc925ceb4fbc8b07442a34045d82 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:22.402070 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65926da-f39e-4258-8970-da2a8d07996e None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:22.509271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65926da-f39e-4258-8970-da2a8d07996e None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:22.544673 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09451be5-0ffa-450a-817c-02940861dfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:22.545586 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09451be5-0ffa-450a-817c-02940861dfa4 None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:22.545860 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09451be5-0ffa-450a-817c-02940861dfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:22.546139 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09451be5-0ffa-450a-817c-02940861dfa4 None admin] PATH_INFO: `/v3/projects/8935dc925ceb4fbc8b07442a34045d82/groups/0377f4b9ea65468a843c3044b6c2dfce/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:22.548188 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09451be5-0ffa-450a-817c-02940861dfa4 None admin] RBAC: Authorizing `identity:create_grant(project_id=8935dc925ceb4fbc8b07442a34045d82, group_id=0377f4b9ea65468a843c3044b6c2dfce, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:22.549708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09451be5-0ffa-450a-817c-02940861dfa4 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:22.582748 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb60b76-156b-4c7b-93da-b1ef6b7ac8b4 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:22.583233 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb60b76-156b-4c7b-93da-b1ef6b7ac8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:22.583233 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb60b76-156b-4c7b-93da-b1ef6b7ac8b4 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:22.586024 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 204/401] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 09:59:22.591287 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dda7d-0e13-42ea-9b06-6973b6f9bacf None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:22.591581 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dda7d-0e13-42ea-9b06-6973b6f9bacf None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:22.591863 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dda7d-0e13-42ea-9b06-6973b6f9bacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:22.611681 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-a22dda7d-0e13-42ea-9b06-6973b6f9bacf None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:22.613154 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-a22dda7d-0e13-42ea-9b06-6973b6f9bacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:22.650843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 198/402] 10.222.0.46 () {58 vars in 1442 bytes} [Wed Jun 22 09:59:22 2022] PUT /identity/v3/projects/8935dc925ceb4fbc8b07442a34045d82/groups/0377f4b9ea65468a843c3044b6c2dfce/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:59:22.714041 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 205/403] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:22.749068 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09451be5-0ffa-450a-817c-02940861dfa4 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:22.753808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:22.902059 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09451be5-0ffa-450a-817c-02940861dfa4 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:22.909146 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971e78f-4c34-4781-b265-f5fdce00b67d None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:22.909447 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971e78f-4c34-4781-b265-f5fdce00b67d None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:22.909700 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971e78f-4c34-4781-b265-f5fdce00b67d None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:22.912510 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 206/404] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:22.917404 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56578007-7476-42b5-b26b-efad4d526020 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:22.917688 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56578007-7476-42b5-b26b-efad4d526020 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:22.917970 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56578007-7476-42b5-b26b-efad4d526020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:22.940868 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-56578007-7476-42b5-b26b-efad4d526020 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:22.942449 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-56578007-7476-42b5-b26b-efad4d526020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:22.949551 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f426696-76fa-49ea-b465-31959bfe122d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:22.950565 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f426696-76fa-49ea-b465-31959bfe122d None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:22.950851 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f426696-76fa-49ea-b465-31959bfe122d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:22.951128 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f426696-76fa-49ea-b465-31959bfe122d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:22.974514 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f426696-76fa-49ea-b465-31959bfe122d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:22.989708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-2f426696-76fa-49ea-b465-31959bfe122d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 09:59:22.989708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:22.989708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:22.989708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:22.989708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:22.989708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:22.989708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:22.989708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:22.989708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:22.989708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:22.989708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:22.989708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:22.989708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:22.989708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:22.989708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:22.989708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:22.990638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:22.990638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:22.990638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:22.990638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:22.990638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:22.990638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:22.990638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:22.990638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:22.990638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:22.990638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:22.990638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:22.990638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:22.990638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:22.990638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:22.990638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:22.990638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:22.991419 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:22.991419 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:22.991419 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:22.991419 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:22.991419 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:22.991419 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:22.991419 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:22.991419 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:22.991419 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:22.991419 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:22.991419 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 09:59:22.991419 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:22.996857 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 199/405] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 22 09:59:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:23.000001 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f426696-76fa-49ea-b465-31959bfe122d None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:23.076204 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 207/406] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:23.102546 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:23.122021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56578007-7476-42b5-b26b-efad4d526020 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:23.135340 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:23.166041 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f426696-76fa-49ea-b465-31959bfe122d None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:23.222605 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045d958-822e-4a27-8762-3a339cb6d9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:23.223287 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045d958-822e-4a27-8762-3a339cb6d9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:23.223573 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045d958-822e-4a27-8762-3a339cb6d9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:23.223852 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045d958-822e-4a27-8762-3a339cb6d9f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:23.224625 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045d958-822e-4a27-8762-3a339cb6d9f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:23.224972 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045d958-822e-4a27-8762-3a339cb6d9f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:23.226545 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045d958-822e-4a27-8762-3a339cb6d9f1 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:23.243591 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 200/407] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 09:59:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:23.250019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045d958-822e-4a27-8762-3a339cb6d9f1 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:23.327540 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56578007-7476-42b5-b26b-efad4d526020 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:23.398577 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0e9b3-2872-4012-8a60-4e6c34103d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:23.400066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0e9b3-2872-4012-8a60-4e6c34103d13 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:23.400615 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0e9b3-2872-4012-8a60-4e6c34103d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:23.401383 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0e9b3-2872-4012-8a60-4e6c34103d13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:23.401675 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045d958-822e-4a27-8762-3a339cb6d9f1 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:23.422393 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0e9b3-2872-4012-8a60-4e6c34103d13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:23.436866 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:23.439476 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04bda5-ff0a-4327-b29e-091695fecb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:23.446134 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04bda5-ff0a-4327-b29e-091695fecb57 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:23.446134 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04bda5-ff0a-4327-b29e-091695fecb57 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:23.446134 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04bda5-ff0a-4327-b29e-091695fecb57 None admin] PATH_INFO: `/v3/groups/0377f4b9ea65468a843c3044b6c2dfce` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:23.446134 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04bda5-ff0a-4327-b29e-091695fecb57 None admin] RBAC: Authorizing `identity:get_group(group_id=0377f4b9ea65468a843c3044b6c2dfce)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:23.446435 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-d6a0e9b3-2872-4012-8a60-4e6c34103d13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 09:59:23.446435 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:23.446435 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:23.446435 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:23.446435 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:23.446435 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:23.446435 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:23.446435 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:23.446435 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:23.446435 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:23.446435 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:23.446435 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:23.446435 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:23.446435 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:23.446435 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:23.446435 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:23.447251 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:23.447251 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:23.447251 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:23.447251 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:23.447251 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:23.447251 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:23.447251 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:23.447251 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:23.447251 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:23.447251 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:23.447251 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:23.447251 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:23.447251 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:23.447251 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:23.447251 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:23.447251 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:23.448033 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:23.448033 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:23.448033 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:23.448033 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:23.448033 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:23.448033 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:23.448033 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:23.448033 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:23.448033 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:23.448033 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:23.448033 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 09:59:23.448033 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:23.448703 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04bda5-ff0a-4327-b29e-091695fecb57 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:23.448767 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 208/408] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 09:59:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:23.448850 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 201/409] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Jun 22 09:59:23 2022] GET /identity/v3/groups/0377f4b9ea65468a843c3044b6c2dfce => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:23.451813 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0e9b3-2872-4012-8a60-4e6c34103d13 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:23.452884 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04bda5-ff0a-4327-b29e-091695fecb57 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:23.569099 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04bda5-ff0a-4327-b29e-091695fecb57 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:23.585871 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:23.611986 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87acbe-3eea-4a7a-9448-ab50b97c412f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:23.613054 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87acbe-3eea-4a7a-9448-ab50b97c412f None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:23.613546 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87acbe-3eea-4a7a-9448-ab50b97c412f None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:23.614051 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87acbe-3eea-4a7a-9448-ab50b97c412f None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:23.615020 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87acbe-3eea-4a7a-9448-ab50b97c412f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:23.615534 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87acbe-3eea-4a7a-9448-ab50b97c412f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:23.617203 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87acbe-3eea-4a7a-9448-ab50b97c412f None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:23.630627 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 202/410] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:59:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:23.634844 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0e9b3-2872-4012-8a60-4e6c34103d13 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:23.637387 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87acbe-3eea-4a7a-9448-ab50b97c412f None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:23.701293 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:23.714749 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da0eb1-4336-4b19-b76d-f728434d0d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:23.720274 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da0eb1-4336-4b19-b76d-f728434d0d5f None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:23.720274 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da0eb1-4336-4b19-b76d-f728434d0d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:23.720274 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da0eb1-4336-4b19-b76d-f728434d0d5f None admin] PATH_INFO: `/v3/projects/8935dc925ceb4fbc8b07442a34045d82` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:23.721817 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da0eb1-4336-4b19-b76d-f728434d0d5f None admin] RBAC: Authorizing `identity:get_project(project_id=8935dc925ceb4fbc8b07442a34045d82)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:23.723395 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da0eb1-4336-4b19-b76d-f728434d0d5f None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:23.725536 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 209/411] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:59:23 2022] GET /identity/v3/projects/8935dc925ceb4fbc8b07442a34045d82 => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:23.731478 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da0eb1-4336-4b19-b76d-f728434d0d5f None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:23.756722 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87acbe-3eea-4a7a-9448-ab50b97c412f None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:23.795861 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ebbc86-55b8-470a-a31d-014117bd864c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:23.797254 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebbc86-55b8-470a-a31d-014117bd864c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:23.797769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebbc86-55b8-470a-a31d-014117bd864c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:23.798255 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebbc86-55b8-470a-a31d-014117bd864c None admin] PATH_INFO: `/v3/groups/e37d72658c1245e1b8df2543f61ab761` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:23.799699 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ebbc86-55b8-470a-a31d-014117bd864c None admin] RBAC: Authorizing `identity:get_group(group_id=e37d72658c1245e1b8df2543f61ab761)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:23.801403 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ebbc86-55b8-470a-a31d-014117bd864c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:23.803571 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 203/412] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Jun 22 09:59:23 2022] GET /identity/v3/groups/e37d72658c1245e1b8df2543f61ab761 => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:23.809751 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ebbc86-55b8-470a-a31d-014117bd864c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:23.928488 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ebbc86-55b8-470a-a31d-014117bd864c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:23.961630 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:23.974427 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f72c4-dacb-494b-b428-48553511ef24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:23.975899 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f72c4-dacb-494b-b428-48553511ef24 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:23.977293 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f72c4-dacb-494b-b428-48553511ef24 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:23.991346 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f72c4-dacb-494b-b428-48553511ef24 None admin] PATH_INFO: `/v3/projects/40e8688682434d2c9756b8751cda6e48` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:23.991346 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f72c4-dacb-494b-b428-48553511ef24 None admin] RBAC: Authorizing `identity:get_project(project_id=40e8688682434d2c9756b8751cda6e48)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:23.991346 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f72c4-dacb-494b-b428-48553511ef24 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:23.991346 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 204/413] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:59:23 2022] GET /identity/v3/projects/40e8688682434d2c9756b8751cda6e48 => generated 344 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:23.992423 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f72c4-dacb-494b-b428-48553511ef24 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:24.010935 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da0eb1-4336-4b19-b76d-f728434d0d5f None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:24.081475 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65036e7d-ba73-44d4-a45d-af68a49e4913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:24.082992 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65036e7d-ba73-44d4-a45d-af68a49e4913 None admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:24.083484 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65036e7d-ba73-44d4-a45d-af68a49e4913 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:24.083989 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65036e7d-ba73-44d4-a45d-af68a49e4913 None admin] PATH_INFO: `/v3/projects/8935dc925ceb4fbc8b07442a34045d82/groups/0377f4b9ea65468a843c3044b6c2dfce/roles/7783830649d941ea9507439a113fc5d9` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:24.087655 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65036e7d-ba73-44d4-a45d-af68a49e4913 None admin] RBAC: Authorizing `identity:create_grant(project_id=8935dc925ceb4fbc8b07442a34045d82, group_id=0377f4b9ea65468a843c3044b6c2dfce, role_id=7783830649d941ea9507439a113fc5d9)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:24.090770 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65036e7d-ba73-44d4-a45d-af68a49e4913 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:24.160242 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f72c4-dacb-494b-b428-48553511ef24 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:24.167384 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:24.174611 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 210/414] 10.222.0.46 () {58 vars in 1442 bytes} [Wed Jun 22 09:59:23 2022] PUT /identity/v3/projects/8935dc925ceb4fbc8b07442a34045d82/groups/0377f4b9ea65468a843c3044b6c2dfce/roles/7783830649d941ea9507439a113fc5d9 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 09:59:24.176648 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1563a0a-8651-424a-b02a-65c842d5b4c5 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:24.177358 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1563a0a-8651-424a-b02a-65c842d5b4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:24.177834 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1563a0a-8651-424a-b02a-65c842d5b4c5 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:24.179421 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 211/415] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:24.186323 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb735ad4-ca9d-45b7-b037-414ec70cb1ca None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:24.186952 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb735ad4-ca9d-45b7-b037-414ec70cb1ca None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:24.187428 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb735ad4-ca9d-45b7-b037-414ec70cb1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:24.212296 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-bb735ad4-ca9d-45b7-b037-414ec70cb1ca None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:24.214273 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-bb735ad4-ca9d-45b7-b037-414ec70cb1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:24.229367 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ac6ce-6cea-4461-b5f7-660c01f26183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:24.230273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ac6ce-6cea-4461-b5f7-660c01f26183 None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:24.230561 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ac6ce-6cea-4461-b5f7-660c01f26183 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:24.230843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ac6ce-6cea-4461-b5f7-660c01f26183 None admin] PATH_INFO: `/v3/projects/40e8688682434d2c9756b8751cda6e48/groups/e37d72658c1245e1b8df2543f61ab761/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:24.238324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ac6ce-6cea-4461-b5f7-660c01f26183 None admin] RBAC: Authorizing `identity:create_grant(project_id=40e8688682434d2c9756b8751cda6e48, group_id=e37d72658c1245e1b8df2543f61ab761, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:24.239967 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ac6ce-6cea-4461-b5f7-660c01f26183 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:24.323315 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 205/416] 10.222.0.46 () {58 vars in 1442 bytes} [Wed Jun 22 09:59:23 2022] PUT /identity/v3/projects/40e8688682434d2c9756b8751cda6e48/groups/e37d72658c1245e1b8df2543f61ab761/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:59:24.329486 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 212/417] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:24.352915 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ac6ce-6cea-4461-b5f7-660c01f26183 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:24.425675 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:24.482434 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ac6ce-6cea-4461-b5f7-660c01f26183 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:24.521281 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03719f4e-23bd-4560-a5f9-a9afa041c19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:24.522500 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03719f4e-23bd-4560-a5f9-a9afa041c19d None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:24.522978 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03719f4e-23bd-4560-a5f9-a9afa041c19d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:24.523504 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03719f4e-23bd-4560-a5f9-a9afa041c19d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:24.535323 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03719f4e-23bd-4560-a5f9-a9afa041c19d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:24.544058 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-03719f4e-23bd-4560-a5f9-a9afa041c19d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 09:59:24.544058 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:24.544058 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:24.544058 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:24.544058 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:24.544058 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:24.544058 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:24.544058 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:24.544058 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:24.544058 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:24.544058 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:24.544058 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:24.544058 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:24.544058 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:24.544058 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:24.544058 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:24.544980 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:24.544980 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:24.544980 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:24.544980 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:24.544980 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:24.544980 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:24.544980 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:24.544980 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:24.544980 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:24.544980 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:24.544980 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:24.544980 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:24.544980 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:24.544980 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:24.544980 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:24.544980 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:24.545754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:24.545754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:24.545754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:24.545754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:24.545754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:24.545754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:24.545754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:24.545754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:24.545754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:24.545754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:24.545754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 09:59:24.545754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:24.551200 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 206/418] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 22 09:59:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:24.555358 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb735ad4-ca9d-45b7-b037-414ec70cb1ca None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:24.671474 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb735ad4-ca9d-45b7-b037-414ec70cb1ca None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:24.701288 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:24.710050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ddc4de-cdbd-45c3-b286-31f751c8eb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:24.710730 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddc4de-cdbd-45c3-b286-31f751c8eb89 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:24.711566 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddc4de-cdbd-45c3-b286-31f751c8eb89 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:24.711853 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddc4de-cdbd-45c3-b286-31f751c8eb89 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:24.719892 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ddc4de-cdbd-45c3-b286-31f751c8eb89 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:24.719892 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ddc4de-cdbd-45c3-b286-31f751c8eb89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:24.719892 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ddc4de-cdbd-45c3-b286-31f751c8eb89 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:24.727598 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 213/419] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 09:59:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:24.728959 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03719f4e-23bd-4560-a5f9-a9afa041c19d None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:24.853510 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03719f4e-23bd-4560-a5f9-a9afa041c19d None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:24.866492 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:24.889291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d636d-327f-4ec2-b797-ecf380125f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:24.889949 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d636d-327f-4ec2-b797-ecf380125f66 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:24.890234 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d636d-327f-4ec2-b797-ecf380125f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:24.890506 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d636d-327f-4ec2-b797-ecf380125f66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:24.977100 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d636d-327f-4ec2-b797-ecf380125f66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:24.978565 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d636d-327f-4ec2-b797-ecf380125f66 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:25.036034 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc715083-3fb0-404b-9a3b-a6f98b5e749b None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:25.036354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc715083-3fb0-404b-9a3b-a6f98b5e749b None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:25.036577 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc715083-3fb0-404b-9a3b-a6f98b5e749b None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:25.038111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 214/420] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 09:59:25.043464 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b03ed9-761e-46d3-9e29-6be844251462 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:25.043776 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b03ed9-761e-46d3-9e29-6be844251462 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:25.044102 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b03ed9-761e-46d3-9e29-6be844251462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:25.076985 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-13b03ed9-761e-46d3-9e29-6be844251462 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:25.078195 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-13b03ed9-761e-46d3-9e29-6be844251462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:25.110090 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 207/421] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:59:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 09:59:25.114531 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d636d-327f-4ec2-b797-ecf380125f66 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:25.140167 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:25.189262 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 215/422] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:25.191002 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c5a9d-305e-40f3-a3b9-aa3f7aa7c361 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:25.191364 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c5a9d-305e-40f3-a3b9-aa3f7aa7c361 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:25.192051 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c5a9d-305e-40f3-a3b9-aa3f7aa7c361 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:25.193975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 216/423] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:25.199386 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe3c0f-abc0-43b4-ad08-60e1361194d7 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:25.199903 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe3c0f-abc0-43b4-ad08-60e1361194d7 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:25.200376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe3c0f-abc0-43b4-ad08-60e1361194d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:25.232761 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-73fe3c0f-abc0-43b4-ad08-60e1361194d7 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:25.234940 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-73fe3c0f-abc0-43b4-ad08-60e1361194d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:25.242938 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d636d-327f-4ec2-b797-ecf380125f66 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:25.278696 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaeabcb-9ee8-4512-ade7-3c23e66efcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:25.279656 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaeabcb-9ee8-4512-ade7-3c23e66efcf1 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:25.279997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaeabcb-9ee8-4512-ade7-3c23e66efcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:25.280376 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaeabcb-9ee8-4512-ade7-3c23e66efcf1 None admin] PATH_INFO: `/v3/projects/f040c41677374080a6ee1538a7a34a54` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:25.281878 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaeabcb-9ee8-4512-ade7-3c23e66efcf1 None admin] RBAC: Authorizing `identity:get_project(project_id=f040c41677374080a6ee1538a7a34a54)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:25.284269 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaeabcb-9ee8-4512-ade7-3c23e66efcf1 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:25.291088 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 208/424] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:59:25 2022] GET /identity/v3/projects/f040c41677374080a6ee1538a7a34a54 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:25.291088 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaeabcb-9ee8-4512-ade7-3c23e66efcf1 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:25.332920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 217/425] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 09:59:25.334091 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe3c0f-abc0-43b4-ad08-60e1361194d7 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:25.399115 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:25.406629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:25.432532 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaeabcb-9ee8-4512-ade7-3c23e66efcf1 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:25.459762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe3c0f-abc0-43b4-ad08-60e1361194d7 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:25.470916 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005d4a2-2ff1-4ee4-8b62-dc5614d69f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:25.471981 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005d4a2-2ff1-4ee4-8b62-dc5614d69f8e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:25.472398 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005d4a2-2ff1-4ee4-8b62-dc5614d69f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:25.472949 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005d4a2-2ff1-4ee4-8b62-dc5614d69f8e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:25.484255 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b005d4a2-2ff1-4ee4-8b62-dc5614d69f8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:25.493276 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-b005d4a2-2ff1-4ee4-8b62-dc5614d69f8e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:59:25.493276 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:25.493276 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:25.493276 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:25.493276 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:25.493276 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:25.493276 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:25.493276 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:25.493276 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:25.493276 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:25.493276 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:25.493276 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:25.493276 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:25.493276 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:25.493276 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:25.493276 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:25.494152 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:25.494152 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:25.494152 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:25.494152 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:25.494152 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:25.494152 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:25.494152 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:25.494152 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:25.494152 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:25.494152 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:25.494152 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:25.494152 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:25.494152 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:25.494152 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:25.494152 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:25.494152 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:25.494951 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:25.494951 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:25.494951 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:25.494951 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:25.494951 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:25.494951 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:25.494951 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:25.494951 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:25.494951 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:25.494951 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:25.494951 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:59:25.494951 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:25.501123 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 209/426] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:59:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:25.501123 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005d4a2-2ff1-4ee4-8b62-dc5614d69f8e None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:25.502047 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fe730-df34-4a6b-963b-b586cba5814c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:25.502904 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fe730-df34-4a6b-963b-b586cba5814c None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:25.503185 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fe730-df34-4a6b-963b-b586cba5814c None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:25.503453 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fe730-df34-4a6b-963b-b586cba5814c None admin] PATH_INFO: `/v3/groups/0377f4b9ea65468a843c3044b6c2dfce` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:25.507336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fe730-df34-4a6b-963b-b586cba5814c None admin] RBAC: Authorizing `identity:get_group(group_id=0377f4b9ea65468a843c3044b6c2dfce)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:25.508810 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fe730-df34-4a6b-963b-b586cba5814c None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:25.512694 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 218/427] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Jun 22 09:59:25 2022] GET /identity/v3/groups/0377f4b9ea65468a843c3044b6c2dfce => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:25.513849 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fe730-df34-4a6b-963b-b586cba5814c None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:25.631642 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fe730-df34-4a6b-963b-b586cba5814c None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:25.650117 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005d4a2-2ff1-4ee4-8b62-dc5614d69f8e None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:25.652088 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:25.672943 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d62f6-514a-40ae-8ca1-5c3aa0ee16f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:25.674403 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d62f6-514a-40ae-8ca1-5c3aa0ee16f8 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:25.674947 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d62f6-514a-40ae-8ca1-5c3aa0ee16f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:25.675412 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d62f6-514a-40ae-8ca1-5c3aa0ee16f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:25.676366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d62f6-514a-40ae-8ca1-5c3aa0ee16f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:25.676894 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d62f6-514a-40ae-8ca1-5c3aa0ee16f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:25.678524 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d62f6-514a-40ae-8ca1-5c3aa0ee16f8 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:25.687833 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 219/428] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 22 09:59:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:25.689074 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d62f6-514a-40ae-8ca1-5c3aa0ee16f8 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:25.701362 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fa7a6-eafd-470e-b876-4f59917e276a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:25.702534 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fa7a6-eafd-470e-b876-4f59917e276a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:25.703013 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fa7a6-eafd-470e-b876-4f59917e276a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:25.703553 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fa7a6-eafd-470e-b876-4f59917e276a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:25.713562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:25.720883 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92fa7a6-eafd-470e-b876-4f59917e276a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:25.730563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-b92fa7a6-eafd-470e-b876-4f59917e276a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:59:25.730563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:25.730563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:25.730563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:25.730563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:25.730563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:25.730563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:25.730563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:25.730563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:25.730563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:25.730563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:25.730563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:25.730563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:25.730563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:25.730563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:25.730563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:25.731465 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:25.731465 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:25.731465 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:25.731465 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:25.731465 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:25.731465 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:25.731465 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:25.731465 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:25.731465 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:25.731465 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:25.731465 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:25.731465 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:25.731465 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:25.731465 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:25.731465 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:25.731465 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:25.732246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:25.732246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:25.732246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:25.732246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:25.732246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:25.732246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:25.732246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:25.732246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:25.732246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:25.732246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:25.732246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 09:59:25.732246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:25.735067 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 210/429] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:59:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:25.736325 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fa7a6-eafd-470e-b876-4f59917e276a None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:25.816602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d62f6-514a-40ae-8ca1-5c3aa0ee16f8 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:25.850351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fa7a6-eafd-470e-b876-4f59917e276a None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:25.853448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce7d17-1ec7-4cab-9995-b728d29657e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:25.854168 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce7d17-1ec7-4cab-9995-b728d29657e9 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:25.855170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce7d17-1ec7-4cab-9995-b728d29657e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:25.855170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce7d17-1ec7-4cab-9995-b728d29657e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:25.855664 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce7d17-1ec7-4cab-9995-b728d29657e9 None admin] RBAC: Adding query filter params (group.id=0377f4b9ea65468a843c3044b6c2dfce, role.id=7783830649d941ea9507439a113fc5d9, scope.project.id=f040c41677374080a6ee1538a7a34a54) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:25.855976 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce7d17-1ec7-4cab-9995-b728d29657e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:25.857431 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce7d17-1ec7-4cab-9995-b728d29657e9 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:25.869131 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 220/430] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Jun 22 09:59:25 2022] GET /identity/v3/role_assignments?group.id=0377f4b9ea65468a843c3044b6c2dfce&scope.project.id=f040c41677374080a6ee1538a7a34a54&role.id=7783830649d941ea9507439a113fc5d9 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:25.870192 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce7d17-1ec7-4cab-9995-b728d29657e9 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:25.891659 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318b154-b775-4819-9196-be3c325f7573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:25.893121 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318b154-b775-4819-9196-be3c325f7573 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:25.893561 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318b154-b775-4819-9196-be3c325f7573 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:25.899926 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318b154-b775-4819-9196-be3c325f7573 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:25.961843 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:26.006155 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:26.015188 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5318b154-b775-4819-9196-be3c325f7573 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:26.016878 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5318b154-b775-4819-9196-be3c325f7573 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:26.027440 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce7d17-1ec7-4cab-9995-b728d29657e9 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:26.076131 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e1e84-9a15-4a9b-a967-748e413923c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:26.076951 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e1e84-9a15-4a9b-a967-748e413923c6 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:26.077237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e1e84-9a15-4a9b-a967-748e413923c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:26.077512 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e1e84-9a15-4a9b-a967-748e413923c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:26.078315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e1e84-9a15-4a9b-a967-748e413923c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:26.078621 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e1e84-9a15-4a9b-a967-748e413923c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:26.080346 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e1e84-9a15-4a9b-a967-748e413923c6 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:26.091106 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 221/431] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 22 09:59:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:26.096967 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e1e84-9a15-4a9b-a967-748e413923c6 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:26.202392 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 211/432] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:59:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 09:59:26.208331 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318b154-b775-4819-9196-be3c325f7573 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:26.214975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e1e84-9a15-4a9b-a967-748e413923c6 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:26.225400 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:26.251995 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4439e-9015-4802-a255-a62e3c76578e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:26.252646 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4439e-9015-4802-a255-a62e3c76578e None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:26.252996 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4439e-9015-4802-a255-a62e3c76578e None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:26.253253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4439e-9015-4802-a255-a62e3c76578e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:26.328835 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:26.332144 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318b154-b775-4819-9196-be3c325f7573 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:26.340262 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f4439e-9015-4802-a255-a62e3c76578e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:26.344884 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f4439e-9015-4802-a255-a62e3c76578e None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:26.386229 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6a0d9-cccc-4954-8d24-a3dece5d21bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:26.387694 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6a0d9-cccc-4954-8d24-a3dece5d21bf None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:26.388165 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6a0d9-cccc-4954-8d24-a3dece5d21bf None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:26.388687 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6a0d9-cccc-4954-8d24-a3dece5d21bf None admin] PATH_INFO: `/v3/projects/8935dc925ceb4fbc8b07442a34045d82` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:26.390766 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6a0d9-cccc-4954-8d24-a3dece5d21bf None admin] RBAC: Authorizing `identity:get_project(project_id=8935dc925ceb4fbc8b07442a34045d82)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:26.393467 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6a0d9-cccc-4954-8d24-a3dece5d21bf None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:26.400979 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 212/433] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:59:26 2022] GET /identity/v3/projects/8935dc925ceb4fbc8b07442a34045d82 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:26.403296 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6a0d9-cccc-4954-8d24-a3dece5d21bf None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:26.483828 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 222/434] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:59:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 09:59:26.485122 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4439e-9015-4802-a255-a62e3c76578e None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:26.494047 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:26.540856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6a0d9-cccc-4954-8d24-a3dece5d21bf None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:26.594047 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e4fae-c64e-46ce-b570-70f0513805d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:26.595113 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e4fae-c64e-46ce-b570-70f0513805d6 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:26.595495 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e4fae-c64e-46ce-b570-70f0513805d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:26.595858 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e4fae-c64e-46ce-b570-70f0513805d6 None admin] PATH_INFO: `/v3/groups/0377f4b9ea65468a843c3044b6c2dfce` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:26.597180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e4fae-c64e-46ce-b570-70f0513805d6 None admin] RBAC: Authorizing `identity:get_group(group_id=0377f4b9ea65468a843c3044b6c2dfce)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:26.598393 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4439e-9015-4802-a255-a62e3c76578e None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:26.598793 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e4fae-c64e-46ce-b570-70f0513805d6 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:26.605574 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 213/435] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Jun 22 09:59:26 2022] GET /identity/v3/groups/0377f4b9ea65468a843c3044b6c2dfce => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:26.607573 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e4fae-c64e-46ce-b570-70f0513805d6 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:26.646413 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:26.649319 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453dba12-af02-403f-b365-0f8c1d912920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:26.650200 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453dba12-af02-403f-b365-0f8c1d912920 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:26.650478 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453dba12-af02-403f-b365-0f8c1d912920 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:26.650750 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453dba12-af02-403f-b365-0f8c1d912920 None admin] PATH_INFO: `/v3/projects/f040c41677374080a6ee1538a7a34a54` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:26.652414 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453dba12-af02-403f-b365-0f8c1d912920 None admin] RBAC: Authorizing `identity:get_project(project_id=f040c41677374080a6ee1538a7a34a54)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:26.654236 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453dba12-af02-403f-b365-0f8c1d912920 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:26.656720 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 223/436] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:59:26 2022] GET /identity/v3/projects/f040c41677374080a6ee1538a7a34a54 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:26.660017 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28a4e1-e38a-4389-8de4-95faf15f13cc None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:26.660017 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28a4e1-e38a-4389-8de4-95faf15f13cc None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:26.660017 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28a4e1-e38a-4389-8de4-95faf15f13cc None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:26.666022 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 224/437] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:26.666022 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28a4e1-e38a-4389-8de4-95faf15f13cc None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:26.721331 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e4fae-c64e-46ce-b570-70f0513805d6 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:26.752788 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:26.759009 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c20007-f2ea-4a68-bc7f-4c4d6bed6016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:26.759675 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c20007-f2ea-4a68-bc7f-4c4d6bed6016 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:26.759954 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c20007-f2ea-4a68-bc7f-4c4d6bed6016 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:26.760221 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c20007-f2ea-4a68-bc7f-4c4d6bed6016 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:26.761090 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c20007-f2ea-4a68-bc7f-4c4d6bed6016 None admin] RBAC: Adding query filter params (group.id=0377f4b9ea65468a843c3044b6c2dfce, role.id=b8f82737ef614907a0d320c6e1f2facf, scope.project.id=8935dc925ceb4fbc8b07442a34045d82) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:26.761401 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c20007-f2ea-4a68-bc7f-4c4d6bed6016 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:26.762931 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c20007-f2ea-4a68-bc7f-4c4d6bed6016 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:26.769055 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 214/438] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Jun 22 09:59:26 2022] GET /identity/v3/role_assignments?group.id=0377f4b9ea65468a843c3044b6c2dfce&scope.project.id=8935dc925ceb4fbc8b07442a34045d82&role.id=b8f82737ef614907a0d320c6e1f2facf => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:26.770177 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dd9b7-d9e2-48f6-acb6-ed680fff5b77 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:26.771471 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dd9b7-d9e2-48f6-acb6-ed680fff5b77 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:26.771471 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dd9b7-d9e2-48f6-acb6-ed680fff5b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:26.788110 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28a4e1-e38a-4389-8de4-95faf15f13cc None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:26.789430 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-893dd9b7-d9e2-48f6-acb6-ed680fff5b77 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:26.790704 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-893dd9b7-d9e2-48f6-acb6-ed680fff5b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:26.829794 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b761802-253c-4475-9dd4-cf2af636a80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:26.830663 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b761802-253c-4475-9dd4-cf2af636a80a None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:26.830942 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b761802-253c-4475-9dd4-cf2af636a80a None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:26.831211 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b761802-253c-4475-9dd4-cf2af636a80a None admin] PATH_INFO: `/v3/groups/0377f4b9ea65468a843c3044b6c2dfce` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:26.832714 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b761802-253c-4475-9dd4-cf2af636a80a None admin] RBAC: Authorizing `identity:get_group(group_id=0377f4b9ea65468a843c3044b6c2dfce)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:26.834197 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b761802-253c-4475-9dd4-cf2af636a80a None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:26.845072 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 225/439] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Jun 22 09:59:26 2022] GET /identity/v3/groups/0377f4b9ea65468a843c3044b6c2dfce => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:26.845072 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cb168-d8f6-4705-ae78-9bed6e30a065 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:26.845072 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cb168-d8f6-4705-ae78-9bed6e30a065 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:26.845072 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cb168-d8f6-4705-ae78-9bed6e30a065 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:26.845072 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 226/440] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:26.845072 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cb168-d8f6-4705-ae78-9bed6e30a065 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:26.877281 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 215/441] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:26.878432 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee41557-e90c-498b-8d20-87ee6dceff6a None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:26.878727 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee41557-e90c-498b-8d20-87ee6dceff6a None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:26.879019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee41557-e90c-498b-8d20-87ee6dceff6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:26.900472 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-5ee41557-e90c-498b-8d20-87ee6dceff6a None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:26.901715 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-5ee41557-e90c-498b-8d20-87ee6dceff6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:26.928212 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:26.972808 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cb168-d8f6-4705-ae78-9bed6e30a065 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:26.981466 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 216/442] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:26.981466 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee41557-e90c-498b-8d20-87ee6dceff6a None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:27.015154 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db502f-e5f4-4371-ab00-ad7a517b9bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:27.015735 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db502f-e5f4-4371-ab00-ad7a517b9bdf None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:27.016020 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db502f-e5f4-4371-ab00-ad7a517b9bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:27.016298 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db502f-e5f4-4371-ab00-ad7a517b9bdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:27.017170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db502f-e5f4-4371-ab00-ad7a517b9bdf None admin] RBAC: Adding query filter params (group.id=0377f4b9ea65468a843c3044b6c2dfce, role.id=b8f82737ef614907a0d320c6e1f2facf, scope.project.id=f040c41677374080a6ee1538a7a34a54) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:27.017483 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db502f-e5f4-4371-ab00-ad7a517b9bdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:27.018916 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db502f-e5f4-4371-ab00-ad7a517b9bdf None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:27.024723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 227/443] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Jun 22 09:59:26 2022] GET /identity/v3/role_assignments?group.id=0377f4b9ea65468a843c3044b6c2dfce&scope.project.id=f040c41677374080a6ee1538a7a34a54&role.id=b8f82737ef614907a0d320c6e1f2facf => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:27.025533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db502f-e5f4-4371-ab00-ad7a517b9bdf None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:27.034260 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:27.097848 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee41557-e90c-498b-8d20-87ee6dceff6a None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:27.139812 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15981a-e448-4a44-8d8b-716621719e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:27.140106 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db502f-e5f4-4371-ab00-ad7a517b9bdf None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:27.140973 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15981a-e448-4a44-8d8b-716621719e54 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:27.141330 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15981a-e448-4a44-8d8b-716621719e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:27.141681 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15981a-e448-4a44-8d8b-716621719e54 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:27.154087 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15981a-e448-4a44-8d8b-716621719e54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:27.162626 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-9f15981a-e448-4a44-8d8b-716621719e54 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 09:59:27.162626 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:27.162626 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:27.162626 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:27.162626 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:27.162626 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:27.162626 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:27.162626 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:27.162626 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:27.162626 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:27.162626 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:27.162626 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:27.162626 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:27.162626 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:27.162626 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:27.162626 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:27.163689 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:27.163689 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:27.163689 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:27.163689 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:27.163689 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:27.163689 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:27.163689 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:27.163689 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:27.163689 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:27.163689 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:27.163689 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:27.163689 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:27.163689 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:27.163689 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:27.163689 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:27.163689 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:27.165104 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:27.165104 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:27.165104 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:27.165104 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:27.165104 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:27.165104 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:27.165104 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:27.165104 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:27.165104 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:27.165104 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:27.165104 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 09:59:27.165104 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:27.165104 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 217/444] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 22 09:59:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:27.170441 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15981a-e448-4a44-8d8b-716621719e54 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:27.186049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e12fa-debd-4c58-95d8-cf08d5b4d7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:27.186360 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e12fa-debd-4c58-95d8-cf08d5b4d7d6 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:27.186609 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e12fa-debd-4c58-95d8-cf08d5b4d7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:27.186889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e12fa-debd-4c58-95d8-cf08d5b4d7d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:27.196774 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:27.200371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e12fa-debd-4c58-95d8-cf08d5b4d7d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:27.209537 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-d52e12fa-debd-4c58-95d8-cf08d5b4d7d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 09:59:27.209537 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:27.209537 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:27.209537 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:27.209537 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:27.209537 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:27.209537 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:27.209537 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:27.209537 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:27.209537 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:27.209537 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:27.209537 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:27.209537 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:27.209537 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:27.209537 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:27.209537 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:27.210602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:27.210602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:27.210602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:27.210602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:27.210602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:27.210602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:27.210602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:27.210602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:27.210602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:27.210602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:27.210602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:27.210602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:27.210602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:27.210602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:27.210602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:27.210602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:27.211953 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:27.211953 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:27.211953 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:27.211953 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:27.211953 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:27.211953 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:27.211953 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:27.211953 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:27.211953 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:27.211953 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:27.211953 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 09:59:27.211953 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:27.211953 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 228/445] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 09:59:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:27.220044 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e12fa-debd-4c58-95d8-cf08d5b4d7d6 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:27.280868 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15981a-e448-4a44-8d8b-716621719e54 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:27.306638 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:27.322096 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2ce9e-9c71-4102-950c-7e22ee9a4545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:27.322775 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2ce9e-9c71-4102-950c-7e22ee9a4545 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:27.323065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2ce9e-9c71-4102-950c-7e22ee9a4545 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:27.323341 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2ce9e-9c71-4102-950c-7e22ee9a4545 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:27.324105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2ce9e-9c71-4102-950c-7e22ee9a4545 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:27.324417 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2ce9e-9c71-4102-950c-7e22ee9a4545 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:27.325840 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2ce9e-9c71-4102-950c-7e22ee9a4545 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:27.338802 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 218/446] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 09:59:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:27.344556 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2ce9e-9c71-4102-950c-7e22ee9a4545 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:27.352309 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e12fa-debd-4c58-95d8-cf08d5b4d7d6 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:27.399623 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da7b0e-6df1-40cd-9305-5d7a7beeae66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:27.400319 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da7b0e-6df1-40cd-9305-5d7a7beeae66 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:27.400605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da7b0e-6df1-40cd-9305-5d7a7beeae66 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:27.400993 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da7b0e-6df1-40cd-9305-5d7a7beeae66 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:27.401768 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da7b0e-6df1-40cd-9305-5d7a7beeae66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:27.402080 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da7b0e-6df1-40cd-9305-5d7a7beeae66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:27.403463 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da7b0e-6df1-40cd-9305-5d7a7beeae66 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:27.412901 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 229/447] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:59:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:27.418955 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da7b0e-6df1-40cd-9305-5d7a7beeae66 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:27.441381 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:27.465982 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2ce9e-9c71-4102-950c-7e22ee9a4545 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:27.510882 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b9eaa-52c1-4036-9c4e-8d9f677c3a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:27.512196 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b9eaa-52c1-4036-9c4e-8d9f677c3a84 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:27.512196 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b9eaa-52c1-4036-9c4e-8d9f677c3a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:27.512196 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b9eaa-52c1-4036-9c4e-8d9f677c3a84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:27.549741 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da7b0e-6df1-40cd-9305-5d7a7beeae66 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:27.581939 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:27.590862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa33b9a-93d8-4836-af50-ceca04587e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:27.591549 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa33b9a-93d8-4836-af50-ceca04587e65 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:27.591857 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa33b9a-93d8-4836-af50-ceca04587e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:27.592112 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa33b9a-93d8-4836-af50-ceca04587e65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:27.601044 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b9eaa-52c1-4036-9c4e-8d9f677c3a84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:27.601044 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b9eaa-52c1-4036-9c4e-8d9f677c3a84 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:27.683193 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa33b9a-93d8-4836-af50-ceca04587e65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:27.684944 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa33b9a-93d8-4836-af50-ceca04587e65 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:27.690061 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:27.709686 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 219/448] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:59:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 09:59:27.715847 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b9eaa-52c1-4036-9c4e-8d9f677c3a84 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:27.786771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 230/449] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:59:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 09:59:27.792349 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa33b9a-93d8-4836-af50-ceca04587e65 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:27.814845 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b9eaa-52c1-4036-9c4e-8d9f677c3a84 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:27.819788 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:27.852050 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1e8a9-636b-46a8-91e9-873da4684479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:27.852950 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1e8a9-636b-46a8-91e9-873da4684479 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:27.853241 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1e8a9-636b-46a8-91e9-873da4684479 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:27.853523 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1e8a9-636b-46a8-91e9-873da4684479 None admin] PATH_INFO: `/v3/projects/8935dc925ceb4fbc8b07442a34045d82` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:27.854741 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1e8a9-636b-46a8-91e9-873da4684479 None admin] RBAC: Authorizing `identity:get_project(project_id=8935dc925ceb4fbc8b07442a34045d82)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:27.856301 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1e8a9-636b-46a8-91e9-873da4684479 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:27.858060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 220/450] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:59:27 2022] GET /identity/v3/projects/8935dc925ceb4fbc8b07442a34045d82 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:27.863351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1e8a9-636b-46a8-91e9-873da4684479 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:27.897893 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa33b9a-93d8-4836-af50-ceca04587e65 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:27.912648 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:27.932371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f33ce-0174-469b-8f4c-2974d3035527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:27.933283 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f33ce-0174-469b-8f4c-2974d3035527 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:27.933563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f33ce-0174-469b-8f4c-2974d3035527 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:27.933836 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f33ce-0174-469b-8f4c-2974d3035527 None admin] PATH_INFO: `/v3/projects/40e8688682434d2c9756b8751cda6e48` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:27.935066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f33ce-0174-469b-8f4c-2974d3035527 None admin] RBAC: Authorizing `identity:get_project(project_id=40e8688682434d2c9756b8751cda6e48)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:27.936513 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f33ce-0174-469b-8f4c-2974d3035527 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:27.938255 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 231/451] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 09:59:27 2022] GET /identity/v3/projects/40e8688682434d2c9756b8751cda6e48 => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:27.943766 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f33ce-0174-469b-8f4c-2974d3035527 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:27.967273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1e8a9-636b-46a8-91e9-873da4684479 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:28.006492 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4130abc1-7606-4c55-94f3-931ec87cd77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:28.007344 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130abc1-7606-4c55-94f3-931ec87cd77d None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:28.008254 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130abc1-7606-4c55-94f3-931ec87cd77d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:28.008529 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130abc1-7606-4c55-94f3-931ec87cd77d None admin] PATH_INFO: `/v3/groups/0377f4b9ea65468a843c3044b6c2dfce` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:28.009768 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4130abc1-7606-4c55-94f3-931ec87cd77d None admin] RBAC: Authorizing `identity:get_group(group_id=0377f4b9ea65468a843c3044b6c2dfce)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:28.011234 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4130abc1-7606-4c55-94f3-931ec87cd77d None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:28.012877 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 221/452] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Jun 22 09:59:27 2022] GET /identity/v3/groups/0377f4b9ea65468a843c3044b6c2dfce => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:28.018698 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4130abc1-7606-4c55-94f3-931ec87cd77d None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:28.053240 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:28.060180 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f33ce-0174-469b-8f4c-2974d3035527 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:28.100259 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d066b-dda7-460b-967b-5191935afc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:28.102301 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d066b-dda7-460b-967b-5191935afc0c None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:28.102586 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d066b-dda7-460b-967b-5191935afc0c None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:28.102861 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d066b-dda7-460b-967b-5191935afc0c None admin] PATH_INFO: `/v3/groups/e37d72658c1245e1b8df2543f61ab761` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:28.104124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d066b-dda7-460b-967b-5191935afc0c None admin] RBAC: Authorizing `identity:get_group(group_id=e37d72658c1245e1b8df2543f61ab761)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:28.105601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d066b-dda7-460b-967b-5191935afc0c None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:28.107252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 232/453] 10.222.0.46 () {56 vars in 1180 bytes} [Wed Jun 22 09:59:27 2022] GET /identity/v3/groups/e37d72658c1245e1b8df2543f61ab761 => generated 229 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:28.113041 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d066b-dda7-460b-967b-5191935afc0c None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:28.128983 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4130abc1-7606-4c55-94f3-931ec87cd77d None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:28.148271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:28.168390 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255dc45-2ffb-48ee-985b-f9c79881fad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:28.169225 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255dc45-2ffb-48ee-985b-f9c79881fad8 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:28.169508 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255dc45-2ffb-48ee-985b-f9c79881fad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:28.169784 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255dc45-2ffb-48ee-985b-f9c79881fad8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:28.170733 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7255dc45-2ffb-48ee-985b-f9c79881fad8 None admin] RBAC: Adding query filter params (group.id=0377f4b9ea65468a843c3044b6c2dfce, role.id=7783830649d941ea9507439a113fc5d9, scope.project.id=8935dc925ceb4fbc8b07442a34045d82) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:28.171048 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7255dc45-2ffb-48ee-985b-f9c79881fad8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:28.172724 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7255dc45-2ffb-48ee-985b-f9c79881fad8 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:28.178655 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 222/454] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Jun 22 09:59:28 2022] GET /identity/v3/role_assignments?group.id=0377f4b9ea65468a843c3044b6c2dfce&scope.project.id=8935dc925ceb4fbc8b07442a34045d82&role.id=7783830649d941ea9507439a113fc5d9 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:28.227694 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d066b-dda7-460b-967b-5191935afc0c None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:28.268430 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a66b87-7807-46ba-83b6-8e2fdf0ad2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:28.269061 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a66b87-7807-46ba-83b6-8e2fdf0ad2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:28.269343 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a66b87-7807-46ba-83b6-8e2fdf0ad2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:28.269617 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a66b87-7807-46ba-83b6-8e2fdf0ad2c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:28.270459 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a66b87-7807-46ba-83b6-8e2fdf0ad2c8 None admin] RBAC: Adding query filter params (group.id=e37d72658c1245e1b8df2543f61ab761, role.id=106aa464a69a49b09de7de5417083d3c, scope.project.id=40e8688682434d2c9756b8751cda6e48) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:28.270767 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a66b87-7807-46ba-83b6-8e2fdf0ad2c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:28.272210 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a66b87-7807-46ba-83b6-8e2fdf0ad2c8 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:28.280710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 233/455] 10.222.0.46 () {56 vars in 1376 bytes} [Wed Jun 22 09:59:28 2022] GET /identity/v3/role_assignments?group.id=e37d72658c1245e1b8df2543f61ab761&scope.project.id=40e8688682434d2c9756b8751cda6e48&role.id=106aa464a69a49b09de7de5417083d3c => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:30.771859 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a1ba1-30fd-4c6f-8dba-d0f691bb780e None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:30.772360 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a1ba1-30fd-4c6f-8dba-d0f691bb780e None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:30.772479 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a1ba1-30fd-4c6f-8dba-d0f691bb780e None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:30.774343 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 223/456] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:30.779584 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a29727-cc37-4603-afb2-8a6fb45aeb37 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:30.779983 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a29727-cc37-4603-afb2-8a6fb45aeb37 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:30.780147 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a29727-cc37-4603-afb2-8a6fb45aeb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:30.805844 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-98a29727-cc37-4603-afb2-8a6fb45aeb37 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:30.807045 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-98a29727-cc37-4603-afb2-8a6fb45aeb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:30.836143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:30.891715 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 234/457] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:30.933064 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a1ba1-30fd-4c6f-8dba-d0f691bb780e None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:31.062195 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebeba42-857d-437f-83da-478f1d80ac77 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:31.062539 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebeba42-857d-437f-83da-478f1d80ac77 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:31.062743 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebeba42-857d-437f-83da-478f1d80ac77 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:31.064100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 235/458] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 09:59:31.073323 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a1085-2b93-4753-a763-1b2e339e6ddd None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:31.073627 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a1085-2b93-4753-a763-1b2e339e6ddd None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:31.073876 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a1085-2b93-4753-a763-1b2e339e6ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:31.098489 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-d10a1085-2b93-4753-a763-1b2e339e6ddd None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:31.099671 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-d10a1085-2b93-4753-a763-1b2e339e6ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:31.103163 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a1ba1-30fd-4c6f-8dba-d0f691bb780e None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:31.139391 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd20814-ef34-41ef-9ab8-f45e2fc4681e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:31.140190 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd20814-ef34-41ef-9ab8-f45e2fc4681e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:31.140468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd20814-ef34-41ef-9ab8-f45e2fc4681e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:31.140737 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd20814-ef34-41ef-9ab8-f45e2fc4681e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:31.151836 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd20814-ef34-41ef-9ab8-f45e2fc4681e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:31.153353 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd20814-ef34-41ef-9ab8-f45e2fc4681e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:31.171839 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-fcd20814-ef34-41ef-9ab8-f45e2fc4681e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:31.171839 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:31.171839 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:31.171839 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:31.171839 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:31.171839 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:31.171839 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:31.171839 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:31.171839 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:31.171839 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:31.171839 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:31.171839 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:31.171839 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:31.171839 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:31.171839 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:31.174101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:31.174101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:31.174101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:31.174101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:31.174101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:31.174101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:31.174101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:31.174101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:31.174101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:31.174101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:31.174101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:31.174101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:31.174101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:31.174101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:31.174101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:31.174101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:31.174101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:31.176256 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:31.176256 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:31.176256 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:31.176256 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:31.176256 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 224/459] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:31.181200 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd20814-ef34-41ef-9ab8-f45e2fc4681e None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:31.237504 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:31.283157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 236/460] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 09:59:31.304844 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd20814-ef34-41ef-9ab8-f45e2fc4681e None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:31.326609 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a1085-2b93-4753-a763-1b2e339e6ddd None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:31.339258 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d930ad-a252-427c-a7e8-992eda73c50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:31.339935 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d930ad-a252-427c-a7e8-992eda73c50e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:31.340213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d930ad-a252-427c-a7e8-992eda73c50e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:31.340488 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d930ad-a252-427c-a7e8-992eda73c50e None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:31.341242 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d930ad-a252-427c-a7e8-992eda73c50e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:31.341542 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d930ad-a252-427c-a7e8-992eda73c50e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:31.342918 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d930ad-a252-427c-a7e8-992eda73c50e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:31.355783 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 225/461] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:31.356897 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f80e5-a564-43c7-a5cb-38f04de84cc3 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:31.357187 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f80e5-a564-43c7-a5cb-38f04de84cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:31.357459 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f80e5-a564-43c7-a5cb-38f04de84cc3 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:31.358916 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 226/462] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:31.361870 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f80e5-a564-43c7-a5cb-38f04de84cc3 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:31.431880 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:31.444900 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a1085-2b93-4753-a763-1b2e339e6ddd None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:31.464955 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:31.472307 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f80e5-a564-43c7-a5cb-38f04de84cc3 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:31.483349 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f85d5-96cb-4d6f-a1f9-f96d7dc773b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:31.484151 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f85d5-96cb-4d6f-a1f9-f96d7dc773b9 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:31.484435 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f85d5-96cb-4d6f-a1f9-f96d7dc773b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:31.484713 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f85d5-96cb-4d6f-a1f9-f96d7dc773b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:31.496060 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f85d5-96cb-4d6f-a1f9-f96d7dc773b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:31.497526 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f85d5-96cb-4d6f-a1f9-f96d7dc773b9 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:31.507567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09de1f-27b2-40b2-adc6-b1ea19f2ccba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:31.508242 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09de1f-27b2-40b2-adc6-b1ea19f2ccba None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:31.508518 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09de1f-27b2-40b2-adc6-b1ea19f2ccba None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:31.508792 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09de1f-27b2-40b2-adc6-b1ea19f2ccba None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:31.519666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09de1f-27b2-40b2-adc6-b1ea19f2ccba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:31.519666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09de1f-27b2-40b2-adc6-b1ea19f2ccba None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:31.520022 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-d10f85d5-96cb-4d6f-a1f9-f96d7dc773b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:31.520022 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:31.520022 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:31.520022 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:31.520022 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:31.520022 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:31.520022 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:31.520022 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:31.520022 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:31.520022 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:31.520022 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:31.520022 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:31.520022 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:31.520022 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:31.520022 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:31.520805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:31.520805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:31.520805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:31.520805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:31.520805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:31.520805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:31.520805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:31.520805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:31.520805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:31.520805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:31.520805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:31.520805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:31.520805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:31.520805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:31.520805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:31.520805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:31.520805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:31.522122 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:31.522122 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:31.522122 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:31.522122 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:31.522122 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 237/463] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:31.522122 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86d1ee-8ddb-479f-8a75-a38e8d65105e None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:31.522122 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86d1ee-8ddb-479f-8a75-a38e8d65105e None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:31.522122 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86d1ee-8ddb-479f-8a75-a38e8d65105e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:31.540461 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-1b86d1ee-8ddb-479f-8a75-a38e8d65105e None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:31.545031 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-1b86d1ee-8ddb-479f-8a75-a38e8d65105e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:31.615769 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 238/464] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:31.617230 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd17ad-c802-4c69-902c-97f2b17d70d1 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:31.617520 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd17ad-c802-4c69-902c-97f2b17d70d1 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:31.617802 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd17ad-c802-4c69-902c-97f2b17d70d1 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:31.619202 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 239/465] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:31.619801 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd17ad-c802-4c69-902c-97f2b17d70d1 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:31.634831 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 227/466] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 22 09:59:31 2022] POST /identity/v3/users => generated 246 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:59:31.636560 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df68ddc-a57e-461e-96b4-1f3743e6f160 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:31.637077 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df68ddc-a57e-461e-96b4-1f3743e6f160 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:31.637517 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df68ddc-a57e-461e-96b4-1f3743e6f160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:31.660295 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-3df68ddc-a57e-461e-96b4-1f3743e6f160 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:31.662045 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-3df68ddc-a57e-461e-96b4-1f3743e6f160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:31.729554 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:31.766062 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd17ad-c802-4c69-902c-97f2b17d70d1 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:31.780856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 228/467] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:31.780856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df68ddc-a57e-461e-96b4-1f3743e6f160 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:31.829355 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78472560-e81c-4907-a203-82240f19c021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:31.830032 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78472560-e81c-4907-a203-82240f19c021 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:31.830317 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78472560-e81c-4907-a203-82240f19c021 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:31.830592 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78472560-e81c-4907-a203-82240f19c021 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:31.831593 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78472560-e81c-4907-a203-82240f19c021 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:31.831904 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78472560-e81c-4907-a203-82240f19c021 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:31.833338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78472560-e81c-4907-a203-82240f19c021 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:31.847005 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 240/468] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:31.847860 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78472560-e81c-4907-a203-82240f19c021 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:31.889753 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:31.914269 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df68ddc-a57e-461e-96b4-1f3743e6f160 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:31.955399 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675c066-ec47-4406-8b37-b7aebdbd6d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:31.957111 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675c066-ec47-4406-8b37-b7aebdbd6d2b None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:31.957111 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675c066-ec47-4406-8b37-b7aebdbd6d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:31.957111 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675c066-ec47-4406-8b37-b7aebdbd6d2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:31.971077 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0675c066-ec47-4406-8b37-b7aebdbd6d2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:31.972745 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0675c066-ec47-4406-8b37-b7aebdbd6d2b None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:31.980729 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78472560-e81c-4907-a203-82240f19c021 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:31.993351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-0675c066-ec47-4406-8b37-b7aebdbd6d2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:31.993351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:31.993351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:31.993351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:31.993351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:31.993351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:31.993351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:31.993351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:31.993351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:31.993351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:31.993351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:31.993351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:31.993351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:31.993351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:31.993351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:31.994252 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:31.994252 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:31.994252 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:31.994252 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:31.994252 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:31.994252 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:31.994252 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:31.994252 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:31.994252 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:31.994252 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:31.994252 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:31.994252 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:31.994252 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:31.994252 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:31.994252 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:31.994252 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:31.994252 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:31.995419 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:31.995419 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:31.995419 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:31.995419 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:31.995419 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 229/469] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:31.995688 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675c066-ec47-4406-8b37-b7aebdbd6d2b None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:32.016498 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:32.022411 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a538808-1a28-48af-b1c3-6375bf2f36de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:32.023884 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a538808-1a28-48af-b1c3-6375bf2f36de None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:32.024264 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a538808-1a28-48af-b1c3-6375bf2f36de None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:32.024796 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a538808-1a28-48af-b1c3-6375bf2f36de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:32.036471 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a538808-1a28-48af-b1c3-6375bf2f36de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:32.038128 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a538808-1a28-48af-b1c3-6375bf2f36de None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:32.060456 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-2a538808-1a28-48af-b1c3-6375bf2f36de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:32.060456 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:32.060456 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:32.060456 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:32.060456 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:32.060456 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:32.060456 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:32.060456 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:32.060456 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:32.060456 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:32.060456 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:32.060456 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:32.060456 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:32.060456 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:32.060456 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:32.061402 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:32.061402 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:32.061402 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:32.061402 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:32.061402 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:32.061402 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:32.061402 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:32.061402 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:32.061402 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:32.061402 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:32.061402 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:32.061402 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:32.061402 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:32.061402 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:32.061402 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:32.061402 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:32.061402 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:32.062806 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:32.062806 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:32.062806 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:32.062806 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:32.062806 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 241/470] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:32.063764 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a538808-1a28-48af-b1c3-6375bf2f36de None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:32.136146 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675c066-ec47-4406-8b37-b7aebdbd6d2b None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:32.178057 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:32.186054 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ae03d-de2d-42a2-8029-eb6e757df8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:32.186974 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ae03d-de2d-42a2-8029-eb6e757df8ca None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:32.195505 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ae03d-de2d-42a2-8029-eb6e757df8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:32.195505 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ae03d-de2d-42a2-8029-eb6e757df8ca None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:32.195779 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a538808-1a28-48af-b1c3-6375bf2f36de None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:32.195874 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ae03d-de2d-42a2-8029-eb6e757df8ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:32.195874 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ae03d-de2d-42a2-8029-eb6e757df8ca None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:32.226230 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e51e79-706f-4b2c-bc29-17604b276bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:32.226896 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e51e79-706f-4b2c-bc29-17604b276bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:32.227180 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e51e79-706f-4b2c-bc29-17604b276bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:32.227454 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e51e79-706f-4b2c-bc29-17604b276bd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:32.228178 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e51e79-706f-4b2c-bc29-17604b276bd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:32.228485 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e51e79-706f-4b2c-bc29-17604b276bd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:32.229901 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e51e79-706f-4b2c-bc29-17604b276bd2 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:32.246845 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 242/471] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:32.246845 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e51e79-706f-4b2c-bc29-17604b276bd2 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:32.294636 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:32.319131 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 230/472] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 22 09:59:31 2022] POST /identity/v3/users => generated 248 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:59:32.320711 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ae03d-de2d-42a2-8029-eb6e757df8ca None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:32.407314 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e51e79-706f-4b2c-bc29-17604b276bd2 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:32.467490 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e09187-e174-49de-b76f-5447cd590dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:32.468173 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e09187-e174-49de-b76f-5447cd590dfb None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:32.468462 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e09187-e174-49de-b76f-5447cd590dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:32.468742 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e09187-e174-49de-b76f-5447cd590dfb None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:32.469511 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e09187-e174-49de-b76f-5447cd590dfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:32.469823 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e09187-e174-49de-b76f-5447cd590dfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:32.471222 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e09187-e174-49de-b76f-5447cd590dfb None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:32.492042 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 243/473] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:32.498067 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e09187-e174-49de-b76f-5447cd590dfb None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:32.522591 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ae03d-de2d-42a2-8029-eb6e757df8ca None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:32.571366 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f646c-a4fd-4fd3-ba91-9feb228e6989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:32.571998 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f646c-a4fd-4fd3-ba91-9feb228e6989 None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:32.572288 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f646c-a4fd-4fd3-ba91-9feb228e6989 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:32.572567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f646c-a4fd-4fd3-ba91-9feb228e6989 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:32.573374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f646c-a4fd-4fd3-ba91-9feb228e6989 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:32.574823 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f646c-a4fd-4fd3-ba91-9feb228e6989 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:32.631052 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e09187-e174-49de-b76f-5447cd590dfb None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:32.633745 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:32.669597 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca1902-5d49-4db1-b5e0-6fda9ea03c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:32.670342 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca1902-5d49-4db1-b5e0-6fda9ea03c20 None admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:32.670634 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca1902-5d49-4db1-b5e0-6fda9ea03c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:32.670914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca1902-5d49-4db1-b5e0-6fda9ea03c20 None admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:32.672098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca1902-5d49-4db1-b5e0-6fda9ea03c20 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:32.684805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca1902-5d49-4db1-b5e0-6fda9ea03c20 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:32.753263 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 231/474] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 22 09:59:32 2022] POST /identity/v3/users => generated 249 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:59:32.756850 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e71bf5-b1ce-4779-a3a9-49e508d9f7f8 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:32.756850 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e71bf5-b1ce-4779-a3a9-49e508d9f7f8 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:32.756850 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e71bf5-b1ce-4779-a3a9-49e508d9f7f8 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:32.756850 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 232/475] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:32.762911 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871dac1e-5877-4e23-9b31-44e3986c99dc None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:32.763328 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871dac1e-5877-4e23-9b31-44e3986c99dc None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:32.763695 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871dac1e-5877-4e23-9b31-44e3986c99dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:32.790619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 244/476] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 22 09:59:32 2022] POST /identity/v3/users => generated 248 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 09:59:32.791172 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-871dac1e-5877-4e23-9b31-44e3986c99dc None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:32.792734 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-871dac1e-5877-4e23-9b31-44e3986c99dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:32.860948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:32.907297 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 233/477] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 09:59:32.946390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca1902-5d49-4db1-b5e0-6fda9ea03c20 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:33.068988 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca1902-5d49-4db1-b5e0-6fda9ea03c20 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:33.106889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71816af9-0988-46b9-97d6-fb04617e9e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:33.107571 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71816af9-0988-46b9-97d6-fb04617e9e86 None admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:33.107969 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71816af9-0988-46b9-97d6-fb04617e9e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:33.108256 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71816af9-0988-46b9-97d6-fb04617e9e86 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:33.109053 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71816af9-0988-46b9-97d6-fb04617e9e86 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:33.110435 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71816af9-0988-46b9-97d6-fb04617e9e86 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:33.152973 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.sql.core [None req-71816af9-0988-46b9-97d6-fb04617e9e86 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 22 09:59:33.152973 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 22 09:59:33.152973 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [parameters: {'id': '4fbcba51329141f895777f5e170d93fc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 22 09:59:33.152973 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80500) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 22 09:59:33.170164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-71816af9-0988-46b9-97d6-fb04617e9e86 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 22 09:59:33.170164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:33.170164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 09:59:33.170164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 09:59:33.170164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 09:59:33.170164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 09:59:33.170164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 09:59:33.170164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 09:59:33.170164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 09:59:33.170164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application conn.query(q) Jun 22 09:59:33.170164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 09:59:33.170164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 09:59:33.170164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 09:59:33.170164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application result.read() Jun 22 09:59:33.170164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 09:59:33.171035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 09:59:33.171035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 09:59:33.171035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 09:59:33.171035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 09:59:33.171035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 09:59:33.171035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 09:59:33.171035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 09:59:33.171035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 22 09:59:33.171035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:33.171035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 22 09:59:33.171035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:33.171035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:33.171035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 22 09:59:33.171035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 22 09:59:33.171035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 22 09:59:33.171035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return ref.to_dict() Jun 22 09:59:33.171035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 09:59:33.171035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application next(self.gen) Jun 22 09:59:33.171924 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 22 09:59:33.171924 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application yield resource Jun 22 09:59:33.171924 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 09:59:33.171924 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application next(self.gen) Jun 22 09:59:33.171924 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 22 09:59:33.171924 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self.session.rollback() Jun 22 09:59:33.171924 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 22 09:59:33.171924 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self.force_reraise() Jun 22 09:59:33.171924 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 22 09:59:33.171924 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise self.value Jun 22 09:59:33.171924 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 22 09:59:33.171924 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 22 09:59:33.171924 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 22 09:59:33.171924 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application session.commit() Jun 22 09:59:33.171924 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 22 09:59:33.171924 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 22 09:59:33.171924 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 22 09:59:33.173375 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._prepare_impl() Jun 22 09:59:33.173375 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 22 09:59:33.173375 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self.session.flush() Jun 22 09:59:33.173375 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 22 09:59:33.173375 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._flush(objects) Jun 22 09:59:33.173375 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 22 09:59:33.173375 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 22 09:59:33.173375 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 22 09:59:33.173375 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application compat.raise_( Jun 22 09:59:33.173375 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 09:59:33.173375 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception Jun 22 09:59:33.173375 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 22 09:59:33.173375 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application flush_context.execute() Jun 22 09:59:33.173375 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 22 09:59:33.173375 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rec.execute(self) Jun 22 09:59:33.173375 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 22 09:59:33.173375 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 22 09:59:33.174248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 22 09:59:33.174248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 22 09:59:33.174248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 22 09:59:33.174248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 22 09:59:33.174248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 22 09:59:33.174248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 22 09:59:33.174248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 22 09:59:33.174248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 22 09:59:33.174248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 22 09:59:33.174248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 22 09:59:33.174248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 22 09:59:33.174248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 22 09:59:33.174248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 22 09:59:33.174248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 22 09:59:33.174248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 09:59:33.174248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception Jun 22 09:59:33.175021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 09:59:33.175021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 09:59:33.175021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 09:59:33.175021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 09:59:33.175021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 09:59:33.175021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 09:59:33.175021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 09:59:33.175021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application conn.query(q) Jun 22 09:59:33.175021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 09:59:33.175021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 09:59:33.175021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 09:59:33.175021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application result.read() Jun 22 09:59:33.175021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 09:59:33.175021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 09:59:33.175021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 09:59:33.175021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 09:59:33.175794 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 09:59:33.175794 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 09:59:33.175794 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 09:59:33.175794 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 09:59:33.175794 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 22 09:59:33.175794 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 22 09:59:33.175794 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [parameters: {'id': '4fbcba51329141f895777f5e170d93fc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 22 09:59:33.175794 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 22 09:59:33.175794 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:33.175794 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 09:59:33.175794 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:33.175794 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:33.175794 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:33.175794 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:33.175794 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:33.175794 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:33.177818 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:33.177818 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:33.177818 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:33.177818 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:33.177818 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:33.177818 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:33.177818 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 22 09:59:33.177818 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 22 09:59:33.177818 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:33.177818 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:33.177818 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 22 09:59:33.177818 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 22 09:59:33.177818 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 22 09:59:33.177818 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 22 09:59:33.177818 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 22 09:59:33.177818 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:33.180125 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 245/478] 10.222.0.46 () {60 vars in 1131 bytes} [Wed Jun 22 09:59:32 2022] POST /identity/v3/roles => generated 144 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:33.180260 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871dac1e-5877-4e23-9b31-44e3986c99dc None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:33.347782 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871dac1e-5877-4e23-9b31-44e3986c99dc None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:33.403537 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70e2c0-dead-435b-85ea-0e2710bffa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:33.404272 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70e2c0-dead-435b-85ea-0e2710bffa4e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:33.404554 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70e2c0-dead-435b-85ea-0e2710bffa4e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:33.404846 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70e2c0-dead-435b-85ea-0e2710bffa4e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:33.419773 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70e2c0-dead-435b-85ea-0e2710bffa4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:33.427993 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-be70e2c0-dead-435b-85ea-0e2710bffa4e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 09:59:33.427993 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:33.427993 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:33.427993 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:33.427993 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:33.427993 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:33.427993 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:33.427993 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:33.427993 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:33.427993 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:33.427993 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:33.427993 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:33.427993 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:33.427993 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:33.427993 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:33.427993 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:33.428909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:33.428909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:33.428909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:33.428909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:33.428909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:33.428909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:33.428909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:33.428909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:33.428909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:33.428909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:33.428909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:33.428909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:33.428909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:33.428909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:33.428909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:33.428909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:33.429686 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:33.429686 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:33.429686 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:33.429686 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:33.429686 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:33.429686 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:33.429686 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:33.429686 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:33.429686 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:33.429686 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:33.429686 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 09:59:33.429686 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:33.430742 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 234/479] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 22 09:59:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:33.435323 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71816af9-0988-46b9-97d6-fb04617e9e86 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:33.491745 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:33.605212 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71816af9-0988-46b9-97d6-fb04617e9e86 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:33.651916 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac8e3a-40b6-4623-8993-5f91bc1de98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:33.653119 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac8e3a-40b6-4623-8993-5f91bc1de98b None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:33.653670 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac8e3a-40b6-4623-8993-5f91bc1de98b None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:33.654143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac8e3a-40b6-4623-8993-5f91bc1de98b None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:33.655087 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac8e3a-40b6-4623-8993-5f91bc1de98b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:33.655584 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac8e3a-40b6-4623-8993-5f91bc1de98b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:33.657175 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac8e3a-40b6-4623-8993-5f91bc1de98b None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:33.685562 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 246/480] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 09:59:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:34.148394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284accb-bce7-4917-9f58-3a608a14a97c None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:34.148915 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284accb-bce7-4917-9f58-3a608a14a97c None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:34.149027 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284accb-bce7-4917-9f58-3a608a14a97c None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:34.150606 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 235/481] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:34.156284 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b93c1-ffd7-4767-90d2-6a2fd0a1599a None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:34.156706 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b93c1-ffd7-4767-90d2-6a2fd0a1599a None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:34.156900 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b93c1-ffd7-4767-90d2-6a2fd0a1599a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:34.174047 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-341b93c1-ffd7-4767-90d2-6a2fd0a1599a None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:34.175256 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-341b93c1-ffd7-4767-90d2-6a2fd0a1599a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:34.255739 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 247/482] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 09:59:34.277110 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284accb-bce7-4917-9f58-3a608a14a97c None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:34.329771 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:34.399390 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284accb-bce7-4917-9f58-3a608a14a97c None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:34.447861 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676a53d-e8cc-49c8-8ded-61d154fac11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:34.448655 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676a53d-e8cc-49c8-8ded-61d154fac11e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:34.449015 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676a53d-e8cc-49c8-8ded-61d154fac11e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:34.449294 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676a53d-e8cc-49c8-8ded-61d154fac11e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:34.465718 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676a53d-e8cc-49c8-8ded-61d154fac11e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:34.473765 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-2676a53d-e8cc-49c8-8ded-61d154fac11e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 09:59:34.473765 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:34.473765 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:34.473765 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:34.473765 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:34.473765 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:34.473765 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:34.473765 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:34.473765 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:34.473765 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:34.473765 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:34.473765 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:34.473765 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:34.473765 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:34.473765 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:34.473765 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:34.474654 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:34.474654 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:34.474654 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:34.474654 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:34.474654 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:34.474654 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:34.474654 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:34.474654 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:34.474654 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:34.474654 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:34.474654 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:34.474654 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:34.474654 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:34.474654 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:34.474654 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:34.474654 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:34.475420 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:34.475420 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:34.475420 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:34.475420 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:34.475420 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:34.475420 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:34.475420 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:34.475420 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:34.475420 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:34.475420 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:34.475420 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 09:59:34.475420 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:34.475420 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 236/483] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 22 09:59:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:34.481499 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b93c1-ffd7-4767-90d2-6a2fd0a1599a None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:34.509660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:34.635767 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b93c1-ffd7-4767-90d2-6a2fd0a1599a None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:34.674791 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746fa17d-ec79-4a24-a3f6-acd4a83f90ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:34.675475 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fa17d-ec79-4a24-a3f6-acd4a83f90ce None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:34.675759 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fa17d-ec79-4a24-a3f6-acd4a83f90ce None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:34.676034 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fa17d-ec79-4a24-a3f6-acd4a83f90ce None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:34.676794 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746fa17d-ec79-4a24-a3f6-acd4a83f90ce None admin] RBAC: Adding query filter params (name=service) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:34.677129 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746fa17d-ec79-4a24-a3f6-acd4a83f90ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:34.680998 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746fa17d-ec79-4a24-a3f6-acd4a83f90ce None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:34.695889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 248/484] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 22 09:59:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:34.697316 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676a53d-e8cc-49c8-8ded-61d154fac11e None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:34.814850 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:34.824801 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676a53d-e8cc-49c8-8ded-61d154fac11e None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:34.864643 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c76be3-70b6-40fc-a28d-3a10ad48d323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:34.865473 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c76be3-70b6-40fc-a28d-3a10ad48d323 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:34.865825 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c76be3-70b6-40fc-a28d-3a10ad48d323 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:34.866499 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c76be3-70b6-40fc-a28d-3a10ad48d323 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:34.877132 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c76be3-70b6-40fc-a28d-3a10ad48d323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:34.878678 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c76be3-70b6-40fc-a28d-3a10ad48d323 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:34.897183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-d8c76be3-70b6-40fc-a28d-3a10ad48d323 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:34.897183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:34.897183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:34.897183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:34.897183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:34.897183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:34.897183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:34.897183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:34.897183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:34.897183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:34.897183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:34.897183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:34.897183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:34.897183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:34.897183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:34.898615 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:34.898615 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:34.898615 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:34.898615 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:34.898615 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:34.898615 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:34.898615 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:34.898615 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:34.898615 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:34.898615 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:34.898615 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:34.898615 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:34.898615 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:34.898615 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:34.898615 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:34.898615 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:34.898615 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:34.899452 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:34.899452 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:34.899452 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:34.899452 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:34.906537 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 237/485] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 09:59:34.908667 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746fa17d-ec79-4a24-a3f6-acd4a83f90ce None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:35.009284 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:35.038956 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746fa17d-ec79-4a24-a3f6-acd4a83f90ce None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:35.081334 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677233f-425a-455f-89a6-fb00563030b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:35.082008 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677233f-425a-455f-89a6-fb00563030b0 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:35.082292 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677233f-425a-455f-89a6-fb00563030b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:35.082568 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677233f-425a-455f-89a6-fb00563030b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:35.083383 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677233f-425a-455f-89a6-fb00563030b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:35.083700 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677233f-425a-455f-89a6-fb00563030b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:35.086024 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677233f-425a-455f-89a6-fb00563030b0 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:35.112416 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 249/486] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:35.117992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c76be3-70b6-40fc-a28d-3a10ad48d323 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:35.159869 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9f4aa-45be-4368-9648-bfcbfa7d13cb None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:35.160371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9f4aa-45be-4368-9648-bfcbfa7d13cb None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:35.160443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9f4aa-45be-4368-9648-bfcbfa7d13cb None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:35.162112 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 250/487] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 09:59:35.166895 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a355c3c-373b-498f-9311-3c4d05fcd3c2 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:35.167173 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a355c3c-373b-498f-9311-3c4d05fcd3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:35.167610 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a355c3c-373b-498f-9311-3c4d05fcd3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:35.192966 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-9a355c3c-373b-498f-9311-3c4d05fcd3c2 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:35.195031 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-9a355c3c-373b-498f-9311-3c4d05fcd3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:35.254600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c76be3-70b6-40fc-a28d-3a10ad48d323 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:35.278427 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 251/488] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:35.279805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91035a5-a22a-493b-b2ef-d36082e6e26b None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:35.280096 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91035a5-a22a-493b-b2ef-d36082e6e26b None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:35.285139 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91035a5-a22a-493b-b2ef-d36082e6e26b None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:35.286600 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 252/489] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:35.292340 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcd4f8-6931-4931-9bf9-50920b7ac894 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:35.292636 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcd4f8-6931-4931-9bf9-50920b7ac894 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:35.292946 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcd4f8-6931-4931-9bf9-50920b7ac894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:35.298421 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ad4d0-6941-4e8c-8165-c424079d1c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:35.299421 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ad4d0-6941-4e8c-8165-c424079d1c64 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:35.299851 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ad4d0-6941-4e8c-8165-c424079d1c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:35.300271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ad4d0-6941-4e8c-8165-c424079d1c64 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:35.308036 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ad4d0-6941-4e8c-8165-c424079d1c64 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:35.309707 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ad4d0-6941-4e8c-8165-c424079d1c64 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:35.321881 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-33bcd4f8-6931-4931-9bf9-50920b7ac894 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:35.323254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-33bcd4f8-6931-4931-9bf9-50920b7ac894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:35.327311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-1a1ad4d0-6941-4e8c-8165-c424079d1c64 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 09:59:35.327311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:35.327311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:35.327311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:35.327311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:35.327311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:35.327311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:35.327311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:35.327311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:35.327311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:35.327311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:35.327311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:35.327311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 09:59:35.327311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 09:59:35.327311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 09:59:35.327311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 09:59:35.328370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:35.328370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:35.328370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 09:59:35.328370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 09:59:35.328370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 09:59:35.328370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 09:59:35.328370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:35.328370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:35.328370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:35.328370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:35.328370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:35.328370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:35.328370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:35.328370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:35.328370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:35.328370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:35.328370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:35.328370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:35.329488 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:35.329488 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:35.329488 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 09:59:35.329488 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 09:59:35.329488 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 09:59:35.329488 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 09:59:35.329488 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 09:59:35.329488 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 09:59:35.329488 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 09:59:35.329488 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:35.331932 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 238/490] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Jun 22 09:59:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:35.337609 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ad4d0-6941-4e8c-8165-c424079d1c64 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:35.346738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:35.394697 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:35.404264 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 253/491] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 09:59:35.405353 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bcd4f8-6931-4931-9bf9-50920b7ac894 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:35.451132 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ad4d0-6941-4e8c-8165-c424079d1c64 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:35.486320 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755bfc9a-1486-4e32-a8ad-97ef49c1d814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:35.487348 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bfc9a-1486-4e32-a8ad-97ef49c1d814 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:35.487808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bfc9a-1486-4e32-a8ad-97ef49c1d814 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:35.488240 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755bfc9a-1486-4e32-a8ad-97ef49c1d814 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:35.500658 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755bfc9a-1486-4e32-a8ad-97ef49c1d814 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:35.509764 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-755bfc9a-1486-4e32-a8ad-97ef49c1d814 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 09:59:35.509764 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:35.509764 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:35.509764 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:35.509764 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:35.509764 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:35.509764 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:35.509764 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:35.509764 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:35.509764 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:35.509764 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:35.509764 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:35.509764 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:35.509764 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:35.509764 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:35.509764 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:35.510663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:35.510663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:35.510663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:35.510663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:35.510663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:35.510663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:35.510663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:35.510663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:35.510663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:35.510663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:35.510663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:35.510663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:35.510663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:35.510663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:35.510663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:35.510663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:35.512142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:35.512142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:35.512142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:35.512142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:35.512142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:35.512142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:35.512142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:35.512142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:35.512142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:35.512142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:35.512142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 09:59:35.512142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:35.512142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 239/492] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 22 09:59:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:35.512922 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493df4b-95fb-4b79-a250-2d09d7fc5102 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:35.512987 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493df4b-95fb-4b79-a250-2d09d7fc5102 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:35.513272 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493df4b-95fb-4b79-a250-2d09d7fc5102 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:35.519114 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 240/493] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:35.519114 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493df4b-95fb-4b79-a250-2d09d7fc5102 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:35.522260 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bcd4f8-6931-4931-9bf9-50920b7ac894 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:35.563586 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a9c45-c8e7-431a-b53c-098b037f1504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:35.564291 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a9c45-c8e7-431a-b53c-098b037f1504 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:35.564575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a9c45-c8e7-431a-b53c-098b037f1504 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:35.564879 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a9c45-c8e7-431a-b53c-098b037f1504 None admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:35.565731 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a9c45-c8e7-431a-b53c-098b037f1504 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:35.566049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a9c45-c8e7-431a-b53c-098b037f1504 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:35.567513 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a9c45-c8e7-431a-b53c-098b037f1504 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:35.590147 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:35.609030 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 254/494] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Jun 22 09:59:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:35.610382 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d7e15-b215-46c0-a2b7-c4ef816f4fba None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:35.610767 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d7e15-b215-46c0-a2b7-c4ef816f4fba None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:35.610948 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d7e15-b215-46c0-a2b7-c4ef816f4fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:35.628333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-3e6d7e15-b215-46c0-a2b7-c4ef816f4fba None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:35.629560 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-3e6d7e15-b215-46c0-a2b7-c4ef816f4fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:35.634404 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493df4b-95fb-4b79-a250-2d09d7fc5102 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:35.675860 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8bf58-2ef4-4e70-ac0b-b6320af477cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:35.676666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8bf58-2ef4-4e70-ac0b-b6320af477cd None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:35.676988 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8bf58-2ef4-4e70-ac0b-b6320af477cd None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:35.677286 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8bf58-2ef4-4e70-ac0b-b6320af477cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:35.686894 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:35.692134 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8bf58-2ef4-4e70-ac0b-b6320af477cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:35.703317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-ada8bf58-2ef4-4e70-ac0b-b6320af477cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 09:59:35.703317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:35.703317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:35.703317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:35.703317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:35.703317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:35.703317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:35.703317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:35.703317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:35.703317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:35.703317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:35.703317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:35.703317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:35.703317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:35.703317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:35.703317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:35.704261 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:35.704261 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:35.704261 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:35.704261 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:35.704261 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:35.704261 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:35.704261 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:35.704261 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:35.704261 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:35.704261 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:35.704261 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:35.704261 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:35.704261 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:35.704261 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:35.704261 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:35.704261 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:35.705069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:35.705069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:35.705069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:35.705069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:35.705069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:35.705069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:35.705069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:35.705069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:35.705069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:35.705069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:35.705069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 09:59:35.705069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:35.705069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 241/495] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 22 09:59:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:35.705734 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8bf58-2ef4-4e70-ac0b-b6320af477cd None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:35.709034 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 255/496] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:35.710165 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d7e15-b215-46c0-a2b7-c4ef816f4fba None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:35.822465 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8bf58-2ef4-4e70-ac0b-b6320af477cd None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:35.822639 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d7e15-b215-46c0-a2b7-c4ef816f4fba None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:35.851453 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:35.858772 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a5074-0ae9-4cb6-8390-227e4e82bfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:35.859431 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a5074-0ae9-4cb6-8390-227e4e82bfb6 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:35.859719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a5074-0ae9-4cb6-8390-227e4e82bfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:35.859998 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a5074-0ae9-4cb6-8390-227e4e82bfb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:35.860246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25cbb6-4fba-426f-9bfb-339c06459617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:35.860934 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25cbb6-4fba-426f-9bfb-339c06459617 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:35.861222 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25cbb6-4fba-426f-9bfb-339c06459617 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:35.861495 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25cbb6-4fba-426f-9bfb-339c06459617 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:35.862253 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25cbb6-4fba-426f-9bfb-339c06459617 None admin] RBAC: Adding query filter params (name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:35.867076 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25cbb6-4fba-426f-9bfb-339c06459617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:35.867076 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25cbb6-4fba-426f-9bfb-339c06459617 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:35.877299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 242/497] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 22 09:59:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:35.878450 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25cbb6-4fba-426f-9bfb-339c06459617 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:35.916976 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:35.933593 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a5074-0ae9-4cb6-8390-227e4e82bfb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:35.935335 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a5074-0ae9-4cb6-8390-227e4e82bfb6 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:35.984738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25cbb6-4fba-426f-9bfb-339c06459617 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:36.021255 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2716bb1-c52f-42e1-8736-ff807fb0425f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:36.021929 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2716bb1-c52f-42e1-8736-ff807fb0425f None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:36.022216 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2716bb1-c52f-42e1-8736-ff807fb0425f None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:36.022527 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2716bb1-c52f-42e1-8736-ff807fb0425f None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:36.023287 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2716bb1-c52f-42e1-8736-ff807fb0425f None admin] RBAC: Adding query filter params (name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:36.023598 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2716bb1-c52f-42e1-8736-ff807fb0425f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:36.025021 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2716bb1-c52f-42e1-8736-ff807fb0425f None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:36.033233 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 243/498] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 22 09:59:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:36.034127 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2716bb1-c52f-42e1-8736-ff807fb0425f None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:36.045127 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 256/499] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:59:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 09:59:36.046669 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a5074-0ae9-4cb6-8390-227e4e82bfb6 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:36.088621 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:36.138155 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:36.142827 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2716bb1-c52f-42e1-8736-ff807fb0425f None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:36.155119 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a5074-0ae9-4cb6-8390-227e4e82bfb6 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:36.183468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e0403-7df1-42c6-a174-6dd72bb04a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:36.184261 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e0403-7df1-42c6-a174-6dd72bb04a5f None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:36.184552 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e0403-7df1-42c6-a174-6dd72bb04a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:36.184846 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e0403-7df1-42c6-a174-6dd72bb04a5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:36.196047 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c2d6d-f19c-4d79-9eaf-cdc593154a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:36.196853 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c2d6d-f19c-4d79-9eaf-cdc593154a1f None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:36.197136 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c2d6d-f19c-4d79-9eaf-cdc593154a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:36.197231 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e0403-7df1-42c6-a174-6dd72bb04a5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:36.197412 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c2d6d-f19c-4d79-9eaf-cdc593154a1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:36.206567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-e83e0403-7df1-42c6-a174-6dd72bb04a5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 09:59:36.206567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:36.206567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:36.206567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:36.206567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:36.206567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:36.206567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:36.206567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:36.206567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:36.206567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:36.206567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:36.206567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:36.206567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:36.206567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:36.206567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:36.206567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:36.207416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:36.207416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:36.207416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:36.207416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:36.207416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:36.207416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:36.207416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:36.207416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:36.207416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:36.207416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:36.207416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:36.207416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:36.207416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:36.207416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:36.207416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:36.207416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:36.213501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:36.213501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:36.213501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:36.213501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:36.213501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:36.213501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:36.213501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:36.213501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:36.213501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:36.213501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:36.213501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 09:59:36.213501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:36.214148 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c2d6d-f19c-4d79-9eaf-cdc593154a1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:36.214218 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 244/500] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 22 09:59:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:36.214296 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c2d6d-f19c-4d79-9eaf-cdc593154a1f None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:36.214362 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e0403-7df1-42c6-a174-6dd72bb04a5f None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:36.234521 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-687c2d6d-f19c-4d79-9eaf-cdc593154a1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:36.234521 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:36.234521 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:36.234521 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:36.234521 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:36.234521 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:36.234521 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:36.234521 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:36.234521 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:36.234521 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:36.234521 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:36.234521 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:36.234521 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:36.234521 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:36.234521 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:36.235417 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:36.235417 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:36.235417 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:36.235417 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:36.235417 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:36.235417 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:36.235417 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:36.235417 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:36.235417 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:36.235417 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:36.235417 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:36.235417 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:36.235417 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:36.235417 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:36.235417 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:36.235417 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:36.235417 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:36.236264 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:36.236264 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:36.236264 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:36.236264 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:36.240375 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 257/501] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:36.241293 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c2d6d-f19c-4d79-9eaf-cdc593154a1f None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:36.321896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e0403-7df1-42c6-a174-6dd72bb04a5f None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:36.333028 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:36.348435 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c2d6d-f19c-4d79-9eaf-cdc593154a1f None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:36.357613 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29401c-2337-40e6-a298-da0bb5a4ce09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:36.358768 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29401c-2337-40e6-a298-da0bb5a4ce09 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:36.359316 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29401c-2337-40e6-a298-da0bb5a4ce09 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:36.359671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29401c-2337-40e6-a298-da0bb5a4ce09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:36.371328 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29401c-2337-40e6-a298-da0bb5a4ce09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:36.372859 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29401c-2337-40e6-a298-da0bb5a4ce09 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:36.385965 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651367bf-42a5-49a4-a5ee-cb3ce9d83fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:36.386767 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651367bf-42a5-49a4-a5ee-cb3ce9d83fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:36.387054 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651367bf-42a5-49a4-a5ee-cb3ce9d83fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:36.387333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651367bf-42a5-49a4-a5ee-cb3ce9d83fb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:36.390176 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:36.395691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-ea29401c-2337-40e6-a298-da0bb5a4ce09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:36.395691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:36.395691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:36.395691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:36.395691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:36.395691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:36.395691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:36.395691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:36.395691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:36.395691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:36.395691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:36.395691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:36.395691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:36.395691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:36.395691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:36.396511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:36.396511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:36.396511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:36.396511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:36.396511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:36.396511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:36.396511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:36.396511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:36.396511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:36.396511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:36.396511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:36.396511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:36.396511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:36.396511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:36.396511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:36.396511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:36.396511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:36.398027 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:36.398027 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:36.398027 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:36.398027 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:36.403869 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 245/502] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:36.404017 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651367bf-42a5-49a4-a5ee-cb3ce9d83fb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:36.405886 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29401c-2337-40e6-a298-da0bb5a4ce09 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:36.405996 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651367bf-42a5-49a4-a5ee-cb3ce9d83fb2 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:36.419975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-651367bf-42a5-49a4-a5ee-cb3ce9d83fb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:36.419975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:36.419975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:36.419975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:36.419975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:36.419975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:36.419975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:36.419975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:36.419975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:36.419975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:36.419975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:36.419975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:36.419975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:36.419975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:36.419975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:36.421023 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:36.421023 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:36.421023 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:36.421023 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:36.421023 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:36.421023 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:36.421023 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:36.421023 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:36.421023 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:36.421023 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:36.421023 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:36.421023 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:36.421023 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:36.421023 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:36.421023 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:36.421023 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:36.421023 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:36.422049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:36.422049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:36.422049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:36.422049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:36.428607 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 258/503] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:36.429372 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651367bf-42a5-49a4-a5ee-cb3ce9d83fb2 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:36.506541 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29401c-2337-40e6-a298-da0bb5a4ce09 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:36.536363 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651367bf-42a5-49a4-a5ee-cb3ce9d83fb2 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:36.541904 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fed259-279a-467e-a211-bb3d53b69a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:36.542573 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fed259-279a-467e-a211-bb3d53b69a99 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:36.542856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fed259-279a-467e-a211-bb3d53b69a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:36.543134 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fed259-279a-467e-a211-bb3d53b69a99 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:36.543879 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fed259-279a-467e-a211-bb3d53b69a99 None admin] RBAC: Adding query filter params (name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:36.544180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fed259-279a-467e-a211-bb3d53b69a99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:36.545574 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fed259-279a-467e-a211-bb3d53b69a99 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:36.553657 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 246/504] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 22 09:59:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:36.554438 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fed259-279a-467e-a211-bb3d53b69a99 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:36.571339 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fdf680-5bf7-44c7-9bb5-79620378a522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:36.571996 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdf680-5bf7-44c7-9bb5-79620378a522 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:36.572276 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdf680-5bf7-44c7-9bb5-79620378a522 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:36.572549 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdf680-5bf7-44c7-9bb5-79620378a522 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:36.573298 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fdf680-5bf7-44c7-9bb5-79620378a522 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:36.573672 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fdf680-5bf7-44c7-9bb5-79620378a522 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:36.574972 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fdf680-5bf7-44c7-9bb5-79620378a522 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:36.580321 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:36.588196 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 259/505] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:36.589093 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fdf680-5bf7-44c7-9bb5-79620378a522 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:36.645254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:36.662246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fed259-279a-467e-a211-bb3d53b69a99 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:36.698193 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79692cf7-ffe4-41ae-915f-95a736d9953f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:36.698854 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79692cf7-ffe4-41ae-915f-95a736d9953f None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:36.699138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79692cf7-ffe4-41ae-915f-95a736d9953f None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:36.699418 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79692cf7-ffe4-41ae-915f-95a736d9953f None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:36.700144 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79692cf7-ffe4-41ae-915f-95a736d9953f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:36.700455 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79692cf7-ffe4-41ae-915f-95a736d9953f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:36.701886 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79692cf7-ffe4-41ae-915f-95a736d9953f None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:36.704780 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fdf680-5bf7-44c7-9bb5-79620378a522 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:36.718554 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 247/506] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:36.719863 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d4306-7f4d-47a0-9fa8-6570d5cfc180 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:36.720160 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d4306-7f4d-47a0-9fa8-6570d5cfc180 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:36.720435 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d4306-7f4d-47a0-9fa8-6570d5cfc180 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:36.721879 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 248/507] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:36.723765 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d4306-7f4d-47a0-9fa8-6570d5cfc180 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:36.744234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf125198-6b58-4e1f-91e2-2c2321230b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:36.744938 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf125198-6b58-4e1f-91e2-2c2321230b3a None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:36.745232 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf125198-6b58-4e1f-91e2-2c2321230b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:36.745508 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf125198-6b58-4e1f-91e2-2c2321230b3a None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:36.746330 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf125198-6b58-4e1f-91e2-2c2321230b3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:36.746637 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf125198-6b58-4e1f-91e2-2c2321230b3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:36.748005 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf125198-6b58-4e1f-91e2-2c2321230b3a None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:36.760172 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 260/508] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:36.761018 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf125198-6b58-4e1f-91e2-2c2321230b3a None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:36.808692 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:36.825101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d4306-7f4d-47a0-9fa8-6570d5cfc180 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:36.859376 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ceec9-b088-4aa6-8c63-598697fad6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:36.860165 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ceec9-b088-4aa6-8c63-598697fad6d5 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:36.860449 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ceec9-b088-4aa6-8c63-598697fad6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:36.860726 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ceec9-b088-4aa6-8c63-598697fad6d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:36.863898 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf125198-6b58-4e1f-91e2-2c2321230b3a None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:36.871114 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ceec9-b088-4aa6-8c63-598697fad6d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:36.872579 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ceec9-b088-4aa6-8c63-598697fad6d5 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:36.873789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:36.892497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-840ceec9-b088-4aa6-8c63-598697fad6d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:36.892497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:36.892497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:36.892497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:36.892497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:36.892497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:36.892497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:36.892497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:36.892497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:36.892497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:36.892497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:36.892497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:36.892497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:36.892497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:36.892497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:36.893431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:36.893431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:36.893431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:36.893431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:36.893431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:36.893431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:36.893431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:36.893431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:36.893431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:36.893431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:36.893431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:36.893431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:36.893431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:36.893431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:36.893431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:36.893431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:36.893431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:36.894259 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:36.894259 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:36.894259 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:36.894259 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:36.894259 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 249/509] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:36.894526 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ceec9-b088-4aa6-8c63-598697fad6d5 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:36.903417 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffc812-c024-41eb-b419-289c8740c71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:36.904143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffc812-c024-41eb-b419-289c8740c71d None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:36.904426 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffc812-c024-41eb-b419-289c8740c71d None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:36.904704 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffc812-c024-41eb-b419-289c8740c71d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:36.912517 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffc812-c024-41eb-b419-289c8740c71d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:36.914039 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffc812-c024-41eb-b419-289c8740c71d None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:36.938437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-98ffc812-c024-41eb-b419-289c8740c71d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 09:59:36.938437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:36.938437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:36.938437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:36.938437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:36.938437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:36.938437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:36.938437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:36.938437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:36.938437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:36.938437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:36.938437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:36.938437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 09:59:36.938437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 09:59:36.938437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 09:59:36.938437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 09:59:36.947605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:36.947605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:36.947605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 09:59:36.947605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 09:59:36.947605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 09:59:36.947605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 09:59:36.947605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:36.947605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:36.947605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:36.947605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:36.947605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:36.947605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:36.947605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:36.947605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:36.947605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:36.947605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:36.947605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:36.947605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:36.948710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:36.948710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:36.948710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 09:59:36.948710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 09:59:36.948710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 09:59:36.948710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 09:59:36.948710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 09:59:36.948710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 09:59:36.948710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 09:59:36.948710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:36.948710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 261/510] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:59:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:36.948710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdacab3-8f0f-4af4-8af5-dee48111572a None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:36.948710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdacab3-8f0f-4af4-8af5-dee48111572a None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:36.949691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdacab3-8f0f-4af4-8af5-dee48111572a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:36.960437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-9bdacab3-8f0f-4af4-8af5-dee48111572a None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:36.961686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-9bdacab3-8f0f-4af4-8af5-dee48111572a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:37.004866 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ceec9-b088-4aa6-8c63-598697fad6d5 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:37.028895 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 262/511] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:37.029827 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdacab3-8f0f-4af4-8af5-dee48111572a None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:37.043610 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510b88c-bdce-4d13-9b86-c1400c7e1130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:37.044681 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510b88c-bdce-4d13-9b86-c1400c7e1130 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:37.045164 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510b88c-bdce-4d13-9b86-c1400c7e1130 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:37.045443 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510b88c-bdce-4d13-9b86-c1400c7e1130 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:37.048516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:37.054638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510b88c-bdce-4d13-9b86-c1400c7e1130 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:37.056093 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510b88c-bdce-4d13-9b86-c1400c7e1130 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:37.071638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-a510b88c-bdce-4d13-9b86-c1400c7e1130 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 22 09:59:37.071638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:37.071638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:37.071638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:37.071638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:37.071638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:37.071638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:37.071638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:37.071638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:37.071638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:37.071638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:37.071638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:37.071638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 09:59:37.071638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 09:59:37.071638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 09:59:37.071638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 09:59:37.072702 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:37.072702 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:37.072702 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 09:59:37.072702 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 09:59:37.072702 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 09:59:37.072702 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 09:59:37.072702 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:37.072702 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:37.072702 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:37.072702 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:37.072702 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:37.072702 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:37.072702 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:37.072702 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:37.072702 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:37.072702 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:37.072702 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:37.072702 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:37.077490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:37.077490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:37.077490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 09:59:37.077490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 09:59:37.077490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 09:59:37.077490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 09:59:37.077490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 09:59:37.077490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 09:59:37.077490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 22 09:59:37.077490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:37.077490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 250/512] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:59:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:37.077490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510b88c-bdce-4d13-9b86-c1400c7e1130 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:37.136385 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:37.140398 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdacab3-8f0f-4af4-8af5-dee48111572a None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:37.175815 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f797b-c3f1-41ee-8bc0-8b24792a8805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:37.176206 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f797b-c3f1-41ee-8bc0-8b24792a8805 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:37.176299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510b88c-bdce-4d13-9b86-c1400c7e1130 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:37.176490 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f797b-c3f1-41ee-8bc0-8b24792a8805 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:37.176767 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f797b-c3f1-41ee-8bc0-8b24792a8805 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:37.184177 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f797b-c3f1-41ee-8bc0-8b24792a8805 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:37.185667 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f797b-c3f1-41ee-8bc0-8b24792a8805 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:37.202321 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-b79f797b-c3f1-41ee-8bc0-8b24792a8805 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 09:59:37.202321 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:37.202321 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:37.202321 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:37.202321 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:37.202321 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:37.202321 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:37.202321 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:37.202321 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:37.202321 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:37.202321 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:37.202321 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:37.202321 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 09:59:37.202321 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 09:59:37.202321 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 09:59:37.203763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 09:59:37.203763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:37.203763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:37.203763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:37.203763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:37.203763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:37.203763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:37.203763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:37.203763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:37.203763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:37.203763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:37.203763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:37.203763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:37.203763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:37.203763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:37.203763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:37.203763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:37.204602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 09:59:37.204602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 09:59:37.204602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 09:59:37.204602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 09:59:37.204602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 09:59:37.204602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 09:59:37.204602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 09:59:37.204602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:37.204602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 263/513] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 09:59:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:37.204602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f797b-c3f1-41ee-8bc0-8b24792a8805 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:37.223376 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b1109-e759-4441-b47e-4e9c4a4c4fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:37.224123 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b1109-e759-4441-b47e-4e9c4a4c4fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:37.224399 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b1109-e759-4441-b47e-4e9c4a4c4fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:37.224681 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b1109-e759-4441-b47e-4e9c4a4c4fe8 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:37.225999 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b1109-e759-4441-b47e-4e9c4a4c4fe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:37.226308 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b1109-e759-4441-b47e-4e9c4a4c4fe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:37.227705 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b1109-e759-4441-b47e-4e9c4a4c4fe8 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:37.246019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 251/514] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:37.246954 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b1109-e759-4441-b47e-4e9c4a4c4fe8 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:37.301914 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:37.312450 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f797b-c3f1-41ee-8bc0-8b24792a8805 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:37.353574 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0a78d-ee94-4346-a369-c9d6ecb3ca05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:37.354248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0a78d-ee94-4346-a369-c9d6ecb3ca05 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:37.354537 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0a78d-ee94-4346-a369-c9d6ecb3ca05 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:37.354823 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0a78d-ee94-4346-a369-c9d6ecb3ca05 None admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:37.355669 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0a78d-ee94-4346-a369-c9d6ecb3ca05 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:37.355983 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0a78d-ee94-4346-a369-c9d6ecb3ca05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:37.356347 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b1109-e759-4441-b47e-4e9c4a4c4fe8 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:37.357499 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0a78d-ee94-4346-a369-c9d6ecb3ca05 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:37.376718 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 264/515] 10.222.0.46 () {56 vars in 1137 bytes} [Wed Jun 22 09:59:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:37.377597 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0a78d-ee94-4346-a369-c9d6ecb3ca05 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:37.391235 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5168e2-f701-44e6-a4fc-360de519582b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:37.392032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5168e2-f701-44e6-a4fc-360de519582b None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:37.392318 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5168e2-f701-44e6-a4fc-360de519582b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:37.392597 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5168e2-f701-44e6-a4fc-360de519582b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:37.395149 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:37.403976 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5168e2-f701-44e6-a4fc-360de519582b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:37.405506 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5168e2-f701-44e6-a4fc-360de519582b None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:37.422984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-8b5168e2-f701-44e6-a4fc-360de519582b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:37.422984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:37.422984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:37.422984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:37.422984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:37.422984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:37.422984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:37.422984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:37.422984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:37.422984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:37.422984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:37.422984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:37.422984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:37.422984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:37.422984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:37.423977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:37.423977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:37.423977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:37.423977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:37.423977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:37.423977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:37.423977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:37.423977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:37.423977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:37.423977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:37.423977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:37.423977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:37.423977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:37.423977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:37.423977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:37.423977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:37.423977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:37.424885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:37.424885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:37.424885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:37.424885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:37.424885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 252/516] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:37.425172 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5168e2-f701-44e6-a4fc-360de519582b None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:37.481434 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0a78d-ee94-4346-a369-c9d6ecb3ca05 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:37.515236 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6188dd-1f31-4df6-8cf6-26b38a7a2442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:37.515912 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6188dd-1f31-4df6-8cf6-26b38a7a2442 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:37.516198 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6188dd-1f31-4df6-8cf6-26b38a7a2442 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:37.516478 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6188dd-1f31-4df6-8cf6-26b38a7a2442 None admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:37.517349 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6188dd-1f31-4df6-8cf6-26b38a7a2442 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:37.517658 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6188dd-1f31-4df6-8cf6-26b38a7a2442 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:37.519102 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6188dd-1f31-4df6-8cf6-26b38a7a2442 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:37.521611 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5168e2-f701-44e6-a4fc-360de519582b None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:37.531118 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:37.535786 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 265/517] 10.222.0.46 () {56 vars in 1137 bytes} [Wed Jun 22 09:59:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:37.536607 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6188dd-1f31-4df6-8cf6-26b38a7a2442 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:37.556973 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff0811-1fcc-4891-86f0-38a1a27e9301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:37.557642 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff0811-1fcc-4891-86f0-38a1a27e9301 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:37.557930 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff0811-1fcc-4891-86f0-38a1a27e9301 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:37.558213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff0811-1fcc-4891-86f0-38a1a27e9301 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:37.559070 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff0811-1fcc-4891-86f0-38a1a27e9301 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:37.559386 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff0811-1fcc-4891-86f0-38a1a27e9301 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:37.560848 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff0811-1fcc-4891-86f0-38a1a27e9301 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:37.579436 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 253/518] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 09:59:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:37.581201 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff0811-1fcc-4891-86f0-38a1a27e9301 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:37.625520 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:37.650552 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6188dd-1f31-4df6-8cf6-26b38a7a2442 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:37.689675 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff0811-1fcc-4891-86f0-38a1a27e9301 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:37.691953 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8429e34-b4fa-4df8-b153-42d7a085c63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:37.692843 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8429e34-b4fa-4df8-b153-42d7a085c63f None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:37.693149 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8429e34-b4fa-4df8-b153-42d7a085c63f None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:37.693423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8429e34-b4fa-4df8-b153-42d7a085c63f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:37.700735 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8429e34-b4fa-4df8-b153-42d7a085c63f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:37.702209 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8429e34-b4fa-4df8-b153-42d7a085c63f None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:37.717036 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-a8429e34-b4fa-4df8-b153-42d7a085c63f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 09:59:37.717036 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:37.717036 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:37.717036 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:37.717036 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:37.717036 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:37.717036 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:37.717036 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:37.717036 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:37.717036 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:37.717036 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:37.717036 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:37.717036 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 09:59:37.717036 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 09:59:37.717036 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 09:59:37.717036 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 09:59:37.718098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:37.718098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:37.718098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 09:59:37.718098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 09:59:37.718098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 09:59:37.718098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 09:59:37.718098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:37.718098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:37.718098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:37.718098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:37.718098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:37.718098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:37.718098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:37.718098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:37.718098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:37.718098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:37.718098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:37.718098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:37.723716 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:37.723716 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:37.723716 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 09:59:37.723716 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 09:59:37.723716 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 09:59:37.723716 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 09:59:37.723716 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 09:59:37.723716 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 09:59:37.723716 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 09:59:37.723716 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:37.723716 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 266/519] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 22 09:59:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:37.723716 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8429e34-b4fa-4df8-b153-42d7a085c63f None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:37.726880 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1159a-fe64-49be-a56f-e7d26a7374c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:37.726880 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1159a-fe64-49be-a56f-e7d26a7374c1 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:37.727094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1159a-fe64-49be-a56f-e7d26a7374c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:37.727269 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1159a-fe64-49be-a56f-e7d26a7374c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:37.760766 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:37.794503 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1159a-fe64-49be-a56f-e7d26a7374c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:37.796057 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1159a-fe64-49be-a56f-e7d26a7374c1 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:37.822738 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8429e34-b4fa-4df8-b153-42d7a085c63f None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:37.856671 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c22d7-45f8-4f0e-a48d-fb213788a837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:37.857359 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c22d7-45f8-4f0e-a48d-fb213788a837 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:37.857649 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c22d7-45f8-4f0e-a48d-fb213788a837 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:37.857924 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c22d7-45f8-4f0e-a48d-fb213788a837 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:37.858646 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c22d7-45f8-4f0e-a48d-fb213788a837 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:37.858954 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c22d7-45f8-4f0e-a48d-fb213788a837 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:37.860323 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c22d7-45f8-4f0e-a48d-fb213788a837 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:37.861836 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:37.872503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 267/520] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:37.873602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c22d7-45f8-4f0e-a48d-fb213788a837 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:37.899295 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 254/521] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:59:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 09:59:37.900135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1159a-fe64-49be-a56f-e7d26a7374c1 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:37.965033 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:37.974492 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c22d7-45f8-4f0e-a48d-fb213788a837 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:37.998355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1159a-fe64-49be-a56f-e7d26a7374c1 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:38.008715 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1f734-59d8-476a-bee0-bd10ed67449c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:38.009391 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1f734-59d8-476a-bee0-bd10ed67449c None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:38.009691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1f734-59d8-476a-bee0-bd10ed67449c None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:38.009962 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1f734-59d8-476a-bee0-bd10ed67449c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:38.031943 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a28889-9ab5-4061-b3ac-2d40be5458a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:38.032524 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a28889-9ab5-4061-b3ac-2d40be5458a7 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:38.032810 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a28889-9ab5-4061-b3ac-2d40be5458a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:38.033124 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a28889-9ab5-4061-b3ac-2d40be5458a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:38.033954 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a28889-9ab5-4061-b3ac-2d40be5458a7 None admin] RBAC: Adding query filter params (role.id=604a13bdd0fd46e182a9749de3b5232d, scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9, user.id=4ed9a00723ab4af2b633ab7614d178a8) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:38.034265 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a28889-9ab5-4061-b3ac-2d40be5458a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:38.035713 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a28889-9ab5-4061-b3ac-2d40be5458a7 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:38.041115 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 255/522] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 09:59:37 2022] GET /identity/v3/role_assignments?user.id=4ed9a00723ab4af2b633ab7614d178a8&scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9&role.id=604a13bdd0fd46e182a9749de3b5232d => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:38.041894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a28889-9ab5-4061-b3ac-2d40be5458a7 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:38.078679 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:38.088360 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1f734-59d8-476a-bee0-bd10ed67449c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:38.090549 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1f734-59d8-476a-bee0-bd10ed67449c None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:38.158127 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a28889-9ab5-4061-b3ac-2d40be5458a7 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:38.190092 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:38.197908 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c70c3-049b-41ac-a1f1-8d6c98301104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:38.198590 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c70c3-049b-41ac-a1f1-8d6c98301104 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:38.198878 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c70c3-049b-41ac-a1f1-8d6c98301104 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:38.199159 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c70c3-049b-41ac-a1f1-8d6c98301104 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:38.200014 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c70c3-049b-41ac-a1f1-8d6c98301104 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:38.201180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c70c3-049b-41ac-a1f1-8d6c98301104 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:38.201805 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c70c3-049b-41ac-a1f1-8d6c98301104 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:38.211339 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 268/523] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:59:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 09:59:38.212991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1f734-59d8-476a-bee0-bd10ed67449c None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:38.246253 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 256/524] 10.222.0.46 () {56 vars in 1139 bytes} [Wed Jun 22 09:59:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:38.247061 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c70c3-049b-41ac-a1f1-8d6c98301104 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:38.308021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:38.314689 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1f734-59d8-476a-bee0-bd10ed67449c None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:38.350471 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468ba14-e1bf-4f53-b1d1-be81707fdfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:38.351189 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468ba14-e1bf-4f53-b1d1-be81707fdfa4 None admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:38.351478 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468ba14-e1bf-4f53-b1d1-be81707fdfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:38.351758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468ba14-e1bf-4f53-b1d1-be81707fdfa4 None admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:38.352467 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468ba14-e1bf-4f53-b1d1-be81707fdfa4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:38.353983 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468ba14-e1bf-4f53-b1d1-be81707fdfa4 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:38.368442 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c70c3-049b-41ac-a1f1-8d6c98301104 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:38.408532 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b52bea-f925-4687-ae31-cf82d5a653b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:38.409449 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b52bea-f925-4687-ae31-cf82d5a653b3 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:38.409731 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b52bea-f925-4687-ae31-cf82d5a653b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:38.410009 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b52bea-f925-4687-ae31-cf82d5a653b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:38.419954 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b52bea-f925-4687-ae31-cf82d5a653b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:38.421496 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b52bea-f925-4687-ae31-cf82d5a653b3 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:38.439439 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-88b52bea-f925-4687-ae31-cf82d5a653b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:38.439439 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:38.439439 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:38.439439 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:38.439439 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:38.439439 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:38.439439 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:38.439439 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:38.439439 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:38.439439 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:38.439439 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:38.439439 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:38.439439 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:38.439439 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:38.439439 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:38.440304 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:38.440304 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:38.440304 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:38.440304 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:38.440304 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:38.440304 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:38.440304 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:38.440304 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:38.440304 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:38.440304 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:38.440304 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:38.440304 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:38.440304 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:38.440304 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:38.440304 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:38.440304 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:38.440304 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:38.441567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:38.441567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:38.441567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:38.441567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:38.441567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 257/525] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:38.441934 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b52bea-f925-4687-ae31-cf82d5a653b3 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:38.454906 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 269/526] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 22 09:59:38 2022] POST /identity/v3/users => generated 247 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:59:38.456072 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468ba14-e1bf-4f53-b1d1-be81707fdfa4 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:38.509208 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:38.586408 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b52bea-f925-4687-ae31-cf82d5a653b3 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:38.589557 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468ba14-e1bf-4f53-b1d1-be81707fdfa4 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:38.634958 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df10157-e73e-4ea6-acfd-4e3181ceb79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:38.635750 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df10157-e73e-4ea6-acfd-4e3181ceb79c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:38.636032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df10157-e73e-4ea6-acfd-4e3181ceb79c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:38.636350 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df10157-e73e-4ea6-acfd-4e3181ceb79c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:38.637119 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5a364-8ee7-4a0e-8370-3d0f218e7ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:38.637876 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5a364-8ee7-4a0e-8370-3d0f218e7ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:38.638263 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5a364-8ee7-4a0e-8370-3d0f218e7ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:38.638643 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5a364-8ee7-4a0e-8370-3d0f218e7ed8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:38.650123 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df10157-e73e-4ea6-acfd-4e3181ceb79c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:38.652379 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df10157-e73e-4ea6-acfd-4e3181ceb79c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:38.660138 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:38.670509 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-2df10157-e73e-4ea6-acfd-4e3181ceb79c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:38.670509 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:38.670509 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:38.670509 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:38.670509 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:38.670509 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:38.670509 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:38.670509 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:38.670509 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:38.670509 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:38.670509 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:38.670509 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:38.670509 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:38.670509 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:38.670509 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:38.677572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:38.677572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:38.677572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:38.677572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:38.677572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:38.677572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:38.677572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:38.677572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:38.677572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:38.677572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:38.677572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:38.677572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:38.677572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:38.677572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:38.677572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:38.677572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:38.677572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:38.682564 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:38.682564 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:38.682564 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:38.682564 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:38.682564 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 258/527] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:38.682564 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df10157-e73e-4ea6-acfd-4e3181ceb79c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:38.732416 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5a364-8ee7-4a0e-8370-3d0f218e7ed8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:38.743569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5a364-8ee7-4a0e-8370-3d0f218e7ed8 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:38.801781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:38.808789 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df10157-e73e-4ea6-acfd-4e3181ceb79c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:38.844787 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522f297-4097-4a3c-9e60-4521c6266a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:38.845487 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522f297-4097-4a3c-9e60-4521c6266a78 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:38.845774 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522f297-4097-4a3c-9e60-4521c6266a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:38.846056 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522f297-4097-4a3c-9e60-4521c6266a78 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:38.846842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522f297-4097-4a3c-9e60-4521c6266a78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:38.847157 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522f297-4097-4a3c-9e60-4521c6266a78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:38.848549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522f297-4097-4a3c-9e60-4521c6266a78 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:38.865221 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 259/528] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:38.866693 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522f297-4097-4a3c-9e60-4521c6266a78 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:38.875696 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 270/529] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:59:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 09:59:38.877135 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5a364-8ee7-4a0e-8370-3d0f218e7ed8 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:38.956159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:38.987767 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522f297-4097-4a3c-9e60-4521c6266a78 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:39.011106 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5a364-8ee7-4a0e-8370-3d0f218e7ed8 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:39.024201 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8147c1a-d3de-4931-915f-04b96a2ea245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:39.025041 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8147c1a-d3de-4931-915f-04b96a2ea245 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:39.025443 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8147c1a-d3de-4931-915f-04b96a2ea245 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:39.025907 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8147c1a-d3de-4931-915f-04b96a2ea245 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:39.027066 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8147c1a-d3de-4931-915f-04b96a2ea245 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:39.027206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8147c1a-d3de-4931-915f-04b96a2ea245 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:39.028670 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8147c1a-d3de-4931-915f-04b96a2ea245 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:39.041858 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 260/530] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:39.043969 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8147c1a-d3de-4931-915f-04b96a2ea245 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:39.050860 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656b7bb-ba53-4aee-a214-50c1e0d10603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:39.052037 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656b7bb-ba53-4aee-a214-50c1e0d10603 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:39.052458 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656b7bb-ba53-4aee-a214-50c1e0d10603 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:39.052903 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656b7bb-ba53-4aee-a214-50c1e0d10603 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:39.061061 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9656b7bb-ba53-4aee-a214-50c1e0d10603 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:39.062763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9656b7bb-ba53-4aee-a214-50c1e0d10603 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:39.077083 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-9656b7bb-ba53-4aee-a214-50c1e0d10603 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 09:59:39.077083 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:39.077083 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:39.077083 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:39.077083 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:39.077083 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:39.077083 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:39.077083 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:39.077083 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:39.077083 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:39.077083 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:39.077083 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:39.077083 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 09:59:39.077083 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 09:59:39.077083 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 09:59:39.078116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 09:59:39.078116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:39.078116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:39.078116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:39.078116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:39.078116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:39.078116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:39.078116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:39.078116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:39.078116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:39.078116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:39.078116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:39.078116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:39.078116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:39.078116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:39.078116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:39.078116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:39.079058 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 09:59:39.079058 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 09:59:39.079058 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 09:59:39.079058 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 09:59:39.079058 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 09:59:39.079058 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 09:59:39.079058 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 09:59:39.079058 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:39.085183 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 271/531] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 09:59:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:39.086280 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656b7bb-ba53-4aee-a214-50c1e0d10603 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:39.088318 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:39.158660 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8147c1a-d3de-4931-915f-04b96a2ea245 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:39.196693 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656b7bb-ba53-4aee-a214-50c1e0d10603 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:39.197051 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bcb338-57c2-49b9-8ec6-60ed1454c71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:39.197975 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcb338-57c2-49b9-8ec6-60ed1454c71e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:39.198349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcb338-57c2-49b9-8ec6-60ed1454c71e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:39.198719 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcb338-57c2-49b9-8ec6-60ed1454c71e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:39.209191 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:39.211743 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bcb338-57c2-49b9-8ec6-60ed1454c71e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:39.213347 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bcb338-57c2-49b9-8ec6-60ed1454c71e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:39.234608 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fd8fd-15e1-40d0-83ca-b6a222ef16d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:39.235142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-00bcb338-57c2-49b9-8ec6-60ed1454c71e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:39.235142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:39.235142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:39.235142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:39.235142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:39.235142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:39.235142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:39.235142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:39.235142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:39.235142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:39.235142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:39.235142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:39.235142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:39.235142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:39.235142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:39.235997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:39.235997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:39.235997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:39.235997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:39.235997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:39.235997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:39.235997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:39.235997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:39.235997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:39.235997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:39.235997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:39.235997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:39.235997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:39.235997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:39.235997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:39.235997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:39.235997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:39.236844 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:39.236844 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:39.236844 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:39.236844 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:39.238236 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fd8fd-15e1-40d0-83ca-b6a222ef16d7 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:39.238685 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fd8fd-15e1-40d0-83ca-b6a222ef16d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:39.239120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fd8fd-15e1-40d0-83ca-b6a222ef16d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:39.241634 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 261/532] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:39.242957 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bcb338-57c2-49b9-8ec6-60ed1454c71e None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:39.252309 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fd8fd-15e1-40d0-83ca-b6a222ef16d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:39.253903 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fd8fd-15e1-40d0-83ca-b6a222ef16d7 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:39.275708 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-c29fd8fd-15e1-40d0-83ca-b6a222ef16d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 09:59:39.275708 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:39.275708 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:39.275708 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:39.275708 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:39.275708 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:39.275708 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:39.275708 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:39.275708 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:39.275708 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:39.275708 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:39.275708 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:39.275708 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 09:59:39.275708 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 09:59:39.275708 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 09:59:39.276632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 09:59:39.276632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:39.276632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:39.276632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:39.276632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:39.276632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:39.276632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:39.276632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:39.276632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:39.276632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:39.276632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:39.276632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:39.276632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:39.276632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:39.276632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:39.276632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:39.276632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:39.280865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 09:59:39.280865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 09:59:39.280865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 09:59:39.280865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 09:59:39.280865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 09:59:39.280865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 09:59:39.280865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 09:59:39.280865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:39.281853 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 272/533] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 09:59:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:39.282735 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fd8fd-15e1-40d0-83ca-b6a222ef16d7 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:39.335816 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:39.383584 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bcb338-57c2-49b9-8ec6-60ed1454c71e None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:39.411538 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fd8fd-15e1-40d0-83ca-b6a222ef16d7 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:39.430330 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe9300-d7c1-4631-ae66-fc5569e97bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:39.430994 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe9300-d7c1-4631-ae66-fc5569e97bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:39.431277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe9300-d7c1-4631-ae66-fc5569e97bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:39.431556 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe9300-d7c1-4631-ae66-fc5569e97bd6 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:39.432348 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe9300-d7c1-4631-ae66-fc5569e97bd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:39.432660 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe9300-d7c1-4631-ae66-fc5569e97bd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:39.434642 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe9300-d7c1-4631-ae66-fc5569e97bd6 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:39.449229 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd0719-3756-48ee-b4b4-ae1de7367257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:39.454668 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd0719-3756-48ee-b4b4-ae1de7367257 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:39.454793 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 262/534] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 09:59:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:39.454793 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe9300-d7c1-4631-ae66-fc5569e97bd6 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:39.455852 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd0719-3756-48ee-b4b4-ae1de7367257 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:39.456362 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd0719-3756-48ee-b4b4-ae1de7367257 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:39.457476 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd0719-3756-48ee-b4b4-ae1de7367257 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:39.458036 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd0719-3756-48ee-b4b4-ae1de7367257 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:39.460212 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd0719-3756-48ee-b4b4-ae1de7367257 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:39.472599 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 273/535] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:39.473745 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd0719-3756-48ee-b4b4-ae1de7367257 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:39.511347 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:39.587477 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd0719-3756-48ee-b4b4-ae1de7367257 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:39.591730 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe9300-d7c1-4631-ae66-fc5569e97bd6 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:39.626474 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:39.626851 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1dcf6-a44a-4c75-8a04-a071d864d353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:39.627779 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1dcf6-a44a-4c75-8a04-a071d864d353 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:39.628258 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1dcf6-a44a-4c75-8a04-a071d864d353 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:39.628727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1dcf6-a44a-4c75-8a04-a071d864d353 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:39.632790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae1dcf6-a44a-4c75-8a04-a071d864d353 None admin] RBAC: Adding query filter params (role.id=604a13bdd0fd46e182a9749de3b5232d, scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9, user.id=6eea844b342b418895d08eef368bbd24) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:39.633358 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae1dcf6-a44a-4c75-8a04-a071d864d353 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:39.635015 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae1dcf6-a44a-4c75-8a04-a071d864d353 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:39.636026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e01824-d8fb-48f3-9a99-7aba4cdb97e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:39.636735 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e01824-d8fb-48f3-9a99-7aba4cdb97e5 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:39.637039 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e01824-d8fb-48f3-9a99-7aba4cdb97e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:39.637315 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e01824-d8fb-48f3-9a99-7aba4cdb97e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:39.639780 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e01824-d8fb-48f3-9a99-7aba4cdb97e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:39.639780 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e01824-d8fb-48f3-9a99-7aba4cdb97e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:39.641193 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e01824-d8fb-48f3-9a99-7aba4cdb97e5 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:39.649142 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 274/536] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 09:59:39 2022] GET /identity/v3/role_assignments?user.id=6eea844b342b418895d08eef368bbd24&scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9&role.id=604a13bdd0fd46e182a9749de3b5232d => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:39.650470 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1dcf6-a44a-4c75-8a04-a071d864d353 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:39.655594 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 263/537] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 09:59:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:39.669001 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e01824-d8fb-48f3-9a99-7aba4cdb97e5 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:39.800902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e01824-d8fb-48f3-9a99-7aba4cdb97e5 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:39.843448 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19685720-869d-44cc-b9d5-b1a77e60602d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:39.844124 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19685720-869d-44cc-b9d5-b1a77e60602d None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:39.844407 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19685720-869d-44cc-b9d5-b1a77e60602d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:39.844683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19685720-869d-44cc-b9d5-b1a77e60602d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:39.845551 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19685720-869d-44cc-b9d5-b1a77e60602d None admin] RBAC: Adding query filter params (role.id=604a13bdd0fd46e182a9749de3b5232d, scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9, user.id=4a4fbf9b051940bd82547a700796d118) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:39.845860 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19685720-869d-44cc-b9d5-b1a77e60602d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:39.847461 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19685720-869d-44cc-b9d5-b1a77e60602d None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:39.860842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 264/538] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 09:59:39 2022] GET /identity/v3/role_assignments?user.id=4a4fbf9b051940bd82547a700796d118&scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9&role.id=604a13bdd0fd46e182a9749de3b5232d => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:39.903000 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:39.910266 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1dcf6-a44a-4c75-8a04-a071d864d353 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:39.952038 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59aada0-4795-404a-9fc1-09ded6f338d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:39.952771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59aada0-4795-404a-9fc1-09ded6f338d4 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:39.953089 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59aada0-4795-404a-9fc1-09ded6f338d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:39.953367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59aada0-4795-404a-9fc1-09ded6f338d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:39.962298 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59aada0-4795-404a-9fc1-09ded6f338d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:39.963864 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59aada0-4795-404a-9fc1-09ded6f338d4 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:39.980126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-c59aada0-4795-404a-9fc1-09ded6f338d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 09:59:39.980126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:39.980126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:39.980126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:39.980126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:39.980126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:39.980126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:39.980126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:39.980126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:39.980126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:39.980126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:39.980126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:39.980126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 09:59:39.980126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 09:59:39.980126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 09:59:39.981066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 09:59:39.981066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:39.981066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:39.981066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:39.981066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:39.981066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:39.981066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:39.981066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:39.981066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:39.981066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:39.981066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:39.981066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:39.981066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:39.981066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:39.981066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:39.981066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:39.981066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:39.981910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 09:59:39.981910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 09:59:39.981910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 09:59:39.981910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 09:59:39.981910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 09:59:39.981910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 09:59:39.981910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 09:59:39.981910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:39.986162 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 275/539] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 09:59:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:39.987637 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19685720-869d-44cc-b9d5-b1a77e60602d None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:40.044898 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:40.097267 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19685720-869d-44cc-b9d5-b1a77e60602d None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:40.133065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1f250-467d-4ff1-866e-a903ac8692b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:40.133728 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1f250-467d-4ff1-866e-a903ac8692b8 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:40.134010 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1f250-467d-4ff1-866e-a903ac8692b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:40.134288 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1f250-467d-4ff1-866e-a903ac8692b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:40.135078 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1f250-467d-4ff1-866e-a903ac8692b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:40.135388 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1f250-467d-4ff1-866e-a903ac8692b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:40.136829 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1f250-467d-4ff1-866e-a903ac8692b8 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:40.153207 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 265/540] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 09:59:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:40.156256 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59aada0-4795-404a-9fc1-09ded6f338d4 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:40.216395 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a0276-a350-44b6-88ab-1f77eacd0d25 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:40.216704 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a0276-a350-44b6-88ab-1f77eacd0d25 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:40.217014 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a0276-a350-44b6-88ab-1f77eacd0d25 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:40.218509 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 266/541] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:40.224050 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283202db-2e28-4ffb-b3d3-3a81fcf70971 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:40.224607 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283202db-2e28-4ffb-b3d3-3a81fcf70971 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:40.225730 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283202db-2e28-4ffb-b3d3-3a81fcf70971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:40.245851 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-283202db-2e28-4ffb-b3d3-3a81fcf70971 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:40.247427 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-283202db-2e28-4ffb-b3d3-3a81fcf70971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:40.310231 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59aada0-4795-404a-9fc1-09ded6f338d4 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:40.349557 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54907c-4d90-41e9-8d1a-8ecae7ba7693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:40.352182 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54907c-4d90-41e9-8d1a-8ecae7ba7693 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:40.353198 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54907c-4d90-41e9-8d1a-8ecae7ba7693 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:40.353695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54907c-4d90-41e9-8d1a-8ecae7ba7693 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:40.354788 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54907c-4d90-41e9-8d1a-8ecae7ba7693 None admin] RBAC: Adding query filter params (role.id=604a13bdd0fd46e182a9749de3b5232d, scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9, user.id=0bddc02875304e8c92ac367c8095efee) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:40.355627 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54907c-4d90-41e9-8d1a-8ecae7ba7693 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:40.357526 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54907c-4d90-41e9-8d1a-8ecae7ba7693 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:40.365362 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 276/542] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 09:59:40 2022] GET /identity/v3/role_assignments?user.id=0bddc02875304e8c92ac367c8095efee&scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9&role.id=604a13bdd0fd46e182a9749de3b5232d => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:40.388801 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 267/543] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 09:59:40.430772 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54907c-4d90-41e9-8d1a-8ecae7ba7693 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:40.462489 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:40.568556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54907c-4d90-41e9-8d1a-8ecae7ba7693 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:40.609527 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ac0aa-74b5-4153-92e3-3f8be5c34f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:40.610707 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ac0aa-74b5-4153-92e3-3f8be5c34f24 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:40.611208 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ac0aa-74b5-4153-92e3-3f8be5c34f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:40.611695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ac0aa-74b5-4153-92e3-3f8be5c34f24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:40.627352 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ac0aa-74b5-4153-92e3-3f8be5c34f24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:40.636111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-622ac0aa-74b5-4153-92e3-3f8be5c34f24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 09:59:40.636111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:40.636111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:40.636111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:40.636111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:40.636111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:40.636111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:40.636111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:40.636111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:40.636111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:40.636111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:40.636111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:40.636111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:40.636111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:40.636111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:40.636111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:40.637038 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:40.637038 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:40.637038 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:40.637038 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:40.637038 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:40.637038 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:40.637038 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:40.637038 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:40.637038 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:40.637038 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:40.637038 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:40.637038 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:40.637038 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:40.637038 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:40.637038 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:40.637038 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:40.637838 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:40.637838 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:40.637838 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:40.637838 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:40.637838 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:40.637838 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:40.637838 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:40.637838 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:40.637838 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:40.637838 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:40.637838 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 09:59:40.637838 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:40.640520 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 277/544] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 22 09:59:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:40.646857 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283202db-2e28-4ffb-b3d3-3a81fcf70971 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:40.703847 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:40.772325 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283202db-2e28-4ffb-b3d3-3a81fcf70971 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:40.808098 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544c0de-8de6-476e-a278-460d1ec953e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:40.808776 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544c0de-8de6-476e-a278-460d1ec953e7 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:40.809089 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544c0de-8de6-476e-a278-460d1ec953e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:40.809677 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544c0de-8de6-476e-a278-460d1ec953e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:40.810990 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544c0de-8de6-476e-a278-460d1ec953e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:40.811523 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544c0de-8de6-476e-a278-460d1ec953e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:40.813522 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544c0de-8de6-476e-a278-460d1ec953e7 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:40.822663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 268/545] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 22 09:59:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:40.828179 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ac0aa-74b5-4153-92e3-3f8be5c34f24 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:40.866786 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a702d-9746-4283-879b-a0a4b15169ac None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:40.867129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a702d-9746-4283-879b-a0a4b15169ac None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:40.867346 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a702d-9746-4283-879b-a0a4b15169ac None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:40.868715 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 269/546] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 09:59:40.878012 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e176bd-db23-4554-bef7-bfbc96745a44 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:40.878299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e176bd-db23-4554-bef7-bfbc96745a44 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:40.878581 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e176bd-db23-4554-bef7-bfbc96745a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:40.903825 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-34e176bd-db23-4554-bef7-bfbc96745a44 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:40.906147 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-34e176bd-db23-4554-bef7-bfbc96745a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:40.949212 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:41.002274 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ac0aa-74b5-4153-92e3-3f8be5c34f24 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:41.029817 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 270/547] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 09:59:41.048160 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce60f9-e0ef-4b29-98b5-64c1cc38cdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:41.048983 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce60f9-e0ef-4b29-98b5-64c1cc38cdd6 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:41.049263 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce60f9-e0ef-4b29-98b5-64c1cc38cdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:41.049536 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce60f9-e0ef-4b29-98b5-64c1cc38cdd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:41.060088 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e176bd-db23-4554-bef7-bfbc96745a44 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:41.072975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce60f9-e0ef-4b29-98b5-64c1cc38cdd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:41.074477 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce60f9-e0ef-4b29-98b5-64c1cc38cdd6 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:41.109742 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-9cce60f9-e0ef-4b29-98b5-64c1cc38cdd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:41.109742 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:41.109742 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:41.109742 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:41.109742 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:41.109742 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:41.109742 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:41.109742 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:41.109742 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:41.109742 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:41.109742 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:41.109742 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:41.109742 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:41.109742 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:41.109742 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:41.110657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:41.110657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:41.110657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:41.110657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:41.110657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:41.110657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:41.110657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:41.110657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:41.110657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:41.110657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:41.110657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:41.110657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:41.110657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:41.110657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:41.110657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:41.110657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:41.110657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:41.112107 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:41.112107 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:41.112107 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:41.112107 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:41.112791 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 278/548] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:41.113259 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:41.125409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce60f9-e0ef-4b29-98b5-64c1cc38cdd6 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:41.231692 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e176bd-db23-4554-bef7-bfbc96745a44 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:41.245385 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce60f9-e0ef-4b29-98b5-64c1cc38cdd6 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:41.281587 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9648462-ef08-4ddf-81a0-b422d7ad1348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:41.282414 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9648462-ef08-4ddf-81a0-b422d7ad1348 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:41.282697 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9648462-ef08-4ddf-81a0-b422d7ad1348 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:41.282972 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9648462-ef08-4ddf-81a0-b422d7ad1348 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:41.285067 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5483621-1ba9-4ab3-af07-1fd028f938a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:41.285967 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5483621-1ba9-4ab3-af07-1fd028f938a6 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:41.286532 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5483621-1ba9-4ab3-af07-1fd028f938a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:41.286992 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5483621-1ba9-4ab3-af07-1fd028f938a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:41.288502 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5483621-1ba9-4ab3-af07-1fd028f938a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:41.289019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5483621-1ba9-4ab3-af07-1fd028f938a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:41.293074 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:41.293975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5483621-1ba9-4ab3-af07-1fd028f938a6 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:41.308464 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9648462-ef08-4ddf-81a0-b422d7ad1348 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:41.318053 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-c9648462-ef08-4ddf-81a0-b422d7ad1348 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 09:59:41.318053 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:41.318053 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:41.318053 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:41.318053 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:41.318053 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:41.318053 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:41.318053 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:41.318053 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:41.318053 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:41.318053 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:41.318053 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:41.318053 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:41.318053 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:41.318053 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:41.318053 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:41.319103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:41.319103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:41.319103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:41.319103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:41.319103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:41.319103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:41.319103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:41.319103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:41.319103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:41.319103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:41.319103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:41.319103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:41.319103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:41.319103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:41.319103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:41.319103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:41.320375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:41.320375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:41.320375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:41.320375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:41.320375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:41.320375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:41.320375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:41.320375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:41.320375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:41.320375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:41.320375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 09:59:41.320375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:41.320375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 271/549] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 22 09:59:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 09:59:41.322668 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 279/550] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:41.327122 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5483621-1ba9-4ab3-af07-1fd028f938a6 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:41.328361 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9648462-ef08-4ddf-81a0-b422d7ad1348 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:41.453116 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:41.463816 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9648462-ef08-4ddf-81a0-b422d7ad1348 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:41.516980 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf2b34-87ab-4b1a-87de-538ea76f3c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:41.517653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf2b34-87ab-4b1a-87de-538ea76f3c15 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:41.517937 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf2b34-87ab-4b1a-87de-538ea76f3c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:41.518206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf2b34-87ab-4b1a-87de-538ea76f3c15 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:41.518958 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf2b34-87ab-4b1a-87de-538ea76f3c15 None admin] RBAC: Adding query filter params (name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:41.519267 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf2b34-87ab-4b1a-87de-538ea76f3c15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:41.523723 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf2b34-87ab-4b1a-87de-538ea76f3c15 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:41.539531 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 272/551] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 22 09:59:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:41.544962 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf2b34-87ab-4b1a-87de-538ea76f3c15 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:41.565913 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5483621-1ba9-4ab3-af07-1fd028f938a6 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:41.634340 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a9dc1-7177-463f-b92c-340b7fef3b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:41.635061 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a9dc1-7177-463f-b92c-340b7fef3b8f None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:41.635342 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a9dc1-7177-463f-b92c-340b7fef3b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:41.635622 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a9dc1-7177-463f-b92c-340b7fef3b8f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:41.649861 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a9dc1-7177-463f-b92c-340b7fef3b8f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:41.652571 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a9dc1-7177-463f-b92c-340b7fef3b8f None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:41.678822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-562a9dc1-7177-463f-b92c-340b7fef3b8f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 09:59:41.678822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:41.678822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:41.678822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:41.678822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:41.678822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:41.678822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:41.678822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:41.678822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:41.678822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:41.678822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:41.678822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:41.678822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 09:59:41.678822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 09:59:41.678822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 09:59:41.678822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 09:59:41.679800 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:41.679800 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:41.679800 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 09:59:41.679800 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 09:59:41.679800 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 09:59:41.679800 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 09:59:41.679800 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:41.679800 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:41.679800 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:41.679800 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:41.679800 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:41.679800 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:41.679800 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:41.679800 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:41.679800 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:41.679800 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:41.679800 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:41.679800 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:41.681637 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:41.681637 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:41.681637 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 09:59:41.681637 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 09:59:41.681637 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 09:59:41.681637 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 09:59:41.681637 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 09:59:41.681637 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 09:59:41.681637 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 09:59:41.681637 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:41.681637 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 280/552] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Jun 22 09:59:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 09:59:41.686130 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a9dc1-7177-463f-b92c-340b7fef3b8f None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:41.747176 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:41.760956 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf2b34-87ab-4b1a-87de-538ea76f3c15 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:41.799987 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a9dc1-7177-463f-b92c-340b7fef3b8f None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:41.809588 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80fc8a-aaaa-4a87-bfbd-6d903594ed8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:41.810420 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80fc8a-aaaa-4a87-bfbd-6d903594ed8a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:41.810708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80fc8a-aaaa-4a87-bfbd-6d903594ed8a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:41.810988 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80fc8a-aaaa-4a87-bfbd-6d903594ed8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:41.831776 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80fc8a-aaaa-4a87-bfbd-6d903594ed8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:41.833295 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80fc8a-aaaa-4a87-bfbd-6d903594ed8a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:41.839696 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de24b76-9531-4c45-ac99-6ee0a3b7e43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:41.840381 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de24b76-9531-4c45-ac99-6ee0a3b7e43b None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:41.840668 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de24b76-9531-4c45-ac99-6ee0a3b7e43b None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:41.840981 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de24b76-9531-4c45-ac99-6ee0a3b7e43b None admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:41.841835 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de24b76-9531-4c45-ac99-6ee0a3b7e43b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:41.842148 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de24b76-9531-4c45-ac99-6ee0a3b7e43b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:41.843601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de24b76-9531-4c45-ac99-6ee0a3b7e43b None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:41.865385 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 281/553] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Jun 22 09:59:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:41.868516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-4a80fc8a-aaaa-4a87-bfbd-6d903594ed8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:41.868516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:41.868516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:41.868516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:41.868516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:41.868516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:41.868516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:41.868516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:41.868516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:41.868516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:41.868516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:41.868516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:41.868516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:41.868516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:41.868516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:41.870759 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:41.870759 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:41.870759 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:41.870759 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:41.870759 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:41.870759 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:41.870759 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:41.870759 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:41.870759 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:41.870759 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:41.870759 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:41.870759 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:41.870759 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:41.870759 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:41.870759 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:41.870759 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:41.870759 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:41.872942 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:41.872942 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:41.872942 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:41.872942 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:41.873446 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de24b76-9531-4c45-ac99-6ee0a3b7e43b None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:41.878466 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 273/554] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:41.890330 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80fc8a-aaaa-4a87-bfbd-6d903594ed8a None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:41.900111 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:41.981358 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de24b76-9531-4c45-ac99-6ee0a3b7e43b None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:41.991877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:42.019360 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1f0ce-9925-48a7-8095-47fdfe0ec05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:42.020177 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1f0ce-9925-48a7-8095-47fdfe0ec05a None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:42.020461 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1f0ce-9925-48a7-8095-47fdfe0ec05a None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:42.020724 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1f0ce-9925-48a7-8095-47fdfe0ec05a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:42.031997 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1f0ce-9925-48a7-8095-47fdfe0ec05a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:42.033597 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1f0ce-9925-48a7-8095-47fdfe0ec05a None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:42.053734 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-22b1f0ce-9925-48a7-8095-47fdfe0ec05a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:42.053734 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:42.053734 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:42.053734 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:42.053734 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:42.053734 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:42.053734 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:42.053734 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:42.053734 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:42.053734 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:42.053734 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:42.053734 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:42.053734 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:42.053734 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:42.053734 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:42.055777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:42.055777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:42.055777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:42.055777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:42.055777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:42.055777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:42.055777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:42.055777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:42.055777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:42.055777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:42.055777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:42.055777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:42.055777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:42.055777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:42.055777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:42.055777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:42.055777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:42.058265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:42.058265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:42.058265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:42.058265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:42.058265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 282/555] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 09:59:42.061216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1f0ce-9925-48a7-8095-47fdfe0ec05a None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:42.131135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80fc8a-aaaa-4a87-bfbd-6d903594ed8a None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:42.167654 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1f0ce-9925-48a7-8095-47fdfe0ec05a None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:42.203445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c5e1e-3347-48fe-8704-fefd53af054c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:42.204234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c5e1e-3347-48fe-8704-fefd53af054c None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:42.204525 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c5e1e-3347-48fe-8704-fefd53af054c None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:42.204893 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c5e1e-3347-48fe-8704-fefd53af054c None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:42.205936 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c5e1e-3347-48fe-8704-fefd53af054c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:42.206252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c5e1e-3347-48fe-8704-fefd53af054c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:42.207627 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8c5e1e-3347-48fe-8704-fefd53af054c None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:42.214591 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4d549-5a9c-47bd-b5b3-3f73bbb31841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:42.215277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4d549-5a9c-47bd-b5b3-3f73bbb31841 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:42.215567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4d549-5a9c-47bd-b5b3-3f73bbb31841 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:42.215848 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4d549-5a9c-47bd-b5b3-3f73bbb31841 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:42.216587 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a4d549-5a9c-47bd-b5b3-3f73bbb31841 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:42.216928 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a4d549-5a9c-47bd-b5b3-3f73bbb31841 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:42.218306 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a4d549-5a9c-47bd-b5b3-3f73bbb31841 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:42.220126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 283/556] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:42.226105 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c5e1e-3347-48fe-8704-fefd53af054c None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:42.244532 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 274/557] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:42.249497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4d549-5a9c-47bd-b5b3-3f73bbb31841 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:42.250237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:42.349092 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:42.391977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4d549-5a9c-47bd-b5b3-3f73bbb31841 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:42.398376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c5e1e-3347-48fe-8704-fefd53af054c None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:42.427592 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0402d88e-5e6b-47b2-9676-4b24f249dbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:42.428954 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402d88e-5e6b-47b2-9676-4b24f249dbb0 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:42.429244 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402d88e-5e6b-47b2-9676-4b24f249dbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:42.429553 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402d88e-5e6b-47b2-9676-4b24f249dbb0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:42.437297 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0402d88e-5e6b-47b2-9676-4b24f249dbb0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:42.438767 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0402d88e-5e6b-47b2-9676-4b24f249dbb0 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:42.445771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e483e-5b5c-4a56-82dc-f64e39c674a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:42.446864 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e483e-5b5c-4a56-82dc-f64e39c674a6 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:42.447342 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e483e-5b5c-4a56-82dc-f64e39c674a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:42.447820 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e483e-5b5c-4a56-82dc-f64e39c674a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:42.453501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-0402d88e-5e6b-47b2-9676-4b24f249dbb0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 09:59:42.453501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:42.453501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:42.453501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:42.453501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:42.453501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:42.453501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:42.453501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:42.453501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:42.453501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:42.453501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:42.453501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:42.453501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 09:59:42.453501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 09:59:42.453501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 09:59:42.453501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 09:59:42.455014 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:42.455014 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:42.455014 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 09:59:42.455014 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 09:59:42.455014 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 09:59:42.455014 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 09:59:42.455014 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:42.455014 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:42.455014 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:42.455014 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:42.455014 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:42.455014 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:42.455014 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:42.455014 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:42.455014 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:42.455014 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:42.455014 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:42.455014 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:42.456283 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:42.456283 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:42.456283 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 09:59:42.456283 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 09:59:42.456283 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 09:59:42.456283 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 09:59:42.456283 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 09:59:42.456283 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 09:59:42.456283 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 09:59:42.456283 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:42.456283 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 275/558] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 09:59:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:42.456892 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce0b96-0b6f-4f35-adfb-86175eecdd15 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:42.456892 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce0b96-0b6f-4f35-adfb-86175eecdd15 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:42.457164 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce0b96-0b6f-4f35-adfb-86175eecdd15 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:42.459332 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e483e-5b5c-4a56-82dc-f64e39c674a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:42.460967 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 276/559] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:42.461270 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e483e-5b5c-4a56-82dc-f64e39c674a6 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:42.462598 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ae7a7-a7aa-4bc6-b8aa-33574fb203f0 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:42.463001 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ae7a7-a7aa-4bc6-b8aa-33574fb203f0 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:42.463284 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ae7a7-a7aa-4bc6-b8aa-33574fb203f0 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:42.468280 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 277/560] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:42.468280 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ae7a7-a7aa-4bc6-b8aa-33574fb203f0 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:42.479751 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-c73e483e-5b5c-4a56-82dc-f64e39c674a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 09:59:42.479751 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:42.479751 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:42.479751 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:42.479751 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:42.479751 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:42.479751 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:42.479751 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:42.479751 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:42.479751 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:42.479751 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:42.479751 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:42.479751 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 09:59:42.479751 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 09:59:42.479751 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 09:59:42.480710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 09:59:42.480710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:42.480710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:42.480710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:42.480710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:42.480710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:42.480710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:42.480710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:42.480710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:42.480710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:42.480710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:42.480710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:42.480710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:42.480710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:42.480710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:42.480710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:42.480710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:42.481648 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 09:59:42.481648 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 09:59:42.481648 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 09:59:42.481648 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 09:59:42.481648 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 09:59:42.481648 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 09:59:42.481648 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 09:59:42.481648 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:42.481648 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 284/561] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 09:59:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 09:59:42.482695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46986893-9664-4196-ab34-f3df400eb2b2 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:42.482979 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46986893-9664-4196-ab34-f3df400eb2b2 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:42.483250 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46986893-9664-4196-ab34-f3df400eb2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:42.501143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-46986893-9664-4196-ab34-f3df400eb2b2 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:42.502321 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-46986893-9664-4196-ab34-f3df400eb2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:42.573341 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ae7a7-a7aa-4bc6-b8aa-33574fb203f0 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:42.576098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 285/562] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:42.577494 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d56c3-7dd1-4556-862d-647d7901efe9 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:42.577789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d56c3-7dd1-4556-862d-647d7901efe9 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:42.578070 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d56c3-7dd1-4556-862d-647d7901efe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:42.597837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-ce3d56c3-7dd1-4556-862d-647d7901efe9 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:42.600449 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-ce3d56c3-7dd1-4556-862d-647d7901efe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:42.603435 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:42.607109 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:42.616176 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40262e7f-27a9-4aef-af00-6f07f2804258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:42.616899 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40262e7f-27a9-4aef-af00-6f07f2804258 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:42.617178 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40262e7f-27a9-4aef-af00-6f07f2804258 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:42.617456 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40262e7f-27a9-4aef-af00-6f07f2804258 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:42.618302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40262e7f-27a9-4aef-af00-6f07f2804258 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:42.618614 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40262e7f-27a9-4aef-af00-6f07f2804258 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:42.620064 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40262e7f-27a9-4aef-af00-6f07f2804258 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:42.637195 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 278/563] 10.222.0.46 () {56 vars in 1135 bytes} [Wed Jun 22 09:59:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:42.638025 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40262e7f-27a9-4aef-af00-6f07f2804258 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:42.688928 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 286/564] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:42.689744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d56c3-7dd1-4556-862d-647d7901efe9 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:42.762462 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40262e7f-27a9-4aef-af00-6f07f2804258 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:42.799718 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d56c3-7dd1-4556-862d-647d7901efe9 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:42.803459 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cecaf7-08ee-48bb-b931-ca8b064646d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:42.804079 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cecaf7-08ee-48bb-b931-ca8b064646d8 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:42.804363 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cecaf7-08ee-48bb-b931-ca8b064646d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:42.804643 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cecaf7-08ee-48bb-b931-ca8b064646d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:42.805550 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cecaf7-08ee-48bb-b931-ca8b064646d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:42.805863 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cecaf7-08ee-48bb-b931-ca8b064646d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:42.807476 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cecaf7-08ee-48bb-b931-ca8b064646d8 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:42.820857 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 279/565] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 09:59:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:42.821617 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cecaf7-08ee-48bb-b931-ca8b064646d8 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:42.845141 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f1377-84cb-46f0-91ca-4984f36391bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:42.845937 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f1377-84cb-46f0-91ca-4984f36391bc None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:42.846221 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f1377-84cb-46f0-91ca-4984f36391bc None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:42.846879 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f1377-84cb-46f0-91ca-4984f36391bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:42.855525 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:42.859303 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f1377-84cb-46f0-91ca-4984f36391bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:42.867760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-0f0f1377-84cb-46f0-91ca-4984f36391bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 09:59:42.867760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:42.867760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:42.867760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:42.867760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:42.867760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:42.867760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:42.867760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:42.867760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:42.867760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:42.867760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:42.867760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:42.867760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:42.867760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:42.867760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:42.867760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:42.868749 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:42.868749 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:42.868749 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:42.868749 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:42.868749 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:42.868749 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:42.868749 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:42.868749 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:42.868749 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:42.868749 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:42.868749 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:42.868749 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:42.868749 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:42.868749 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:42.868749 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:42.868749 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:42.869660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:42.869660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:42.869660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:42.869660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:42.869660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:42.869660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:42.869660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:42.869660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:42.869660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:42.869660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:42.869660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 09:59:42.869660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:42.869660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 287/566] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 22 09:59:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:42.870728 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f1377-84cb-46f0-91ca-4984f36391bc None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:42.878942 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:42.933834 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cecaf7-08ee-48bb-b931-ca8b064646d8 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:42.967659 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f9b55-5588-4502-9045-fe5261d8047a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:42.968230 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f9b55-5588-4502-9045-fe5261d8047a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:42.968516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f9b55-5588-4502-9045-fe5261d8047a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:42.968795 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f9b55-5588-4502-9045-fe5261d8047a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:42.969055 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f1377-84cb-46f0-91ca-4984f36391bc None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:43.004253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02761616-a196-4b1f-9939-81bb28f89fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:43.005079 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02761616-a196-4b1f-9939-81bb28f89fed None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:43.005366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02761616-a196-4b1f-9939-81bb28f89fed None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:43.005641 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02761616-a196-4b1f-9939-81bb28f89fed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:43.016963 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02761616-a196-4b1f-9939-81bb28f89fed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:43.025406 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-02761616-a196-4b1f-9939-81bb28f89fed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 09:59:43.025406 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:43.025406 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:43.025406 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:43.025406 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:43.025406 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:43.025406 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:43.025406 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:43.025406 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:43.025406 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:43.025406 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:43.025406 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:43.025406 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:43.025406 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:43.025406 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:43.025406 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:43.026354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:43.026354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:43.026354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:43.026354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:43.026354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:43.026354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:43.026354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:43.026354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:43.026354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:43.026354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:43.026354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:43.026354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:43.026354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:43.026354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:43.026354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:43.026354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:43.027223 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:43.027223 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:43.027223 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:43.027223 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:43.027223 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:43.027223 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:43.027223 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:43.027223 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:43.027223 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:43.027223 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:43.027223 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 09:59:43.027223 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:43.027223 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 288/567] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 22 09:59:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:43.027904 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02761616-a196-4b1f-9939-81bb28f89fed None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:43.041685 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f9b55-5588-4502-9045-fe5261d8047a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:43.043145 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f9b55-5588-4502-9045-fe5261d8047a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:43.127669 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02761616-a196-4b1f-9939-81bb28f89fed None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:43.140175 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 280/568] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:59:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 09:59:43.141075 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f9b55-5588-4502-9045-fe5261d8047a None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:43.146693 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:43.169536 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc632774-06c5-486d-b406-03dfb085c58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:43.170428 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc632774-06c5-486d-b406-03dfb085c58f None admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:43.170715 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc632774-06c5-486d-b406-03dfb085c58f None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:43.170990 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc632774-06c5-486d-b406-03dfb085c58f None admin] PATH_INFO: `/v3/projects/a2bb614e4d7747c1a3fff154c8bc18d9/users/4ed9a00723ab4af2b633ab7614d178a8/roles/604a13bdd0fd46e182a9749de3b5232d` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:43.257054 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:43.267132 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc632774-06c5-486d-b406-03dfb085c58f None admin] RBAC: Authorizing `identity:create_grant(project_id=a2bb614e4d7747c1a3fff154c8bc18d9, user_id=4ed9a00723ab4af2b633ab7614d178a8, role_id=604a13bdd0fd46e182a9749de3b5232d)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:43.268605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc632774-06c5-486d-b406-03dfb085c58f None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:43.319213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f9b55-5588-4502-9045-fe5261d8047a None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:43.351358 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3163c9-d014-42b5-b589-411fd8bf1932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:43.360883 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3163c9-d014-42b5-b589-411fd8bf1932 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:43.360883 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3163c9-d014-42b5-b589-411fd8bf1932 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:43.360883 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3163c9-d014-42b5-b589-411fd8bf1932 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:43.361220 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 289/569] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 22 09:59:43 2022] PUT /identity/v3/projects/a2bb614e4d7747c1a3fff154c8bc18d9/users/4ed9a00723ab4af2b633ab7614d178a8/roles/604a13bdd0fd46e182a9749de3b5232d => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:59:43.361319 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3163c9-d014-42b5-b589-411fd8bf1932 None admin] RBAC: Adding query filter params (name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:43.361319 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3163c9-d014-42b5-b589-411fd8bf1932 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:43.361498 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dd4cd-d8da-4d30-acd4-c060ac615a97 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:43.361498 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dd4cd-d8da-4d30-acd4-c060ac615a97 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:43.361498 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dd4cd-d8da-4d30-acd4-c060ac615a97 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:43.361738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3163c9-d014-42b5-b589-411fd8bf1932 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:43.361827 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 290/570] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:43.361827 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151dd4cd-d8da-4d30-acd4-c060ac615a97 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:43.369793 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 281/571] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 22 09:59:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:43.370669 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3163c9-d014-42b5-b589-411fd8bf1932 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:43.385675 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:43.484343 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151dd4cd-d8da-4d30-acd4-c060ac615a97 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:43.492130 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3163c9-d014-42b5-b589-411fd8bf1932 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:43.497789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:43.529206 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4ffa2-f800-4a06-a247-08aa3820de27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:43.529807 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4ffa2-f800-4a06-a247-08aa3820de27 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:43.530195 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4ffa2-f800-4a06-a247-08aa3820de27 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:43.530368 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4ffa2-f800-4a06-a247-08aa3820de27 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:43.531118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4ffa2-f800-4a06-a247-08aa3820de27 None admin] RBAC: Adding query filter params (name=service) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:43.531428 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4ffa2-f800-4a06-a247-08aa3820de27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:43.532804 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4ffa2-f800-4a06-a247-08aa3820de27 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:43.536652 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831aec0-fd20-48a0-a9d0-70527ecd46bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:43.537829 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831aec0-fd20-48a0-a9d0-70527ecd46bf None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:43.538293 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831aec0-fd20-48a0-a9d0-70527ecd46bf None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:43.538734 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831aec0-fd20-48a0-a9d0-70527ecd46bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:43.542339 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 291/572] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 22 09:59:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:43.543896 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e38a8-3c31-4de5-940b-d5e035cfca2d None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:43.544402 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e38a8-3c31-4de5-940b-d5e035cfca2d None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:43.552441 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e38a8-3c31-4de5-940b-d5e035cfca2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:43.552576 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831aec0-fd20-48a0-a9d0-70527ecd46bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:43.552576 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831aec0-fd20-48a0-a9d0-70527ecd46bf None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:43.562777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-a39e38a8-3c31-4de5-940b-d5e035cfca2d None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:43.563979 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-a39e38a8-3c31-4de5-940b-d5e035cfca2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:43.571671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-6831aec0-fd20-48a0-a9d0-70527ecd46bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:43.571671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:43.571671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:43.571671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:43.571671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:43.571671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:43.571671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:43.571671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:43.571671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:43.571671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:43.571671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:43.571671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:43.571671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:43.571671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:43.571671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:43.572577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:43.572577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:43.572577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:43.572577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:43.572577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:43.572577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:43.572577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:43.572577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:43.572577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:43.572577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:43.572577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:43.572577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:43.572577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:43.572577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:43.572577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:43.572577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:43.572577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:43.573839 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:43.573839 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:43.573839 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:43.573839 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:43.573839 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 282/573] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:43.573839 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831aec0-fd20-48a0-a9d0-70527ecd46bf None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:43.634089 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:43.642894 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 292/574] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:43.644020 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e38a8-3c31-4de5-940b-d5e035cfca2d None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:43.689926 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831aec0-fd20-48a0-a9d0-70527ecd46bf None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:43.727560 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20411e61-c58c-4f0b-8d7c-0a5cd2081993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:43.728352 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20411e61-c58c-4f0b-8d7c-0a5cd2081993 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:43.728635 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20411e61-c58c-4f0b-8d7c-0a5cd2081993 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:43.728954 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20411e61-c58c-4f0b-8d7c-0a5cd2081993 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:43.739488 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20411e61-c58c-4f0b-8d7c-0a5cd2081993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:43.741561 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20411e61-c58c-4f0b-8d7c-0a5cd2081993 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:43.759048 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-20411e61-c58c-4f0b-8d7c-0a5cd2081993 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:43.759048 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:43.759048 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:43.759048 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:43.759048 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:43.759048 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:43.759048 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:43.759048 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:43.759048 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:43.759048 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:43.759048 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:43.759048 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:43.759048 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:43.759048 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:43.759048 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:43.759983 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:43.759983 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:43.759983 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:43.759983 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:43.759983 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:43.759983 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:43.759983 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:43.759983 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:43.759983 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:43.759983 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:43.759983 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:43.759983 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:43.759983 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:43.759983 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:43.759983 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:43.759983 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:43.759983 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:43.761799 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:43.761799 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:43.761799 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:43.761799 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:43.761799 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 283/575] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:43.761799 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20411e61-c58c-4f0b-8d7c-0a5cd2081993 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:43.775121 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e38a8-3c31-4de5-940b-d5e035cfca2d None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:43.776846 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:43.810124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce13b2-6fdc-4fcd-a358-a311f157ac59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:43.810933 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce13b2-6fdc-4fcd-a358-a311f157ac59 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:43.811217 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce13b2-6fdc-4fcd-a358-a311f157ac59 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:43.811495 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce13b2-6fdc-4fcd-a358-a311f157ac59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:43.822492 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce13b2-6fdc-4fcd-a358-a311f157ac59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:43.823958 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce13b2-6fdc-4fcd-a358-a311f157ac59 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:43.843354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-8bce13b2-6fdc-4fcd-a358-a311f157ac59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:43.843354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:43.843354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:43.843354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:43.843354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:43.843354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:43.843354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:43.843354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:43.843354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:43.843354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:43.843354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:43.843354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:43.843354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:43.843354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:43.843354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:43.844366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:43.844366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:43.844366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:43.844366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:43.844366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:43.844366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:43.844366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:43.844366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:43.844366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:43.844366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:43.844366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:43.844366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:43.844366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:43.844366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:43.844366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:43.844366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:43.844366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:43.845675 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:43.845675 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:43.845675 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:43.845675 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:43.845675 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 293/576] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:43.846142 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce13b2-6fdc-4fcd-a358-a311f157ac59 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:43.881901 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20411e61-c58c-4f0b-8d7c-0a5cd2081993 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:43.893767 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:43.921913 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b8d56-8a82-4ac9-b94a-d79341c29cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:43.922616 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b8d56-8a82-4ac9-b94a-d79341c29cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:43.923150 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b8d56-8a82-4ac9-b94a-d79341c29cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:43.923442 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b8d56-8a82-4ac9-b94a-d79341c29cb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:43.924181 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b8d56-8a82-4ac9-b94a-d79341c29cb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:43.924494 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b8d56-8a82-4ac9-b94a-d79341c29cb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:43.925917 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b8d56-8a82-4ac9-b94a-d79341c29cb4 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:43.943343 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 284/577] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:43.944225 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b8d56-8a82-4ac9-b94a-d79341c29cb4 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:44.020991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce13b2-6fdc-4fcd-a358-a311f157ac59 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:44.056744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca4bdd-4010-493e-8118-f28fb4b4835f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:44.057639 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca4bdd-4010-493e-8118-f28fb4b4835f None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:44.057909 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca4bdd-4010-493e-8118-f28fb4b4835f None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:44.058135 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca4bdd-4010-493e-8118-f28fb4b4835f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:44.068725 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca4bdd-4010-493e-8118-f28fb4b4835f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:44.076493 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-7aca4bdd-4010-493e-8118-f28fb4b4835f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 09:59:44.076493 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:44.076493 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:44.076493 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:44.076493 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:44.076493 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:44.076493 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:44.076493 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:44.076493 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:44.076493 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:44.076493 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:44.076493 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:44.076493 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:44.076493 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:44.076493 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:44.076493 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:44.077484 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:44.077484 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:44.077484 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:44.077484 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:44.077484 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:44.077484 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:44.077484 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:44.077484 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:44.077484 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:44.077484 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:44.077484 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:44.077484 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:44.077484 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:44.077484 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:44.077484 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:44.077484 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:44.078977 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:44.078977 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:44.078977 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:44.078977 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:44.078977 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:44.078977 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:44.078977 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:44.078977 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:44.078977 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:44.078977 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:44.078977 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 09:59:44.078977 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:44.078977 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 294/578] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 22 09:59:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:44.078977 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca4bdd-4010-493e-8118-f28fb4b4835f None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:44.100359 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b8d56-8a82-4ac9-b94a-d79341c29cb4 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:44.100578 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:44.135854 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bda01-9b56-48a8-bcc0-fa1a3591d206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:44.137026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bda01-9b56-48a8-bcc0-fa1a3591d206 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:44.137519 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bda01-9b56-48a8-bcc0-fa1a3591d206 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:44.137852 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bda01-9b56-48a8-bcc0-fa1a3591d206 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:44.138722 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7bda01-9b56-48a8-bcc0-fa1a3591d206 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:44.139053 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7bda01-9b56-48a8-bcc0-fa1a3591d206 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:44.140694 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7bda01-9b56-48a8-bcc0-fa1a3591d206 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:44.153262 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 285/579] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:44.154094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bda01-9b56-48a8-bcc0-fa1a3591d206 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:44.185655 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:44.195693 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca4bdd-4010-493e-8118-f28fb4b4835f None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:44.231142 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c78666-79e1-4d97-86aa-b07268e3b2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:44.232074 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c78666-79e1-4d97-86aa-b07268e3b2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:44.232355 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c78666-79e1-4d97-86aa-b07268e3b2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:44.232634 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c78666-79e1-4d97-86aa-b07268e3b2f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:44.233412 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c78666-79e1-4d97-86aa-b07268e3b2f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:44.233720 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c78666-79e1-4d97-86aa-b07268e3b2f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:44.235127 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c78666-79e1-4d97-86aa-b07268e3b2f4 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:44.248092 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 295/580] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:44.248716 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c78666-79e1-4d97-86aa-b07268e3b2f4 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:44.260596 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bda01-9b56-48a8-bcc0-fa1a3591d206 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:44.298897 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723184fe-72e2-422c-8ebf-41d956e9acf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:44.299979 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723184fe-72e2-422c-8ebf-41d956e9acf9 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:44.300489 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723184fe-72e2-422c-8ebf-41d956e9acf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:44.300978 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723184fe-72e2-422c-8ebf-41d956e9acf9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:44.308149 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723184fe-72e2-422c-8ebf-41d956e9acf9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:44.309838 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723184fe-72e2-422c-8ebf-41d956e9acf9 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:44.325271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-723184fe-72e2-422c-8ebf-41d956e9acf9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 09:59:44.325271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:44.325271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:44.325271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:44.325271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:44.325271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:44.325271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:44.325271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:44.325271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:44.325271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:44.325271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:44.325271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:44.325271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 09:59:44.325271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 09:59:44.325271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 09:59:44.326296 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 09:59:44.326296 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:44.326296 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:44.326296 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:44.326296 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:44.326296 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:44.326296 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:44.326296 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:44.326296 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:44.326296 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:44.326296 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:44.326296 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:44.326296 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:44.326296 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:44.326296 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:44.326296 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:44.326296 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:44.327170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 09:59:44.327170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 09:59:44.327170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 09:59:44.327170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 09:59:44.327170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 09:59:44.327170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 09:59:44.327170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 09:59:44.327170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:44.328434 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:44.331332 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 286/581] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 09:59:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:44.332481 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723184fe-72e2-422c-8ebf-41d956e9acf9 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:44.356386 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c78666-79e1-4d97-86aa-b07268e3b2f4 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:44.392371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b8d6c-3c9a-40dd-94e3-13aab3b503f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:44.393072 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b8d6c-3c9a-40dd-94e3-13aab3b503f5 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:44.393367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b8d6c-3c9a-40dd-94e3-13aab3b503f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:44.393638 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b8d6c-3c9a-40dd-94e3-13aab3b503f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:44.394395 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b8d6c-3c9a-40dd-94e3-13aab3b503f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:44.394704 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b8d6c-3c9a-40dd-94e3-13aab3b503f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:44.396086 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b8d6c-3c9a-40dd-94e3-13aab3b503f5 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:44.409999 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 296/582] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 22 09:59:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:44.409999 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b8d6c-3c9a-40dd-94e3-13aab3b503f5 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:44.438125 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:44.451316 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723184fe-72e2-422c-8ebf-41d956e9acf9 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:44.492097 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960ba5d-5efc-430f-9257-49071ef40ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:44.492936 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960ba5d-5efc-430f-9257-49071ef40ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:44.493548 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960ba5d-5efc-430f-9257-49071ef40ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:44.493832 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1960ba5d-5efc-430f-9257-49071ef40ee0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:44.503128 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960ba5d-5efc-430f-9257-49071ef40ee0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:44.504591 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1960ba5d-5efc-430f-9257-49071ef40ee0 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:44.515393 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b8d6c-3c9a-40dd-94e3-13aab3b503f5 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:44.520590 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-1960ba5d-5efc-430f-9257-49071ef40ee0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 09:59:44.520590 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:44.520590 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:44.520590 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:44.520590 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:44.520590 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:44.520590 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:44.520590 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:44.520590 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:44.520590 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:44.520590 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:44.520590 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:44.520590 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 09:59:44.520590 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 09:59:44.520590 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 09:59:44.520590 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 09:59:44.522317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:44.522317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:44.522317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 09:59:44.522317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 09:59:44.522317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 09:59:44.522317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 09:59:44.522317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:44.522317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:44.522317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:44.522317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:44.522317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:44.522317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:44.522317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:44.522317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:44.522317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:44.522317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:44.522317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:44.522317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:44.523518 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:44.523518 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:44.523518 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 09:59:44.523518 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 09:59:44.523518 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 09:59:44.523518 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 09:59:44.523518 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 09:59:44.523518 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 09:59:44.523518 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 09:59:44.523518 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:44.525155 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 287/583] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:59:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:44.530163 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960ba5d-5efc-430f-9257-49071ef40ee0 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:44.556103 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c4c7e-a0ae-4145-8a32-1b7b5b659cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:44.556974 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c4c7e-a0ae-4145-8a32-1b7b5b659cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:44.557257 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c4c7e-a0ae-4145-8a32-1b7b5b659cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:44.557532 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c4c7e-a0ae-4145-8a32-1b7b5b659cd6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:44.560883 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:44.567310 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c4c7e-a0ae-4145-8a32-1b7b5b659cd6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:44.569479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c4c7e-a0ae-4145-8a32-1b7b5b659cd6 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:44.585329 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-437c4c7e-a0ae-4145-8a32-1b7b5b659cd6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 22 09:59:44.585329 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:44.585329 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:44.585329 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:44.585329 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:44.585329 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:44.585329 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:44.585329 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:44.585329 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:44.585329 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:44.585329 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:44.585329 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:44.585329 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 09:59:44.585329 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 09:59:44.585329 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 09:59:44.585329 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 09:59:44.586236 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:44.586236 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:44.586236 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 09:59:44.586236 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 09:59:44.586236 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 09:59:44.586236 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 09:59:44.586236 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:44.586236 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:44.586236 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:44.586236 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:44.586236 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:44.586236 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:44.586236 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:44.586236 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:44.586236 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:44.586236 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:44.586236 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:44.586236 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:44.587160 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:44.587160 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:44.587160 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 09:59:44.587160 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 09:59:44.587160 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 09:59:44.587160 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 09:59:44.587160 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 09:59:44.587160 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 09:59:44.587160 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 22 09:59:44.587160 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:44.587160 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 297/584] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:59:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:44.587741 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c4c7e-a0ae-4145-8a32-1b7b5b659cd6 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:44.638728 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1960ba5d-5efc-430f-9257-49071ef40ee0 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:44.680604 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5252b4-b24b-42d7-99d1-8472b96e1d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:44.681500 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5252b4-b24b-42d7-99d1-8472b96e1d1b None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:44.681930 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5252b4-b24b-42d7-99d1-8472b96e1d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:44.682395 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5252b4-b24b-42d7-99d1-8472b96e1d1b None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:44.684028 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5252b4-b24b-42d7-99d1-8472b96e1d1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:44.684593 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5252b4-b24b-42d7-99d1-8472b96e1d1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:44.686925 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5252b4-b24b-42d7-99d1-8472b96e1d1b None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:44.695304 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c4c7e-a0ae-4145-8a32-1b7b5b659cd6 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:44.701340 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 288/585] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 09:59:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:44.702451 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5252b4-b24b-42d7-99d1-8472b96e1d1b None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:44.716921 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:44.737849 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496333db-482c-4ecb-92cb-de91d0d73ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:44.738945 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496333db-482c-4ecb-92cb-de91d0d73ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:44.739374 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496333db-482c-4ecb-92cb-de91d0d73ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:44.739807 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496333db-482c-4ecb-92cb-de91d0d73ac6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:44.750867 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496333db-482c-4ecb-92cb-de91d0d73ac6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:44.752321 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496333db-482c-4ecb-92cb-de91d0d73ac6 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:44.770432 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-496333db-482c-4ecb-92cb-de91d0d73ac6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:44.770432 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:44.770432 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:44.770432 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:44.770432 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:44.770432 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:44.770432 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:44.770432 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:44.770432 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:44.770432 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:44.770432 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:44.770432 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:44.770432 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:44.770432 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:44.770432 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:44.771525 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:44.771525 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:44.771525 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:44.771525 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:44.771525 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:44.771525 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:44.771525 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:44.771525 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:44.771525 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:44.771525 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:44.771525 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:44.771525 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:44.771525 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:44.771525 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:44.771525 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:44.771525 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:44.771525 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:44.773012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:44.773012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:44.773012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:44.773012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:44.773012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 298/586] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:44.773463 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496333db-482c-4ecb-92cb-de91d0d73ac6 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:44.813255 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5252b4-b24b-42d7-99d1-8472b96e1d1b None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:44.828750 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:44.852444 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589dda72-6123-4c54-ad0e-b80cc5101c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:44.853157 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589dda72-6123-4c54-ad0e-b80cc5101c4e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:44.853550 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589dda72-6123-4c54-ad0e-b80cc5101c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:44.853887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589dda72-6123-4c54-ad0e-b80cc5101c4e None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:44.854801 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589dda72-6123-4c54-ad0e-b80cc5101c4e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:44.855178 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589dda72-6123-4c54-ad0e-b80cc5101c4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:44.856687 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589dda72-6123-4c54-ad0e-b80cc5101c4e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:44.879084 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 289/587] 10.222.0.46 () {56 vars in 1137 bytes} [Wed Jun 22 09:59:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:44.879084 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589dda72-6123-4c54-ad0e-b80cc5101c4e None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:44.892765 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496333db-482c-4ecb-92cb-de91d0d73ac6 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:44.926522 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f44720-4e28-4669-9551-1ebb328847da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:44.927579 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f44720-4e28-4669-9551-1ebb328847da None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:44.928650 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f44720-4e28-4669-9551-1ebb328847da None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:44.928961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f44720-4e28-4669-9551-1ebb328847da None admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:44.929806 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f44720-4e28-4669-9551-1ebb328847da None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:44.930117 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f44720-4e28-4669-9551-1ebb328847da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:44.931674 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f44720-4e28-4669-9551-1ebb328847da None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:44.945646 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:44.951618 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 299/588] 10.222.0.46 () {56 vars in 1137 bytes} [Wed Jun 22 09:59:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:44.952460 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f44720-4e28-4669-9551-1ebb328847da None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:45.036005 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589dda72-6123-4c54-ad0e-b80cc5101c4e None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:45.073697 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90a072-f53d-4bf1-b463-bb693032c8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:45.074602 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90a072-f53d-4bf1-b463-bb693032c8ed None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:45.074885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90a072-f53d-4bf1-b463-bb693032c8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:45.075185 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90a072-f53d-4bf1-b463-bb693032c8ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:45.076050 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90a072-f53d-4bf1-b463-bb693032c8ed None admin] RBAC: Adding query filter params (role.id=604a13bdd0fd46e182a9749de3b5232d, scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9, user.id=9c724063ce51470ca09c5c5ab231fd9b) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:45.076360 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90a072-f53d-4bf1-b463-bb693032c8ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:45.077836 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90a072-f53d-4bf1-b463-bb693032c8ed None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:45.083782 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 290/589] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 09:59:44 2022] GET /identity/v3/role_assignments?user.id=9c724063ce51470ca09c5c5ab231fd9b&scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9&role.id=604a13bdd0fd46e182a9749de3b5232d => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:45.084629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90a072-f53d-4bf1-b463-bb693032c8ed None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:45.128687 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f44720-4e28-4669-9551-1ebb328847da None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:45.139782 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:45.172521 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc49be0-f8fc-48bf-8994-0d4426eedeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:45.173352 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc49be0-f8fc-48bf-8994-0d4426eedeb3 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:45.173733 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc49be0-f8fc-48bf-8994-0d4426eedeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:45.174110 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc49be0-f8fc-48bf-8994-0d4426eedeb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:45.174955 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc49be0-f8fc-48bf-8994-0d4426eedeb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:45.175365 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc49be0-f8fc-48bf-8994-0d4426eedeb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:45.176936 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc49be0-f8fc-48bf-8994-0d4426eedeb3 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:45.196498 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 300/590] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:45.197665 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc49be0-f8fc-48bf-8994-0d4426eedeb3 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:45.236018 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90a072-f53d-4bf1-b463-bb693032c8ed None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:45.280073 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:45.285419 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc831fec-8d87-4726-8887-4932e001fd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:45.286475 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc831fec-8d87-4726-8887-4932e001fd51 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:45.286960 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc831fec-8d87-4726-8887-4932e001fd51 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:45.288043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc831fec-8d87-4726-8887-4932e001fd51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:45.300349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc831fec-8d87-4726-8887-4932e001fd51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:45.302241 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc831fec-8d87-4726-8887-4932e001fd51 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:45.324890 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc49be0-f8fc-48bf-8994-0d4426eedeb3 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:45.327369 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-dc831fec-8d87-4726-8887-4932e001fd51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:45.327369 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:45.327369 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:45.327369 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:45.327369 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:45.327369 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:45.327369 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:45.327369 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:45.327369 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:45.327369 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:45.327369 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:45.327369 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:45.327369 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:45.327369 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:45.327369 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:45.328287 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:45.328287 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:45.328287 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:45.328287 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:45.328287 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:45.328287 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:45.328287 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:45.328287 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:45.328287 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:45.328287 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:45.328287 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:45.328287 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:45.328287 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:45.328287 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:45.328287 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:45.328287 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:45.328287 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:45.329203 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:45.329203 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:45.329203 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:45.329203 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:45.333086 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 291/591] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:45.334187 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc831fec-8d87-4726-8887-4932e001fd51 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:45.369127 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd7e22-e2a3-4b30-8599-35519703a1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:45.370332 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd7e22-e2a3-4b30-8599-35519703a1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:45.370853 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd7e22-e2a3-4b30-8599-35519703a1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:45.371396 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd7e22-e2a3-4b30-8599-35519703a1a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:45.383257 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd7e22-e2a3-4b30-8599-35519703a1a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:45.385138 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd7e22-e2a3-4b30-8599-35519703a1a5 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:45.403700 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-54dd7e22-e2a3-4b30-8599-35519703a1a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:45.403700 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:45.403700 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:45.403700 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:45.403700 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:45.403700 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:45.403700 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:45.403700 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:45.403700 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:45.403700 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:45.403700 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:45.403700 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:45.403700 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:45.403700 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:45.403700 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:45.404657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:45.404657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:45.404657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:45.404657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:45.404657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:45.404657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:45.404657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:45.404657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:45.404657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:45.404657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:45.404657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:45.404657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:45.404657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:45.404657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:45.404657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:45.404657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:45.404657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:45.405575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:45.405575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:45.405575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:45.405575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:45.410582 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 301/592] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:45.410582 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd7e22-e2a3-4b30-8599-35519703a1a5 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:45.429863 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:45.452488 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc831fec-8d87-4726-8887-4932e001fd51 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:45.489551 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e7807-a331-4d68-b43c-480e0316f8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:45.490439 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e7807-a331-4d68-b43c-480e0316f8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:45.490687 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e7807-a331-4d68-b43c-480e0316f8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:45.490962 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e7807-a331-4d68-b43c-480e0316f8e3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:45.500458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e7807-a331-4d68-b43c-480e0316f8e3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:45.501958 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e7807-a331-4d68-b43c-480e0316f8e3 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:45.517610 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd7e22-e2a3-4b30-8599-35519703a1a5 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:45.518074 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-1d6e7807-a331-4d68-b43c-480e0316f8e3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 09:59:45.518074 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:45.518074 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:45.518074 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:45.518074 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:45.518074 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:45.518074 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:45.518074 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:45.518074 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:45.518074 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:45.518074 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:45.518074 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:45.518074 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 09:59:45.518074 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 09:59:45.518074 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 09:59:45.518074 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 09:59:45.518933 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:45.518933 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:45.518933 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 09:59:45.518933 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 09:59:45.518933 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 09:59:45.518933 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 09:59:45.518933 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:45.518933 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:45.518933 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:45.518933 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:45.518933 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:45.518933 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:45.518933 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:45.518933 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:45.518933 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:45.518933 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:45.518933 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:45.518933 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:45.519843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:45.519843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:45.519843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 09:59:45.519843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 09:59:45.519843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 09:59:45.519843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 09:59:45.519843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 09:59:45.519843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 09:59:45.519843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 09:59:45.519843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:45.523559 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 292/593] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 22 09:59:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:45.525193 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5ef5b-cb43-4aa3-b25c-0cbded27d27b None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:45.525490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5ef5b-cb43-4aa3-b25c-0cbded27d27b None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:45.525773 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5ef5b-cb43-4aa3-b25c-0cbded27d27b None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:45.527247 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 293/594] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:45.529065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5ef5b-cb43-4aa3-b25c-0cbded27d27b None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:45.562075 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30bc01b-667b-4033-aa1b-1f9d4c73bead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:45.562740 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bc01b-667b-4033-aa1b-1f9d4c73bead None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:45.563021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bc01b-667b-4033-aa1b-1f9d4c73bead None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:45.563302 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30bc01b-667b-4033-aa1b-1f9d4c73bead None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:45.564025 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30bc01b-667b-4033-aa1b-1f9d4c73bead None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:45.564330 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30bc01b-667b-4033-aa1b-1f9d4c73bead None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:45.565719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30bc01b-667b-4033-aa1b-1f9d4c73bead None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:45.583126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 302/595] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:45.583126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30bc01b-667b-4033-aa1b-1f9d4c73bead None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:45.591581 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:45.650639 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5ef5b-cb43-4aa3-b25c-0cbded27d27b None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:45.667054 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:45.689115 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30bc01b-667b-4033-aa1b-1f9d4c73bead None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:45.694741 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8dd4b5-e676-471c-b130-a5ede5310a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:45.695518 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8dd4b5-e676-471c-b130-a5ede5310a3b None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:45.695868 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8dd4b5-e676-471c-b130-a5ede5310a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:45.696219 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8dd4b5-e676-471c-b130-a5ede5310a3b None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:45.697756 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8dd4b5-e676-471c-b130-a5ede5310a3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:45.698138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8dd4b5-e676-471c-b130-a5ede5310a3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:45.700146 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8dd4b5-e676-471c-b130-a5ede5310a3b None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:45.716121 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 294/596] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:45.717440 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff7c65-0f0f-4ba0-b4d8-70094a25c2a3 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:45.717728 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff7c65-0f0f-4ba0-b4d8-70094a25c2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:45.718010 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff7c65-0f0f-4ba0-b4d8-70094a25c2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:45.735171 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-50ff7c65-0f0f-4ba0-b4d8-70094a25c2a3 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:45.736420 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-50ff7c65-0f0f-4ba0-b4d8-70094a25c2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:45.736800 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ddb32-2934-4726-bf2b-20fcda392eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:45.737604 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ddb32-2934-4726-bf2b-20fcda392eca None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:45.737990 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ddb32-2934-4726-bf2b-20fcda392eca None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:45.738374 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ddb32-2934-4726-bf2b-20fcda392eca None admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:45.739440 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ddb32-2934-4726-bf2b-20fcda392eca None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:45.739854 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ddb32-2934-4726-bf2b-20fcda392eca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:45.741484 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ddb32-2934-4726-bf2b-20fcda392eca None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:45.761918 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 303/597] 10.222.0.46 () {56 vars in 1139 bytes} [Wed Jun 22 09:59:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:45.767126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ddb32-2934-4726-bf2b-20fcda392eca None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:45.819311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 295/598] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:45.819311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff7c65-0f0f-4ba0-b4d8-70094a25c2a3 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:45.856278 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:45.883032 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ddb32-2934-4726-bf2b-20fcda392eca None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:45.923734 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302781f7-8eac-4eaa-8338-a8641f076a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:45.923734 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302781f7-8eac-4eaa-8338-a8641f076a8c None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:45.923734 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302781f7-8eac-4eaa-8338-a8641f076a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:45.923734 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302781f7-8eac-4eaa-8338-a8641f076a8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:45.925938 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:45.926260 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff7c65-0f0f-4ba0-b4d8-70094a25c2a3 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:45.930700 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302781f7-8eac-4eaa-8338-a8641f076a8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:45.932139 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302781f7-8eac-4eaa-8338-a8641f076a8c None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:45.948220 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-302781f7-8eac-4eaa-8338-a8641f076a8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 09:59:45.948220 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:45.948220 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:45.948220 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:45.948220 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:45.948220 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:45.948220 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:45.948220 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:45.948220 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:45.948220 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:45.948220 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:45.948220 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:45.948220 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 09:59:45.948220 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 09:59:45.948220 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 09:59:45.949315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 09:59:45.949315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:45.949315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:45.949315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:45.949315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:45.949315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:45.949315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:45.949315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:45.949315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:45.949315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:45.949315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:45.949315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:45.949315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:45.949315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:45.949315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:45.949315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:45.949315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:45.950565 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 09:59:45.950565 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 09:59:45.950565 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 09:59:45.950565 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 09:59:45.950565 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 09:59:45.950565 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 09:59:45.950565 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 09:59:45.950565 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:45.954497 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 304/599] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 09:59:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:45.954840 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302781f7-8eac-4eaa-8338-a8641f076a8c None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:45.967053 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211bf33-294a-47d3-a313-202794df92f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:45.983414 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211bf33-294a-47d3-a313-202794df92f1 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:45.983414 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211bf33-294a-47d3-a313-202794df92f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:45.983414 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211bf33-294a-47d3-a313-202794df92f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:45.983414 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0211bf33-294a-47d3-a313-202794df92f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:45.983414 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0211bf33-294a-47d3-a313-202794df92f1 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:45.991644 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-0211bf33-294a-47d3-a313-202794df92f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 09:59:45.991644 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:45.991644 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:45.991644 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:45.991644 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:45.991644 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:45.991644 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:45.991644 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:45.991644 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:45.991644 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:45.991644 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:45.991644 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:45.991644 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 09:59:45.991644 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 09:59:45.991644 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 09:59:45.992666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 09:59:45.992666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:45.992666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:45.992666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:45.992666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:45.992666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:45.992666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:45.992666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:45.992666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:45.992666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:45.992666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:45.992666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:45.992666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:45.992666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:45.992666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:45.992666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:45.992666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:45.993571 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 09:59:45.993571 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 09:59:45.993571 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 09:59:45.993571 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 09:59:45.993571 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 09:59:45.993571 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 09:59:45.993571 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 09:59:45.993571 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:45.997124 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 296/600] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 09:59:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:45.998082 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211bf33-294a-47d3-a313-202794df92f1 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:46.061053 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302781f7-8eac-4eaa-8338-a8641f076a8c None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:46.099038 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244dbf5-985a-443b-b58a-2464be09c04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:46.099871 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244dbf5-985a-443b-b58a-2464be09c04e None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:46.100157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244dbf5-985a-443b-b58a-2464be09c04e None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:46.100436 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244dbf5-985a-443b-b58a-2464be09c04e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:46.104429 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:46.110969 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211bf33-294a-47d3-a313-202794df92f1 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:46.113737 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244dbf5-985a-443b-b58a-2464be09c04e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:46.115252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244dbf5-985a-443b-b58a-2464be09c04e None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:46.133448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-0244dbf5-985a-443b-b58a-2464be09c04e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:46.133448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:46.133448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:46.133448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:46.133448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:46.133448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:46.133448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:46.133448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:46.133448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:46.133448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:46.133448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:46.133448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:46.133448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:46.133448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:46.133448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:46.134530 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:46.134530 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:46.134530 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:46.134530 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:46.134530 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:46.134530 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:46.134530 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:46.134530 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:46.134530 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:46.134530 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:46.134530 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:46.134530 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:46.134530 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:46.134530 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:46.134530 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:46.134530 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:46.134530 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:46.135593 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:46.135593 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:46.135593 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:46.135593 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:46.135593 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 305/601] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:46.135593 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244dbf5-985a-443b-b58a-2464be09c04e None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:46.155084 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0137b-85d9-470b-9cd1-24a53dffb956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:46.155932 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0137b-85d9-470b-9cd1-24a53dffb956 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:46.156220 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0137b-85d9-470b-9cd1-24a53dffb956 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:46.156544 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0137b-85d9-470b-9cd1-24a53dffb956 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:46.169158 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0137b-85d9-470b-9cd1-24a53dffb956 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:46.176998 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-b1c0137b-85d9-470b-9cd1-24a53dffb956 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 09:59:46.176998 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:46.176998 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:46.176998 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:46.176998 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:46.176998 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:46.176998 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:46.176998 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:46.176998 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:46.176998 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:46.176998 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:46.176998 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:46.176998 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:46.176998 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:46.176998 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:46.176998 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:46.178140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:46.178140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:46.178140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:46.178140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:46.178140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:46.178140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:46.178140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:46.178140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:46.178140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:46.178140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:46.178140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:46.178140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:46.178140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:46.178140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:46.178140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:46.178140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:46.179747 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:46.179747 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:46.179747 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:46.179747 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:46.179747 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:46.179747 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:46.179747 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:46.179747 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:46.179747 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:46.179747 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:46.179747 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 09:59:46.179747 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:46.179747 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 297/602] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 22 09:59:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:46.179747 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0137b-85d9-470b-9cd1-24a53dffb956 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:46.199352 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:46.257475 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244dbf5-985a-443b-b58a-2464be09c04e None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:46.284098 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0137b-85d9-470b-9cd1-24a53dffb956 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:46.301564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025b956-8746-4f0f-9b4f-4da3d8d597f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:46.302227 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025b956-8746-4f0f-9b4f-4da3d8d597f5 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:46.302515 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025b956-8746-4f0f-9b4f-4da3d8d597f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:46.302845 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025b956-8746-4f0f-9b4f-4da3d8d597f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:46.303642 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025b956-8746-4f0f-9b4f-4da3d8d597f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:46.303954 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025b956-8746-4f0f-9b4f-4da3d8d597f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:46.305435 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025b956-8746-4f0f-9b4f-4da3d8d597f5 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:46.321003 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8708fe-8ee4-427e-9817-574d52f31e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:46.321886 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8708fe-8ee4-427e-9817-574d52f31e0b None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:46.322308 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8708fe-8ee4-427e-9817-574d52f31e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:46.322733 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8708fe-8ee4-427e-9817-574d52f31e0b None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:46.323678 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8708fe-8ee4-427e-9817-574d52f31e0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:46.323786 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 306/603] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 09:59:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:46.324228 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8708fe-8ee4-427e-9817-574d52f31e0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:46.324604 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025b956-8746-4f0f-9b4f-4da3d8d597f5 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:46.326167 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8708fe-8ee4-427e-9817-574d52f31e0b None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:46.344973 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 298/604] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 09:59:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:46.344973 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8708fe-8ee4-427e-9817-574d52f31e0b None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:46.361576 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:46.448858 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025b956-8746-4f0f-9b4f-4da3d8d597f5 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:46.458189 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8708fe-8ee4-427e-9817-574d52f31e0b None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:46.459447 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:46.484076 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adc0d1-ec78-4758-9987-54f9e5f6ead1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:46.484742 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adc0d1-ec78-4758-9987-54f9e5f6ead1 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:46.485063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adc0d1-ec78-4758-9987-54f9e5f6ead1 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:46.485337 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adc0d1-ec78-4758-9987-54f9e5f6ead1 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:46.486064 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33adc0d1-ec78-4758-9987-54f9e5f6ead1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:46.486372 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33adc0d1-ec78-4758-9987-54f9e5f6ead1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:46.487732 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33adc0d1-ec78-4758-9987-54f9e5f6ead1 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:46.500448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 307/605] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:46.501207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adc0d1-ec78-4758-9987-54f9e5f6ead1 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:46.501607 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3e545-c597-4d88-bccc-867949b99627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:46.503034 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3e545-c597-4d88-bccc-867949b99627 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:46.503318 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3e545-c597-4d88-bccc-867949b99627 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:46.503591 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3e545-c597-4d88-bccc-867949b99627 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:46.504342 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3e545-c597-4d88-bccc-867949b99627 None admin] RBAC: Adding query filter params (name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:46.504724 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3e545-c597-4d88-bccc-867949b99627 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:46.506615 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3e545-c597-4d88-bccc-867949b99627 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:46.519149 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 299/606] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 22 09:59:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:46.519149 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3e545-c597-4d88-bccc-867949b99627 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:46.597099 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:46.620114 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3e545-c597-4d88-bccc-867949b99627 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:46.627541 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adc0d1-ec78-4758-9987-54f9e5f6ead1 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:46.659294 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58376bc-4733-4a13-b402-01249590fb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:46.660188 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58376bc-4733-4a13-b402-01249590fb3e None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:46.660473 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58376bc-4733-4a13-b402-01249590fb3e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:46.660753 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58376bc-4733-4a13-b402-01249590fb3e None admin] PATH_INFO: `/v3/projects/a2bb614e4d7747c1a3fff154c8bc18d9/users/4a4fbf9b051940bd82547a700796d118/roles/604a13bdd0fd46e182a9749de3b5232d` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:46.662177 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d618806-00a9-4a66-9346-88046f0a69ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:46.663065 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d618806-00a9-4a66-9346-88046f0a69ba None admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:46.663349 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d618806-00a9-4a66-9346-88046f0a69ba None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:46.663622 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d618806-00a9-4a66-9346-88046f0a69ba None admin] PATH_INFO: `/v3/projects/a2bb614e4d7747c1a3fff154c8bc18d9/users/6eea844b342b418895d08eef368bbd24/roles/604a13bdd0fd46e182a9749de3b5232d` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:46.680020 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58376bc-4733-4a13-b402-01249590fb3e None admin] RBAC: Authorizing `identity:create_grant(project_id=a2bb614e4d7747c1a3fff154c8bc18d9, user_id=4a4fbf9b051940bd82547a700796d118, role_id=604a13bdd0fd46e182a9749de3b5232d)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:46.681530 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58376bc-4733-4a13-b402-01249590fb3e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:46.685568 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d618806-00a9-4a66-9346-88046f0a69ba None admin] RBAC: Authorizing `identity:create_grant(project_id=a2bb614e4d7747c1a3fff154c8bc18d9, user_id=6eea844b342b418895d08eef368bbd24, role_id=604a13bdd0fd46e182a9749de3b5232d)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:46.687006 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d618806-00a9-4a66-9346-88046f0a69ba None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:46.831694 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 300/607] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 22 09:59:46 2022] PUT /identity/v3/projects/a2bb614e4d7747c1a3fff154c8bc18d9/users/4a4fbf9b051940bd82547a700796d118/roles/604a13bdd0fd46e182a9749de3b5232d => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:59:46.832434 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58376bc-4733-4a13-b402-01249590fb3e None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:46.935196 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 308/608] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 22 09:59:46 2022] PUT /identity/v3/projects/a2bb614e4d7747c1a3fff154c8bc18d9/users/6eea844b342b418895d08eef368bbd24/roles/604a13bdd0fd46e182a9749de3b5232d => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:59:46.936479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d618806-00a9-4a66-9346-88046f0a69ba None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:46.967356 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:46.982438 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58376bc-4733-4a13-b402-01249590fb3e None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:47.022435 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:47.042776 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857559e-45ad-4257-80a8-8163d41f507a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:47.043593 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857559e-45ad-4257-80a8-8163d41f507a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:47.043881 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857559e-45ad-4257-80a8-8163d41f507a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:47.044150 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857559e-45ad-4257-80a8-8163d41f507a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:47.056248 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e857559e-45ad-4257-80a8-8163d41f507a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:47.058108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e857559e-45ad-4257-80a8-8163d41f507a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:47.078306 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-e857559e-45ad-4257-80a8-8163d41f507a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 09:59:47.078306 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:47.078306 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:47.078306 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:47.078306 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:47.078306 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:47.078306 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:47.078306 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:47.078306 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:47.078306 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:47.078306 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:47.078306 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:47.078306 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 09:59:47.078306 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 09:59:47.078306 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 09:59:47.079277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 09:59:47.079277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:47.079277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:47.079277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:47.079277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:47.079277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:47.079277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:47.079277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:47.079277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:47.079277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:47.079277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:47.079277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:47.079277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:47.079277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:47.079277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:47.079277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:47.079277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:47.080416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 09:59:47.080416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 09:59:47.080416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 09:59:47.080416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 09:59:47.080416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 09:59:47.080416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 09:59:47.080416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 09:59:47.080416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:47.082451 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 301/609] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 09:59:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:47.089733 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857559e-45ad-4257-80a8-8163d41f507a None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:47.117050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d618806-00a9-4a66-9346-88046f0a69ba None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:47.180362 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d44e9-3ed1-447d-bf56-a5280d8fdfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:47.180933 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d44e9-3ed1-447d-bf56-a5280d8fdfd9 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:47.181222 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d44e9-3ed1-447d-bf56-a5280d8fdfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:47.181501 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d44e9-3ed1-447d-bf56-a5280d8fdfd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:47.194280 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d44e9-3ed1-447d-bf56-a5280d8fdfd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:47.195761 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d44e9-3ed1-447d-bf56-a5280d8fdfd9 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:47.217762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-f16d44e9-3ed1-447d-bf56-a5280d8fdfd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:47.217762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:47.217762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:47.217762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:47.217762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:47.217762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:47.217762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:47.217762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:47.217762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:47.217762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:47.217762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:47.217762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:47.217762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:47.217762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:47.217762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:47.218735 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:47.218735 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:47.218735 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:47.218735 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:47.218735 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:47.218735 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:47.218735 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:47.218735 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:47.218735 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:47.218735 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:47.218735 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:47.218735 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:47.218735 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:47.218735 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:47.218735 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:47.218735 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:47.218735 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:47.219634 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:47.219634 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:47.219634 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:47.219634 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:47.220357 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 309/610] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:47.221983 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44cb13-b23b-4d2c-96f5-801aa0516057 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:47.222502 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44cb13-b23b-4d2c-96f5-801aa0516057 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:47.223024 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44cb13-b23b-4d2c-96f5-801aa0516057 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:47.225439 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 310/611] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:47.226908 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44cb13-b23b-4d2c-96f5-801aa0516057 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:47.236955 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857559e-45ad-4257-80a8-8163d41f507a None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:47.275406 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e3824-334c-45a0-bd6e-e68f21a32416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:47.277134 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e3824-334c-45a0-bd6e-e68f21a32416 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:47.281223 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e3824-334c-45a0-bd6e-e68f21a32416 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:47.281582 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e3824-334c-45a0-bd6e-e68f21a32416 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:47.282481 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e3824-334c-45a0-bd6e-e68f21a32416 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:47.283476 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e3824-334c-45a0-bd6e-e68f21a32416 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:47.285076 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e3824-334c-45a0-bd6e-e68f21a32416 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:47.303532 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 302/612] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 09:59:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:47.305517 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af38618-c7b5-4d32-b2fb-859b5fd5d327 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:47.305796 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af38618-c7b5-4d32-b2fb-859b5fd5d327 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:47.306140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af38618-c7b5-4d32-b2fb-859b5fd5d327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:47.319478 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:47.332092 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-8af38618-c7b5-4d32-b2fb-859b5fd5d327 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:47.334790 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-8af38618-c7b5-4d32-b2fb-859b5fd5d327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:47.357754 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44cb13-b23b-4d2c-96f5-801aa0516057 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:47.388233 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:47.402568 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8da08-6fe7-4847-ac61-65e29bf14204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:47.403544 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8da08-6fe7-4847-ac61-65e29bf14204 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:47.404044 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8da08-6fe7-4847-ac61-65e29bf14204 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:47.404465 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8da08-6fe7-4847-ac61-65e29bf14204 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:47.405472 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8da08-6fe7-4847-ac61-65e29bf14204 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:47.405971 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8da08-6fe7-4847-ac61-65e29bf14204 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:47.407573 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8da08-6fe7-4847-ac61-65e29bf14204 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:47.415668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 303/613] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:47.416595 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af38618-c7b5-4d32-b2fb-859b5fd5d327 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:47.432033 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 311/614] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:47.433618 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8da08-6fe7-4847-ac61-65e29bf14204 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:47.546874 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af38618-c7b5-4d32-b2fb-859b5fd5d327 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:47.550904 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8da08-6fe7-4847-ac61-65e29bf14204 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:47.582495 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:47.589649 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47494c13-3dbb-4ce0-af9c-8a1bae058f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:47.590694 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47494c13-3dbb-4ce0-af9c-8a1bae058f8f None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:47.591157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47494c13-3dbb-4ce0-af9c-8a1bae058f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:47.591621 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47494c13-3dbb-4ce0-af9c-8a1bae058f8f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:47.592806 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4069612-ef1a-418e-9fba-c7ad45e2641c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:47.593787 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4069612-ef1a-418e-9fba-c7ad45e2641c None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:47.594317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4069612-ef1a-418e-9fba-c7ad45e2641c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:47.594669 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4069612-ef1a-418e-9fba-c7ad45e2641c None admin] PATH_INFO: `/v3/projects/a2bb614e4d7747c1a3fff154c8bc18d9/users/0bddc02875304e8c92ac367c8095efee/roles/604a13bdd0fd46e182a9749de3b5232d` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:47.600917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47494c13-3dbb-4ce0-af9c-8a1bae058f8f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:47.602649 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47494c13-3dbb-4ce0-af9c-8a1bae058f8f None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:47.612079 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4069612-ef1a-418e-9fba-c7ad45e2641c None admin] RBAC: Authorizing `identity:create_grant(project_id=a2bb614e4d7747c1a3fff154c8bc18d9, user_id=0bddc02875304e8c92ac367c8095efee, role_id=604a13bdd0fd46e182a9749de3b5232d)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:47.613687 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4069612-ef1a-418e-9fba-c7ad45e2641c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:47.618503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-47494c13-3dbb-4ce0-af9c-8a1bae058f8f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 09:59:47.618503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:47.618503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:47.618503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:47.618503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:47.618503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:47.618503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:47.618503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:47.618503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:47.618503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:47.618503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:47.618503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:47.618503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 09:59:47.618503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 09:59:47.618503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 09:59:47.618503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 09:59:47.619419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:47.619419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:47.619419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 09:59:47.619419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 09:59:47.619419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 09:59:47.619419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 09:59:47.619419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:47.619419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:47.619419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:47.619419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:47.619419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:47.619419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:47.619419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:47.619419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:47.619419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:47.619419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:47.619419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:47.619419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:47.620352 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:47.620352 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:47.620352 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 09:59:47.620352 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 09:59:47.620352 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 09:59:47.620352 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 09:59:47.620352 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 09:59:47.620352 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 09:59:47.620352 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 09:59:47.620352 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:47.626983 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 312/615] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Jun 22 09:59:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 09:59:47.626983 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47494c13-3dbb-4ce0-af9c-8a1bae058f8f None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:47.710426 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 304/616] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 22 09:59:47 2022] PUT /identity/v3/projects/a2bb614e4d7747c1a3fff154c8bc18d9/users/0bddc02875304e8c92ac367c8095efee/roles/604a13bdd0fd46e182a9749de3b5232d => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:59:47.710426 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4069612-ef1a-418e-9fba-c7ad45e2641c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:47.762470 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:47.786305 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47494c13-3dbb-4ce0-af9c-8a1bae058f8f None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:47.857141 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74761ee4-0e1e-4d95-87ec-b21c0b3e2ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:47.858251 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74761ee4-0e1e-4d95-87ec-b21c0b3e2ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:47.858251 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74761ee4-0e1e-4d95-87ec-b21c0b3e2ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:47.858528 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74761ee4-0e1e-4d95-87ec-b21c0b3e2ff5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:47.880381 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74761ee4-0e1e-4d95-87ec-b21c0b3e2ff5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:47.892801 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-74761ee4-0e1e-4d95-87ec-b21c0b3e2ff5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 09:59:47.892801 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:47.892801 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:47.892801 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:47.892801 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:47.892801 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:47.892801 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:47.892801 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:47.892801 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:47.892801 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:47.892801 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:47.892801 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:47.892801 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:47.892801 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:47.892801 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:47.892801 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:47.894750 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:47.894750 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:47.894750 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:47.894750 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:47.894750 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:47.894750 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:47.894750 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:47.894750 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:47.894750 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:47.894750 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:47.894750 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:47.894750 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:47.894750 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:47.894750 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:47.894750 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:47.894750 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:47.895587 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:47.895587 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:47.895587 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:47.895587 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:47.895587 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:47.895587 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:47.895587 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:47.895587 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:47.895587 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:47.895587 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:47.895587 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 09:59:47.895587 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:47.895587 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 313/617] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 22 09:59:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:47.903517 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74761ee4-0e1e-4d95-87ec-b21c0b3e2ff5 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:47.910351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4069612-ef1a-418e-9fba-c7ad45e2641c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:47.951662 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa4d80-8a43-4b51-b3a6-532f9637592b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:47.952338 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa4d80-8a43-4b51-b3a6-532f9637592b None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:47.952626 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa4d80-8a43-4b51-b3a6-532f9637592b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:47.952976 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa4d80-8a43-4b51-b3a6-532f9637592b None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:47.953864 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa4d80-8a43-4b51-b3a6-532f9637592b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:47.954258 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa4d80-8a43-4b51-b3a6-532f9637592b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:47.956218 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa4d80-8a43-4b51-b3a6-532f9637592b None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:47.972216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:47.976432 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 305/618] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Jun 22 09:59:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:47.981378 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa4d80-8a43-4b51-b3a6-532f9637592b None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:48.028438 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74761ee4-0e1e-4d95-87ec-b21c0b3e2ff5 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:48.066591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb38ab-5cad-4f99-b677-2bc2bbc8c365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:48.067516 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb38ab-5cad-4f99-b677-2bc2bbc8c365 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:48.068063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb38ab-5cad-4f99-b677-2bc2bbc8c365 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:48.069092 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb38ab-5cad-4f99-b677-2bc2bbc8c365 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:48.070005 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb38ab-5cad-4f99-b677-2bc2bbc8c365 None admin] RBAC: Adding query filter params (name=service) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:48.070505 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb38ab-5cad-4f99-b677-2bc2bbc8c365 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:48.072196 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb38ab-5cad-4f99-b677-2bc2bbc8c365 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:48.075656 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:48.083573 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 314/619] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 22 09:59:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:48.089101 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb38ab-5cad-4f99-b677-2bc2bbc8c365 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:48.093970 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa4d80-8a43-4b51-b3a6-532f9637592b None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:48.132504 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45d330-8410-4bc6-94bd-67dd32c0aead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:48.133586 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45d330-8410-4bc6-94bd-67dd32c0aead None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:48.133700 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45d330-8410-4bc6-94bd-67dd32c0aead None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:48.134149 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45d330-8410-4bc6-94bd-67dd32c0aead None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:48.203723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb38ab-5cad-4f99-b677-2bc2bbc8c365 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:48.211375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45d330-8410-4bc6-94bd-67dd32c0aead None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:48.213229 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45d330-8410-4bc6-94bd-67dd32c0aead None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:48.219853 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:48.243982 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf76cb-a8fa-483e-8eb9-218a40ba9321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:48.245170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf76cb-a8fa-483e-8eb9-218a40ba9321 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:48.245601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf76cb-a8fa-483e-8eb9-218a40ba9321 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:48.246050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf76cb-a8fa-483e-8eb9-218a40ba9321 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:48.258049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf76cb-a8fa-483e-8eb9-218a40ba9321 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:48.259969 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf76cb-a8fa-483e-8eb9-218a40ba9321 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:48.279609 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-7aaf76cb-a8fa-483e-8eb9-218a40ba9321 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:48.279609 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:48.279609 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:48.279609 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:48.279609 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:48.279609 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:48.279609 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:48.279609 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:48.279609 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:48.279609 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:48.279609 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:48.279609 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:48.279609 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:48.279609 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:48.279609 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:48.280588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:48.280588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:48.280588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:48.280588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:48.280588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:48.280588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:48.280588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:48.280588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:48.280588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:48.280588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:48.280588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:48.280588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:48.280588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:48.280588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:48.280588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:48.280588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:48.280588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:48.281511 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:48.281511 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:48.281511 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:48.281511 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:48.283817 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 315/620] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 09:59:48.289951 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf76cb-a8fa-483e-8eb9-218a40ba9321 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:48.305474 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:48.335747 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 306/621] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:59:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 09:59:48.341157 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45d330-8410-4bc6-94bd-67dd32c0aead None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:48.403215 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf76cb-a8fa-483e-8eb9-218a40ba9321 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:48.439257 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd643f8-5167-4bc4-ba70-d283d747d9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:48.440277 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd643f8-5167-4bc4-ba70-d283d747d9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:48.440790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd643f8-5167-4bc4-ba70-d283d747d9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:48.441316 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd643f8-5167-4bc4-ba70-d283d747d9d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:48.442320 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd643f8-5167-4bc4-ba70-d283d747d9d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:48.442891 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd643f8-5167-4bc4-ba70-d283d747d9d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:48.444504 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd643f8-5167-4bc4-ba70-d283d747d9d0 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:48.458294 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 316/622] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:48.467111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd643f8-5167-4bc4-ba70-d283d747d9d0 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:48.516257 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:48.525775 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45d330-8410-4bc6-94bd-67dd32c0aead None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:48.587874 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8cee4a-4f06-4c42-afff-785315834e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:48.589564 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8cee4a-4f06-4c42-afff-785315834e10 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:48.590023 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8cee4a-4f06-4c42-afff-785315834e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:48.590573 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8cee4a-4f06-4c42-afff-785315834e10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:48.601975 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8cee4a-4f06-4c42-afff-785315834e10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:48.603701 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8cee4a-4f06-4c42-afff-785315834e10 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:48.635829 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-0e8cee4a-4f06-4c42-afff-785315834e10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:48.635829 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:48.635829 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:48.635829 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:48.635829 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:48.635829 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:48.635829 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:48.635829 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:48.635829 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:48.635829 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:48.635829 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:48.635829 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:48.635829 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:48.635829 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:48.635829 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:48.636766 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:48.636766 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:48.636766 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:48.636766 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:48.636766 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:48.636766 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:48.636766 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:48.636766 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:48.636766 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:48.636766 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:48.636766 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:48.636766 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:48.636766 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:48.636766 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:48.636766 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:48.636766 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:48.636766 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:48.637672 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:48.637672 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:48.637672 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:48.637672 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:48.637900 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd643f8-5167-4bc4-ba70-d283d747d9d0 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:48.640356 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 307/623] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:48.645839 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8cee4a-4f06-4c42-afff-785315834e10 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:48.700702 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1927a2f-0e9f-4051-b331-8c833a604dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:48.701527 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1927a2f-0e9f-4051-b331-8c833a604dfb None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:48.701820 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1927a2f-0e9f-4051-b331-8c833a604dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:48.702096 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1927a2f-0e9f-4051-b331-8c833a604dfb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:48.716115 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1927a2f-0e9f-4051-b331-8c833a604dfb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:48.717618 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1927a2f-0e9f-4051-b331-8c833a604dfb None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:48.723954 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:48.746920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-c1927a2f-0e9f-4051-b331-8c833a604dfb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 09:59:48.746920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:48.746920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:48.746920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:48.746920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:48.746920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:48.746920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:48.746920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:48.746920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:48.746920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:48.746920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:48.746920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:48.746920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 09:59:48.746920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 09:59:48.746920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 09:59:48.746920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 09:59:48.748106 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:48.748106 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:48.748106 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 09:59:48.748106 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 09:59:48.748106 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 09:59:48.748106 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 09:59:48.748106 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:48.748106 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:48.748106 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:48.748106 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:48.748106 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:48.748106 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:48.748106 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:48.748106 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:48.748106 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:48.748106 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:48.748106 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:48.748106 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:48.749080 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:48.749080 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:48.749080 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 09:59:48.749080 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 09:59:48.749080 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 09:59:48.749080 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 09:59:48.749080 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 09:59:48.749080 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 09:59:48.749080 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 09:59:48.749080 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:48.749080 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 317/624] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 09:59:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:48.757869 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1927a2f-0e9f-4051-b331-8c833a604dfb None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:48.821067 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8cee4a-4f06-4c42-afff-785315834e10 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:48.885093 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8813f23-21b8-494d-ae16-e6d934dd5491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:48.885773 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8813f23-21b8-494d-ae16-e6d934dd5491 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:48.886062 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8813f23-21b8-494d-ae16-e6d934dd5491 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:48.891334 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8813f23-21b8-494d-ae16-e6d934dd5491 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:48.892311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8813f23-21b8-494d-ae16-e6d934dd5491 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:48.892633 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8813f23-21b8-494d-ae16-e6d934dd5491 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:48.894089 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8813f23-21b8-494d-ae16-e6d934dd5491 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:48.915999 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:48.918815 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 308/625] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:48.925194 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8813f23-21b8-494d-ae16-e6d934dd5491 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:48.946032 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1927a2f-0e9f-4051-b331-8c833a604dfb None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:49.011009 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4392bb-8e36-4206-8948-c2a840d5b401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:49.011689 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4392bb-8e36-4206-8948-c2a840d5b401 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:49.011976 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4392bb-8e36-4206-8948-c2a840d5b401 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:49.012257 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4392bb-8e36-4206-8948-c2a840d5b401 None admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:49.013138 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4392bb-8e36-4206-8948-c2a840d5b401 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:49.013451 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4392bb-8e36-4206-8948-c2a840d5b401 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:49.014887 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4392bb-8e36-4206-8948-c2a840d5b401 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:49.056662 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 318/626] 10.222.0.46 () {56 vars in 1135 bytes} [Wed Jun 22 09:59:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:49.066002 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4392bb-8e36-4206-8948-c2a840d5b401 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:49.082136 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8813f23-21b8-494d-ae16-e6d934dd5491 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:49.084660 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:49.140784 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea98eb-f639-4aa4-a3b2-1c9d83c6617d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:49.142058 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea98eb-f639-4aa4-a3b2-1c9d83c6617d None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:49.142545 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea98eb-f639-4aa4-a3b2-1c9d83c6617d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:49.143047 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea98eb-f639-4aa4-a3b2-1c9d83c6617d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:49.156275 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea98eb-f639-4aa4-a3b2-1c9d83c6617d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:49.159788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea98eb-f639-4aa4-a3b2-1c9d83c6617d None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:49.189525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-94ea98eb-f639-4aa4-a3b2-1c9d83c6617d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 09:59:49.189525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:49.189525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:49.189525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:49.189525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:49.189525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:49.189525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:49.189525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:49.189525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:49.189525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:49.189525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:49.189525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:49.189525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 09:59:49.189525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 09:59:49.189525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 09:59:49.190516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 09:59:49.190516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:49.190516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:49.190516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:49.190516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:49.190516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:49.190516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:49.190516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:49.190516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:49.190516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:49.190516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:49.190516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:49.190516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:49.190516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:49.190516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:49.190516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:49.190516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:49.191365 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 09:59:49.191365 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 09:59:49.191365 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 09:59:49.191365 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 09:59:49.191365 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 09:59:49.191365 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 09:59:49.191365 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 09:59:49.191365 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:49.196086 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 309/627] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 09:59:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:49.202067 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea98eb-f639-4aa4-a3b2-1c9d83c6617d None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:49.281825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4392bb-8e36-4206-8948-c2a840d5b401 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:49.339084 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea19ae2-0681-42aa-9465-9be476c53b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:49.339879 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea19ae2-0681-42aa-9465-9be476c53b13 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:49.340160 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea19ae2-0681-42aa-9465-9be476c53b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:49.340432 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea19ae2-0681-42aa-9465-9be476c53b13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:49.351669 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea19ae2-0681-42aa-9465-9be476c53b13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:49.353306 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea19ae2-0681-42aa-9465-9be476c53b13 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:49.355118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:49.368243 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea98eb-f639-4aa4-a3b2-1c9d83c6617d None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:49.374526 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-fea19ae2-0681-42aa-9465-9be476c53b13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:49.374526 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:49.374526 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:49.374526 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:49.374526 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:49.374526 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:49.374526 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:49.374526 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:49.374526 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:49.374526 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:49.374526 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:49.374526 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:49.374526 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:49.374526 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:49.374526 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:49.375554 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:49.375554 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:49.375554 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:49.375554 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:49.375554 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:49.375554 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:49.375554 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:49.375554 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:49.375554 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:49.375554 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:49.375554 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:49.375554 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:49.375554 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:49.375554 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:49.375554 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:49.375554 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:49.375554 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:49.376432 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:49.376432 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:49.376432 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:49.376432 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:49.376652 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 319/628] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:49.381739 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd43e2-6a6f-401a-b5eb-caf0ae065e95 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:49.381739 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd43e2-6a6f-401a-b5eb-caf0ae065e95 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:49.381739 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd43e2-6a6f-401a-b5eb-caf0ae065e95 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:49.382352 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 320/629] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:49.383707 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdca428-0b60-47a7-a661-8b8feb0e680d None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:49.384055 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdca428-0b60-47a7-a661-8b8feb0e680d None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:49.384329 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdca428-0b60-47a7-a661-8b8feb0e680d None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:49.385693 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 321/630] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:49.386490 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdca428-0b60-47a7-a661-8b8feb0e680d None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:49.408143 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e39112-0995-42d9-994a-bd0418a45a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:49.408805 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e39112-0995-42d9-994a-bd0418a45a0e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:49.409115 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e39112-0995-42d9-994a-bd0418a45a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:49.409392 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e39112-0995-42d9-994a-bd0418a45a0e None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:49.410509 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e39112-0995-42d9-994a-bd0418a45a0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:49.410616 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e39112-0995-42d9-994a-bd0418a45a0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:49.412057 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e39112-0995-42d9-994a-bd0418a45a0e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:49.428308 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 310/631] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 09:59:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:49.428308 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c845d0-3261-4c0c-8988-6d4b7380a163 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:49.428308 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c845d0-3261-4c0c-8988-6d4b7380a163 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:49.428308 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c845d0-3261-4c0c-8988-6d4b7380a163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:49.444632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-68c845d0-3261-4c0c-8988-6d4b7380a163 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:49.445796 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-68c845d0-3261-4c0c-8988-6d4b7380a163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:49.457311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:49.497604 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdca428-0b60-47a7-a661-8b8feb0e680d None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:49.516263 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 311/632] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:49.522524 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32492c75-d0f6-4dad-9b00-f72e253e5134 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:49.523021 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32492c75-d0f6-4dad-9b00-f72e253e5134 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:49.523682 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32492c75-d0f6-4dad-9b00-f72e253e5134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:49.543281 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-32492c75-d0f6-4dad-9b00-f72e253e5134 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:49.544465 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-32492c75-d0f6-4dad-9b00-f72e253e5134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:49.546419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ffa61-6ba8-4a08-a378-2dcea8d9f9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:49.547145 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ffa61-6ba8-4a08-a378-2dcea8d9f9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:49.547435 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ffa61-6ba8-4a08-a378-2dcea8d9f9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:49.547770 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ffa61-6ba8-4a08-a378-2dcea8d9f9b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:49.548554 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ffa61-6ba8-4a08-a378-2dcea8d9f9b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:49.548926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ffa61-6ba8-4a08-a378-2dcea8d9f9b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:49.550385 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ffa61-6ba8-4a08-a378-2dcea8d9f9b7 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:49.564974 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 322/633] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:49.565888 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ffa61-6ba8-4a08-a378-2dcea8d9f9b7 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:49.622149 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 312/634] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:49.623022 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32492c75-d0f6-4dad-9b00-f72e253e5134 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:49.631872 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:49.688800 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ffa61-6ba8-4a08-a378-2dcea8d9f9b7 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:49.716988 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:49.724839 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9dc90-c745-43bc-9186-a9d483a698fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:49.725567 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9dc90-c745-43bc-9186-a9d483a698fd None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:49.726084 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9dc90-c745-43bc-9186-a9d483a698fd None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:49.733481 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9dc90-c745-43bc-9186-a9d483a698fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:49.733481 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9dc90-c745-43bc-9186-a9d483a698fd None admin] RBAC: Adding query filter params (role.id=604a13bdd0fd46e182a9749de3b5232d, scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9, user.id=4ed9a00723ab4af2b633ab7614d178a8) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:49.733481 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9dc90-c745-43bc-9186-a9d483a698fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:49.733481 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9dc90-c745-43bc-9186-a9d483a698fd None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:49.734969 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 323/635] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 09:59:49 2022] GET /identity/v3/role_assignments?user.id=4ed9a00723ab4af2b633ab7614d178a8&scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9&role.id=604a13bdd0fd46e182a9749de3b5232d => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:49.735769 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9dc90-c745-43bc-9186-a9d483a698fd None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:49.752472 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32492c75-d0f6-4dad-9b00-f72e253e5134 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:49.795486 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5975e-c9bb-4e2a-9135-34f2f9fc457e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:49.796644 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5975e-c9bb-4e2a-9135-34f2f9fc457e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:49.797148 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5975e-c9bb-4e2a-9135-34f2f9fc457e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:49.797577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5975e-c9bb-4e2a-9135-34f2f9fc457e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:49.810900 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5975e-c9bb-4e2a-9135-34f2f9fc457e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:49.819584 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-70c5975e-c9bb-4e2a-9135-34f2f9fc457e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 09:59:49.819584 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:49.819584 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:49.819584 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:49.819584 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:49.819584 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:49.819584 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:49.819584 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:49.819584 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:49.819584 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:49.819584 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:49.819584 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:49.819584 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:49.819584 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:49.819584 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:49.819584 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:49.820811 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:49.820811 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:49.820811 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:49.820811 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:49.820811 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:49.820811 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:49.820811 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:49.820811 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:49.820811 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:49.820811 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:49.820811 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:49.820811 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:49.820811 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:49.820811 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:49.820811 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:49.820811 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:49.821836 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:49.821836 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:49.821836 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:49.821836 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:49.821836 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:49.821836 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:49.821836 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:49.821836 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:49.821836 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:49.821836 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:49.821836 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 09:59:49.821836 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:49.824205 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 313/636] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 22 09:59:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:49.825303 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5975e-c9bb-4e2a-9135-34f2f9fc457e None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:49.907376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9dc90-c745-43bc-9186-a9d483a698fd None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:49.928200 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:49.949568 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf93cd-32cc-43e9-8c2b-973f389d07b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:49.950370 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf93cd-32cc-43e9-8c2b-973f389d07b9 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:49.950651 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf93cd-32cc-43e9-8c2b-973f389d07b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:49.950928 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf93cd-32cc-43e9-8c2b-973f389d07b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:49.960968 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf93cd-32cc-43e9-8c2b-973f389d07b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:49.962525 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf93cd-32cc-43e9-8c2b-973f389d07b9 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:49.964256 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5975e-c9bb-4e2a-9135-34f2f9fc457e None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:49.978533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-ffdf93cd-32cc-43e9-8c2b-973f389d07b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 09:59:49.978533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:49.978533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:49.978533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:49.978533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:49.978533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:49.978533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:49.978533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:49.978533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:49.978533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:49.978533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:49.978533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:49.978533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 09:59:49.978533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 09:59:49.978533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 09:59:49.979575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 09:59:49.979575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:49.979575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:49.979575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:49.979575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:49.979575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:49.979575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:49.979575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:49.979575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:49.979575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:49.979575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:49.979575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:49.979575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:49.979575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:49.979575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:49.979575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:49.979575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:49.980545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 09:59:49.980545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 09:59:49.980545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 09:59:49.980545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 09:59:49.980545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 09:59:49.980545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 09:59:49.980545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 09:59:49.980545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:49.982758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 324/637] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 09:59:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:49.983568 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf93cd-32cc-43e9-8c2b-973f389d07b9 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:50.012129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53f8e7-cb72-49b8-8ec4-f107c6688e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:50.012969 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53f8e7-cb72-49b8-8ec4-f107c6688e85 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:50.013257 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53f8e7-cb72-49b8-8ec4-f107c6688e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:50.013533 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53f8e7-cb72-49b8-8ec4-f107c6688e85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:50.017322 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:50.028312 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53f8e7-cb72-49b8-8ec4-f107c6688e85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:50.037770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-9a53f8e7-cb72-49b8-8ec4-f107c6688e85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 09:59:50.037770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:50.037770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:50.037770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:50.037770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:50.037770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:50.037770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:50.037770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:50.037770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:50.037770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:50.037770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:50.037770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:50.037770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:50.037770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:50.037770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:50.037770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:50.043289 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:50.043289 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:50.043289 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:50.043289 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:50.043289 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:50.043289 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:50.043289 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:50.043289 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:50.043289 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:50.043289 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:50.043289 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:50.043289 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:50.043289 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:50.043289 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:50.043289 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:50.043289 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:50.044349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:50.044349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:50.044349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:50.044349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:50.044349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:50.044349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:50.044349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:50.044349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:50.044349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:50.044349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:50.044349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 09:59:50.044349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:50.044349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 314/638] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 22 09:59:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:50.044349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53f8e7-cb72-49b8-8ec4-f107c6688e85 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:50.110857 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf93cd-32cc-43e9-8c2b-973f389d07b9 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:50.147552 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9157743-e712-4a4e-89a7-448d16f779e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:50.148647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9157743-e712-4a4e-89a7-448d16f779e4 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:50.148647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9157743-e712-4a4e-89a7-448d16f779e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:50.148951 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9157743-e712-4a4e-89a7-448d16f779e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:50.149598 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9157743-e712-4a4e-89a7-448d16f779e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:50.149913 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9157743-e712-4a4e-89a7-448d16f779e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:50.151292 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9157743-e712-4a4e-89a7-448d16f779e4 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:50.164449 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 325/639] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 22 09:59:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:50.164449 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9157743-e712-4a4e-89a7-448d16f779e4 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:50.172348 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53f8e7-cb72-49b8-8ec4-f107c6688e85 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:50.207529 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:50.211561 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebc0a2-0645-4fb8-af93-9a8507d6fe56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:50.212231 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebc0a2-0645-4fb8-af93-9a8507d6fe56 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:50.212517 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebc0a2-0645-4fb8-af93-9a8507d6fe56 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:50.212802 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebc0a2-0645-4fb8-af93-9a8507d6fe56 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:50.213631 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ebc0a2-0645-4fb8-af93-9a8507d6fe56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:50.213944 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ebc0a2-0645-4fb8-af93-9a8507d6fe56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:50.215458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ebc0a2-0645-4fb8-af93-9a8507d6fe56 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:50.232479 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 315/640] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 09:59:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:50.232479 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091526a-3fae-4fa5-90fd-cd78e1f88dfd None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:50.232479 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091526a-3fae-4fa5-90fd-cd78e1f88dfd None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:50.232479 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091526a-3fae-4fa5-90fd-cd78e1f88dfd None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:50.232479 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 316/641] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:50.232479 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091526a-3fae-4fa5-90fd-cd78e1f88dfd None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:50.275088 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9157743-e712-4a4e-89a7-448d16f779e4 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:50.293399 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:50.309889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7977da5-d2e0-4534-ac74-1963e2391cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:50.310581 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7977da5-d2e0-4534-ac74-1963e2391cbe None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:50.310857 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7977da5-d2e0-4534-ac74-1963e2391cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:50.311225 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7977da5-d2e0-4534-ac74-1963e2391cbe None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:50.311898 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7977da5-d2e0-4534-ac74-1963e2391cbe None admin] RBAC: Adding query filter params (name=service) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:50.312210 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7977da5-d2e0-4534-ac74-1963e2391cbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:50.313612 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7977da5-d2e0-4534-ac74-1963e2391cbe None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:50.323709 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 326/642] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 22 09:59:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:50.324520 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7977da5-d2e0-4534-ac74-1963e2391cbe None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:50.345970 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091526a-3fae-4fa5-90fd-cd78e1f88dfd None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:50.385184 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf9cc5-03d3-4891-b948-e26512758f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:50.385975 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf9cc5-03d3-4891-b948-e26512758f12 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:50.386261 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf9cc5-03d3-4891-b948-e26512758f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:50.386535 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf9cc5-03d3-4891-b948-e26512758f12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:50.398808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf9cc5-03d3-4891-b948-e26512758f12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:50.400271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf9cc5-03d3-4891-b948-e26512758f12 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:50.417808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-d3bf9cc5-03d3-4891-b948-e26512758f12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:50.417808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:50.417808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:50.417808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:50.417808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:50.417808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:50.417808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:50.417808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:50.417808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:50.417808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:50.417808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:50.417808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:50.417808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:50.417808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:50.417808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:50.418803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:50.418803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:50.418803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:50.418803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:50.418803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:50.418803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:50.418803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:50.418803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:50.418803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:50.418803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:50.418803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:50.418803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:50.418803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:50.418803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:50.418803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:50.418803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:50.418803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:50.419685 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:50.419685 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:50.419685 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:50.419685 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:50.423582 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 317/643] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:50.424907 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679db09-d4fa-4e23-97d2-17908d069f9c None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:50.425202 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679db09-d4fa-4e23-97d2-17908d069f9c None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:50.425482 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679db09-d4fa-4e23-97d2-17908d069f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:50.434612 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7977da5-d2e0-4534-ac74-1963e2391cbe None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:50.436367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:50.444199 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-d679db09-d4fa-4e23-97d2-17908d069f9c None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:50.445421 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-d679db09-d4fa-4e23-97d2-17908d069f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:50.474858 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae42ec-8910-48d0-b280-d0b7dd4089db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:50.475752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae42ec-8910-48d0-b280-d0b7dd4089db None admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:50.476123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae42ec-8910-48d0-b280-d0b7dd4089db None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:50.476387 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae42ec-8910-48d0-b280-d0b7dd4089db None admin] PATH_INFO: `/v3/projects/a2bb614e4d7747c1a3fff154c8bc18d9/users/9c724063ce51470ca09c5c5ab231fd9b/roles/604a13bdd0fd46e182a9749de3b5232d` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:50.493424 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae42ec-8910-48d0-b280-d0b7dd4089db None admin] RBAC: Authorizing `identity:create_grant(project_id=a2bb614e4d7747c1a3fff154c8bc18d9, user_id=9c724063ce51470ca09c5c5ab231fd9b, role_id=604a13bdd0fd46e182a9749de3b5232d)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:50.495242 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae42ec-8910-48d0-b280-d0b7dd4089db None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:50.516397 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 318/644] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:50.517288 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679db09-d4fa-4e23-97d2-17908d069f9c None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:50.557132 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:50.570023 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 327/645] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 22 09:59:50 2022] PUT /identity/v3/projects/a2bb614e4d7747c1a3fff154c8bc18d9/users/9c724063ce51470ca09c5c5ab231fd9b/roles/604a13bdd0fd46e182a9749de3b5232d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 09:59:50.571070 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae42ec-8910-48d0-b280-d0b7dd4089db None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:50.648750 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679db09-d4fa-4e23-97d2-17908d069f9c None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:50.698698 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a36c13-d834-4b18-8bb5-0795e5798d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:50.700408 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a36c13-d834-4b18-8bb5-0795e5798d5a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:50.701165 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a36c13-d834-4b18-8bb5-0795e5798d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:50.701607 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a36c13-d834-4b18-8bb5-0795e5798d5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:50.717054 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a36c13-d834-4b18-8bb5-0795e5798d5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:50.719846 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a36c13-d834-4b18-8bb5-0795e5798d5a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:50.721690 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae42ec-8910-48d0-b280-d0b7dd4089db None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:50.744151 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-b7a36c13-d834-4b18-8bb5-0795e5798d5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:50.744151 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:50.744151 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:50.744151 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:50.744151 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:50.744151 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:50.744151 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:50.744151 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:50.744151 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:50.744151 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:50.744151 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:50.744151 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:50.744151 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:50.744151 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:50.744151 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:50.745094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:50.745094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:50.745094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:50.745094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:50.745094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:50.745094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:50.745094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:50.745094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:50.745094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:50.745094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:50.745094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:50.745094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:50.745094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:50.745094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:50.745094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:50.745094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:50.745094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:50.747485 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:50.747485 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:50.747485 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:50.747485 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:50.747485 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 319/646] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:50.747485 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a36c13-d834-4b18-8bb5-0795e5798d5a None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:50.772295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b322a4-0f52-4fa5-85ea-d2d83b0273b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:50.773003 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b322a4-0f52-4fa5-85ea-d2d83b0273b3 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:50.773292 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b322a4-0f52-4fa5-85ea-d2d83b0273b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:50.773567 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b322a4-0f52-4fa5-85ea-d2d83b0273b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:50.774308 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b322a4-0f52-4fa5-85ea-d2d83b0273b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:50.774617 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b322a4-0f52-4fa5-85ea-d2d83b0273b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:50.776007 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b322a4-0f52-4fa5-85ea-d2d83b0273b3 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:50.790238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 328/647] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:50.791491 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b322a4-0f52-4fa5-85ea-d2d83b0273b3 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:50.808580 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:50.865816 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:50.875486 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a36c13-d834-4b18-8bb5-0795e5798d5a None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:50.913933 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2a73c-d439-4fab-bbff-0f3b30f2f55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:50.914947 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2a73c-d439-4fab-bbff-0f3b30f2f55b None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:50.915305 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2a73c-d439-4fab-bbff-0f3b30f2f55b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:50.915654 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2a73c-d439-4fab-bbff-0f3b30f2f55b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:50.920497 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b322a4-0f52-4fa5-85ea-d2d83b0273b3 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:50.927004 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2a73c-d439-4fab-bbff-0f3b30f2f55b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:50.935537 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-46d2a73c-d439-4fab-bbff-0f3b30f2f55b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 09:59:50.935537 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:50.935537 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:50.935537 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:50.935537 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:50.935537 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:50.935537 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:50.935537 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:50.935537 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:50.935537 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:50.935537 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:50.935537 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:50.935537 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:50.935537 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:50.935537 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:50.935537 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:50.936481 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:50.936481 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:50.936481 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:50.936481 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:50.936481 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:50.936481 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:50.936481 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:50.936481 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:50.936481 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:50.936481 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:50.936481 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:50.936481 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:50.936481 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:50.936481 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:50.936481 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:50.936481 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:50.937497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:50.937497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:50.937497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:50.937497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:50.937497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:50.937497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:50.937497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:50.937497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:50.937497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:50.937497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:50.937497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 09:59:50.937497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:50.937497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 320/648] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 22 09:59:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:50.938443 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2a73c-d439-4fab-bbff-0f3b30f2f55b None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:50.960442 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd3b27-1685-412e-aeac-a1fb6ebf664a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:50.961411 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd3b27-1685-412e-aeac-a1fb6ebf664a None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:50.961695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd3b27-1685-412e-aeac-a1fb6ebf664a None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:50.961976 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd3b27-1685-412e-aeac-a1fb6ebf664a None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:50.962788 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd3b27-1685-412e-aeac-a1fb6ebf664a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:50.963095 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd3b27-1685-412e-aeac-a1fb6ebf664a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:50.964939 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd3b27-1685-412e-aeac-a1fb6ebf664a None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:50.983467 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 329/649] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:50.984449 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd3b27-1685-412e-aeac-a1fb6ebf664a None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:51.071269 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:51.073713 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2a73c-d439-4fab-bbff-0f3b30f2f55b None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:51.109960 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd3b27-1685-412e-aeac-a1fb6ebf664a None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:51.127114 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591900d-6681-4242-a5e2-c3ab5a3b952d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:51.128351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591900d-6681-4242-a5e2-c3ab5a3b952d None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:51.128737 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591900d-6681-4242-a5e2-c3ab5a3b952d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:51.129563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591900d-6681-4242-a5e2-c3ab5a3b952d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:51.140796 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591900d-6681-4242-a5e2-c3ab5a3b952d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:51.143402 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591900d-6681-4242-a5e2-c3ab5a3b952d None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:51.148569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b3e72-9c92-4e55-9cea-74202e886b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:51.149520 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b3e72-9c92-4e55-9cea-74202e886b22 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:51.149950 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b3e72-9c92-4e55-9cea-74202e886b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:51.150401 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b3e72-9c92-4e55-9cea-74202e886b22 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:51.151324 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b3e72-9c92-4e55-9cea-74202e886b22 None admin] RBAC: Adding query filter params (name=service) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:51.151816 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b3e72-9c92-4e55-9cea-74202e886b22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:51.153419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b3e72-9c92-4e55-9cea-74202e886b22 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:51.162180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-c591900d-6681-4242-a5e2-c3ab5a3b952d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 09:59:51.162180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:51.162180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:51.162180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:51.162180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:51.162180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:51.162180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:51.162180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:51.162180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:51.162180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:51.162180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:51.162180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:51.162180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 09:59:51.162180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 09:59:51.162180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 09:59:51.162180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 09:59:51.163108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:51.163108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:51.163108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 09:59:51.163108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 09:59:51.163108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 09:59:51.163108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 09:59:51.163108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:51.163108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:51.163108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:51.163108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:51.163108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:51.163108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:51.163108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:51.163108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:51.163108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:51.163108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:51.163108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:51.163108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:51.164631 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:51.164631 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:51.164631 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 09:59:51.164631 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 09:59:51.164631 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 09:59:51.164631 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 09:59:51.164631 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 09:59:51.164631 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 09:59:51.164631 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 09:59:51.164631 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:51.164631 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 321/650] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:59:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:51.165244 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591900d-6681-4242-a5e2-c3ab5a3b952d None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:51.170941 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 330/651] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 22 09:59:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:51.172096 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b3e72-9c92-4e55-9cea-74202e886b22 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:51.180326 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:51.278299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591900d-6681-4242-a5e2-c3ab5a3b952d None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:51.304537 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b3e72-9c92-4e55-9cea-74202e886b22 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:51.324341 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a0533-6976-4aed-8366-5aadc9ffdce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:51.325265 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a0533-6976-4aed-8366-5aadc9ffdce6 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:51.325650 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a0533-6976-4aed-8366-5aadc9ffdce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:51.326031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a0533-6976-4aed-8366-5aadc9ffdce6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:51.338797 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a0533-6976-4aed-8366-5aadc9ffdce6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:51.340496 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a0533-6976-4aed-8366-5aadc9ffdce6 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:51.342057 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35b45b-2695-4af9-b7f2-a08e6c8886eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:51.342949 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35b45b-2695-4af9-b7f2-a08e6c8886eb None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:51.343399 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35b45b-2695-4af9-b7f2-a08e6c8886eb None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:51.343816 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35b45b-2695-4af9-b7f2-a08e6c8886eb None admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:51.344785 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35b45b-2695-4af9-b7f2-a08e6c8886eb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:51.345277 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35b45b-2695-4af9-b7f2-a08e6c8886eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:51.346901 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35b45b-2695-4af9-b7f2-a08e6c8886eb None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:51.349109 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:51.359230 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-8e2a0533-6976-4aed-8366-5aadc9ffdce6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 22 09:59:51.359230 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:51.359230 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:51.359230 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:51.359230 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:51.359230 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:51.359230 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:51.359230 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:51.359230 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:51.359230 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:51.359230 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:51.359230 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:51.359230 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 09:59:51.359230 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 09:59:51.359230 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 09:59:51.359230 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 09:59:51.365469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:51.365469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:51.365469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 09:59:51.365469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 09:59:51.365469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 09:59:51.365469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 09:59:51.365469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:51.365469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:51.365469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:51.365469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:51.365469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:51.365469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:51.365469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:51.365469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:51.365469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:51.365469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:51.365469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:51.365469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:51.366483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:51.366483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:51.366483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 09:59:51.366483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 09:59:51.366483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 09:59:51.366483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 09:59:51.366483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 09:59:51.366483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 09:59:51.366483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 22 09:59:51.366483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:51.366483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 322/652] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:59:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:51.366483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a0533-6976-4aed-8366-5aadc9ffdce6 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:51.374281 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 331/653] 10.222.0.46 () {56 vars in 1137 bytes} [Wed Jun 22 09:59:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:51.375610 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35b45b-2695-4af9-b7f2-a08e6c8886eb None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:51.446455 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:51.490766 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a0533-6976-4aed-8366-5aadc9ffdce6 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:51.501601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35b45b-2695-4af9-b7f2-a08e6c8886eb None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:51.531465 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0628b0-9ae1-4a1b-b966-afb694a41a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:51.532759 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0628b0-9ae1-4a1b-b966-afb694a41a9c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:51.533549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0628b0-9ae1-4a1b-b966-afb694a41a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:51.534273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0628b0-9ae1-4a1b-b966-afb694a41a9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:51.545463 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57f46e-bb21-4c8b-b3a4-fa332c3913f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:51.546252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57f46e-bb21-4c8b-b3a4-fa332c3913f8 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:51.546622 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57f46e-bb21-4c8b-b3a4-fa332c3913f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:51.547251 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57f46e-bb21-4c8b-b3a4-fa332c3913f8 None admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:51.548070 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0628b0-9ae1-4a1b-b966-afb694a41a9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:51.548178 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57f46e-bb21-4c8b-b3a4-fa332c3913f8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:51.548550 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57f46e-bb21-4c8b-b3a4-fa332c3913f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:51.550070 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0628b0-9ae1-4a1b-b966-afb694a41a9c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:51.550193 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57f46e-bb21-4c8b-b3a4-fa332c3913f8 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:51.575964 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 332/654] 10.222.0.46 () {56 vars in 1137 bytes} [Wed Jun 22 09:59:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:51.575964 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57f46e-bb21-4c8b-b3a4-fa332c3913f8 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:51.576683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-ae0628b0-9ae1-4a1b-b966-afb694a41a9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:51.576683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:51.576683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:51.576683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:51.576683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:51.576683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:51.576683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:51.576683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:51.576683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:51.576683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:51.576683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:51.576683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:51.576683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:51.576683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:51.576683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:51.577738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:51.577738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:51.577738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:51.577738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:51.577738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:51.577738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:51.577738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:51.577738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:51.577738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:51.577738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:51.577738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:51.577738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:51.577738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:51.577738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:51.577738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:51.577738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:51.577738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:51.578798 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:51.578798 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:51.578798 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:51.578798 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:51.587304 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 323/655] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:51.588885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0628b0-9ae1-4a1b-b966-afb694a41a9c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:51.636486 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:51.701112 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57f46e-bb21-4c8b-b3a4-fa332c3913f8 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:51.709414 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0628b0-9ae1-4a1b-b966-afb694a41a9c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:51.734044 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:51.740369 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c99c1e-89d4-4de3-bf6d-5575c5cafe80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:51.741694 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c99c1e-89d4-4de3-bf6d-5575c5cafe80 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:51.746317 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c99c1e-89d4-4de3-bf6d-5575c5cafe80 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:51.746317 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c99c1e-89d4-4de3-bf6d-5575c5cafe80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:51.747513 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527f4b7-da6e-4e53-a8a4-ce31341a55a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:51.748246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527f4b7-da6e-4e53-a8a4-ce31341a55a3 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:51.748620 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527f4b7-da6e-4e53-a8a4-ce31341a55a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:51.749017 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527f4b7-da6e-4e53-a8a4-ce31341a55a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:51.827609 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527f4b7-da6e-4e53-a8a4-ce31341a55a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:51.827787 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c99c1e-89d4-4de3-bf6d-5575c5cafe80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:51.829219 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527f4b7-da6e-4e53-a8a4-ce31341a55a3 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:51.829588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c99c1e-89d4-4de3-bf6d-5575c5cafe80 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:51.896350 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:51.944903 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 324/656] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:59:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 09:59:51.946615 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527f4b7-da6e-4e53-a8a4-ce31341a55a3 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:51.960732 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 333/657] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:59:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 09:59:51.962052 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c99c1e-89d4-4de3-bf6d-5575c5cafe80 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:51.977734 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:52.067365 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c99c1e-89d4-4de3-bf6d-5575c5cafe80 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:52.070313 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527f4b7-da6e-4e53-a8a4-ce31341a55a3 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:52.104702 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88ffa5-f4f2-4b06-a446-7a2729ff8fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:52.105447 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88ffa5-f4f2-4b06-a446-7a2729ff8fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:52.105730 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88ffa5-f4f2-4b06-a446-7a2729ff8fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:52.105995 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88ffa5-f4f2-4b06-a446-7a2729ff8fb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:52.108230 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123c570-0648-443a-885d-021731e82958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:52.109259 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123c570-0648-443a-885d-021731e82958 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:52.109550 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123c570-0648-443a-885d-021731e82958 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:52.109830 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123c570-0648-443a-885d-021731e82958 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:52.110566 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123c570-0648-443a-885d-021731e82958 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:52.110880 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123c570-0648-443a-885d-021731e82958 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:52.112258 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123c570-0648-443a-885d-021731e82958 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:52.117813 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88ffa5-f4f2-4b06-a446-7a2729ff8fb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:52.119479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88ffa5-f4f2-4b06-a446-7a2729ff8fb1 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:52.129623 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 325/658] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:52.129623 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123c570-0648-443a-885d-021731e82958 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:52.141409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-5a88ffa5-f4f2-4b06-a446-7a2729ff8fb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:52.141409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:52.141409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:52.141409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:52.141409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:52.141409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:52.141409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:52.141409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:52.141409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:52.141409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:52.141409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:52.141409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:52.141409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:52.141409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:52.141409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:52.142336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:52.142336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:52.142336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:52.142336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:52.142336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:52.142336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:52.142336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:52.142336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:52.142336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:52.142336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:52.142336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:52.142336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:52.142336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:52.142336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:52.142336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:52.142336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:52.142336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:52.143238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:52.143238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:52.143238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:52.143238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:52.143238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 334/659] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:52.143984 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97175d7b-3ab0-4aa0-9ec1-46461a1824f7 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:52.144085 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97175d7b-3ab0-4aa0-9ec1-46461a1824f7 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:52.144398 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97175d7b-3ab0-4aa0-9ec1-46461a1824f7 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:52.149658 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 335/660] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:52.150438 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97175d7b-3ab0-4aa0-9ec1-46461a1824f7 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:52.153595 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:52.219137 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:52.237185 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123c570-0648-443a-885d-021731e82958 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:52.271668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbcc28c-5a32-4115-a62f-f784a713170e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:52.272468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcc28c-5a32-4115-a62f-f784a713170e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:52.272755 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcc28c-5a32-4115-a62f-f784a713170e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:52.273063 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcc28c-5a32-4115-a62f-f784a713170e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:52.275325 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97175d7b-3ab0-4aa0-9ec1-46461a1824f7 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:52.283287 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbcc28c-5a32-4115-a62f-f784a713170e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:52.284752 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbcc28c-5a32-4115-a62f-f784a713170e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:52.305031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-2bbcc28c-5a32-4115-a62f-f784a713170e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:52.305031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:52.305031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:52.305031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:52.305031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:52.305031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:52.305031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:52.305031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:52.305031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:52.305031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:52.305031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:52.305031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:52.305031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:52.305031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:52.305031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:52.306141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:52.306141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:52.306141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:52.306141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:52.306141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:52.306141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:52.306141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:52.306141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:52.306141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:52.306141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:52.306141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:52.306141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:52.306141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:52.306141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:52.306141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:52.306141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:52.306141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:52.307220 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:52.307220 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:52.307220 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:52.307220 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:52.312638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 326/661] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:52.312638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbcc28c-5a32-4115-a62f-f784a713170e None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:52.323109 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b660f3-a811-4d67-8231-a34322b0032a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:52.324159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b660f3-a811-4d67-8231-a34322b0032a None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:52.324514 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b660f3-a811-4d67-8231-a34322b0032a None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:52.324966 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b660f3-a811-4d67-8231-a34322b0032a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:52.333933 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b660f3-a811-4d67-8231-a34322b0032a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:52.335650 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b660f3-a811-4d67-8231-a34322b0032a None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:52.352483 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-88b660f3-a811-4d67-8231-a34322b0032a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 09:59:52.352483 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:52.352483 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:52.352483 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:52.352483 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:52.352483 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:52.352483 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:52.352483 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:52.352483 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:52.352483 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:52.352483 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:52.352483 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:52.352483 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 09:59:52.352483 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 09:59:52.352483 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 09:59:52.352483 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 09:59:52.353549 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:52.353549 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:52.353549 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 09:59:52.353549 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 09:59:52.353549 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 09:59:52.353549 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 09:59:52.353549 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:52.353549 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:52.353549 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:52.353549 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:52.353549 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:52.353549 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:52.353549 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:52.353549 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:52.353549 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:52.353549 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:52.353549 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:52.353549 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:52.354563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:52.354563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:52.354563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 09:59:52.354563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 09:59:52.354563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 09:59:52.354563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 09:59:52.354563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 09:59:52.354563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 09:59:52.354563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 09:59:52.354563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:52.354563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 336/662] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 22 09:59:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:52.355720 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e010b-d8f6-44be-ae68-40ceb0a2f7ab None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:52.355720 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e010b-d8f6-44be-ae68-40ceb0a2f7ab None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:52.356334 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e010b-d8f6-44be-ae68-40ceb0a2f7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:52.374264 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-597e010b-d8f6-44be-ae68-40ceb0a2f7ab None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:52.375509 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-597e010b-d8f6-44be-ae68-40ceb0a2f7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:52.420092 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbcc28c-5a32-4115-a62f-f784a713170e None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:52.438294 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:52.449237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 337/663] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:52.453684 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e010b-d8f6-44be-ae68-40ceb0a2f7ab None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:52.456957 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c8493-6b0e-4c8e-a407-3eb98b0715bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:52.457628 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c8493-6b0e-4c8e-a407-3eb98b0715bd None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:52.457910 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c8493-6b0e-4c8e-a407-3eb98b0715bd None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:52.458715 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c8493-6b0e-4c8e-a407-3eb98b0715bd None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:52.459842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c8493-6b0e-4c8e-a407-3eb98b0715bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:52.459842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c8493-6b0e-4c8e-a407-3eb98b0715bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:52.461154 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c8493-6b0e-4c8e-a407-3eb98b0715bd None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:52.462860 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:52.480137 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 327/664] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:52.481044 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c8493-6b0e-4c8e-a407-3eb98b0715bd None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:52.570781 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e010b-d8f6-44be-ae68-40ceb0a2f7ab None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:52.595481 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c8493-6b0e-4c8e-a407-3eb98b0715bd None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:52.608432 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11c4bb-8049-46eb-84d7-dae56e2e2d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:52.609623 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11c4bb-8049-46eb-84d7-dae56e2e2d88 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:52.609909 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11c4bb-8049-46eb-84d7-dae56e2e2d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:52.610394 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11c4bb-8049-46eb-84d7-dae56e2e2d88 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:52.610919 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c11c4bb-8049-46eb-84d7-dae56e2e2d88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:52.611231 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c11c4bb-8049-46eb-84d7-dae56e2e2d88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:52.612615 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c11c4bb-8049-46eb-84d7-dae56e2e2d88 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:52.628602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 338/665] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:52.628602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11c4bb-8049-46eb-84d7-dae56e2e2d88 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:52.636058 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f2d51-1b91-4dfe-938f-c0d01acf6dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:52.636732 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f2d51-1b91-4dfe-938f-c0d01acf6dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:52.637045 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f2d51-1b91-4dfe-938f-c0d01acf6dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:52.637327 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f2d51-1b91-4dfe-938f-c0d01acf6dd1 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:52.638171 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f2d51-1b91-4dfe-938f-c0d01acf6dd1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:52.638486 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f2d51-1b91-4dfe-938f-c0d01acf6dd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:52.639928 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f2d51-1b91-4dfe-938f-c0d01acf6dd1 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:52.658313 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 328/666] 10.222.0.46 () {56 vars in 1139 bytes} [Wed Jun 22 09:59:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:52.664067 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f2d51-1b91-4dfe-938f-c0d01acf6dd1 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:52.696647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:52.721204 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:52.748413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11c4bb-8049-46eb-84d7-dae56e2e2d88 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:52.767840 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f2d51-1b91-4dfe-938f-c0d01acf6dd1 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:52.783873 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4a7df-f502-4032-b820-53b7dc2c193a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:52.784802 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4a7df-f502-4032-b820-53b7dc2c193a None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:52.785118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4a7df-f502-4032-b820-53b7dc2c193a None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:52.785392 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4a7df-f502-4032-b820-53b7dc2c193a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:52.796773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4a7df-f502-4032-b820-53b7dc2c193a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:52.804580 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-56e4a7df-f502-4032-b820-53b7dc2c193a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 09:59:52.804580 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:52.804580 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:52.804580 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:52.804580 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:52.804580 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:52.804580 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:52.804580 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:52.804580 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:52.804580 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:52.804580 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:52.804580 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:52.804580 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:52.804580 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:52.804580 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:52.804580 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:52.805777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:52.805777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:52.805777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:52.805777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:52.805777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:52.805777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:52.805777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:52.805777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:52.805777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:52.805777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:52.805777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:52.805777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:52.805777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:52.805777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:52.805777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:52.805777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:52.806773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:52.806773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:52.806773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:52.806773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:52.806773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:52.806773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:52.806773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:52.806773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:52.806773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:52.806773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:52.806773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 09:59:52.806773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:52.806773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 339/667] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 09:59:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:52.806773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4a7df-f502-4032-b820-53b7dc2c193a None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:52.818547 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e77fb-92d4-46fa-a7c2-95f4ae14759b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:52.819342 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e77fb-92d4-46fa-a7c2-95f4ae14759b None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:52.819621 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e77fb-92d4-46fa-a7c2-95f4ae14759b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:52.819891 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e77fb-92d4-46fa-a7c2-95f4ae14759b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:52.827067 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e77fb-92d4-46fa-a7c2-95f4ae14759b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:52.828521 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e77fb-92d4-46fa-a7c2-95f4ae14759b None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:52.843319 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-976e77fb-92d4-46fa-a7c2-95f4ae14759b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 09:59:52.843319 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:52.843319 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:52.843319 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:52.843319 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:52.843319 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:52.843319 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:52.843319 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:52.843319 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:52.843319 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:52.843319 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:52.843319 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:52.843319 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 09:59:52.843319 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 09:59:52.843319 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 09:59:52.844397 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 09:59:52.844397 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:52.844397 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:52.844397 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:52.844397 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:52.844397 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:52.844397 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:52.844397 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:52.844397 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:52.844397 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:52.844397 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:52.844397 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:52.844397 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:52.844397 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:52.844397 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:52.844397 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:52.844397 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:52.845523 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 09:59:52.845523 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 09:59:52.845523 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 09:59:52.845523 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 09:59:52.845523 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 09:59:52.845523 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 09:59:52.845523 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 09:59:52.845523 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:52.845523 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 329/668] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 09:59:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:52.845523 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e77fb-92d4-46fa-a7c2-95f4ae14759b None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:52.920425 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4a7df-f502-4032-b820-53b7dc2c193a None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:52.933098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:52.953151 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e77fb-92d4-46fa-a7c2-95f4ae14759b None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:52.954769 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9905a-7d96-42a5-8a4c-d7ba901e90f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:52.955568 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9905a-7d96-42a5-8a4c-d7ba901e90f8 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:52.955858 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9905a-7d96-42a5-8a4c-d7ba901e90f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:52.956138 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9905a-7d96-42a5-8a4c-d7ba901e90f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:52.963550 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9905a-7d96-42a5-8a4c-d7ba901e90f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:52.965024 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9905a-7d96-42a5-8a4c-d7ba901e90f8 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:52.966401 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:52.979255 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-3db9905a-7d96-42a5-8a4c-d7ba901e90f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 09:59:52.979255 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:52.979255 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:52.979255 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:52.979255 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:52.979255 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:52.979255 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:52.979255 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:52.979255 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:52.979255 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:52.979255 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:52.979255 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:52.979255 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 09:59:52.979255 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 09:59:52.979255 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 09:59:52.981719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 09:59:52.981719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:52.981719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:52.981719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:52.981719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:52.981719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:52.981719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:52.981719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:52.981719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:52.981719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:52.981719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:52.981719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:52.981719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:52.981719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:52.981719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:52.981719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:52.981719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:52.982611 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 09:59:52.982611 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 09:59:52.982611 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 09:59:52.982611 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 09:59:52.982611 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 09:59:52.982611 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 09:59:52.982611 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 09:59:52.982611 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:52.982611 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 340/669] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 09:59:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:52.982611 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c000f8-7efb-40e7-b761-66bdb702f1a8 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:52.982611 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c000f8-7efb-40e7-b761-66bdb702f1a8 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:52.983357 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c000f8-7efb-40e7-b761-66bdb702f1a8 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:52.983867 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 341/670] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:52.984632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c000f8-7efb-40e7-b761-66bdb702f1a8 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:52.989071 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee88c2-f460-4278-acc9-a1206dfe7582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:52.989762 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee88c2-f460-4278-acc9-a1206dfe7582 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:52.990083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee88c2-f460-4278-acc9-a1206dfe7582 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:52.990364 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee88c2-f460-4278-acc9-a1206dfe7582 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:53.061918 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee88c2-f460-4278-acc9-a1206dfe7582 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:53.063428 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee88c2-f460-4278-acc9-a1206dfe7582 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:53.090680 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c000f8-7efb-40e7-b761-66bdb702f1a8 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:53.131126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17282581-0298-4a22-ad80-45d3a1c9cb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:53.131796 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17282581-0298-4a22-ad80-45d3a1c9cb3f None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:53.132081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17282581-0298-4a22-ad80-45d3a1c9cb3f None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:53.132365 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17282581-0298-4a22-ad80-45d3a1c9cb3f None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:53.133154 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17282581-0298-4a22-ad80-45d3a1c9cb3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:53.133463 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17282581-0298-4a22-ad80-45d3a1c9cb3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:53.134833 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17282581-0298-4a22-ad80-45d3a1c9cb3f None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:53.143397 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 342/671] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:59:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:53.144259 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17282581-0298-4a22-ad80-45d3a1c9cb3f None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:53.178313 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 330/672] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:59:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 09:59:53.179071 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee88c2-f460-4278-acc9-a1206dfe7582 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:53.184038 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:53.193802 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:53.249799 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17282581-0298-4a22-ad80-45d3a1c9cb3f None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:53.276981 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee88c2-f460-4278-acc9-a1206dfe7582 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:53.282912 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7c45c-100d-4c31-a31f-0cccba52eaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:53.283568 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7c45c-100d-4c31-a31f-0cccba52eaa6 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:53.283848 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7c45c-100d-4c31-a31f-0cccba52eaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:53.284127 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7c45c-100d-4c31-a31f-0cccba52eaa6 None admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:53.284941 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7c45c-100d-4c31-a31f-0cccba52eaa6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:53.285249 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7c45c-100d-4c31-a31f-0cccba52eaa6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:53.287217 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7c45c-100d-4c31-a31f-0cccba52eaa6 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:53.300838 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 343/673] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 09:59:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:53.302249 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c29132-2a46-4f64-8d6e-24242d7f7c33 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:53.302640 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c29132-2a46-4f64-8d6e-24242d7f7c33 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:53.303084 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c29132-2a46-4f64-8d6e-24242d7f7c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:53.313100 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f13901-274a-4f55-a447-7ab20d0362d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:53.314183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f13901-274a-4f55-a447-7ab20d0362d1 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:53.314472 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f13901-274a-4f55-a447-7ab20d0362d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:53.314753 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f13901-274a-4f55-a447-7ab20d0362d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:53.315556 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f13901-274a-4f55-a447-7ab20d0362d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:53.315869 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f13901-274a-4f55-a447-7ab20d0362d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:53.317339 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f13901-274a-4f55-a447-7ab20d0362d1 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:53.319168 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-95c29132-2a46-4f64-8d6e-24242d7f7c33 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:53.320365 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-95c29132-2a46-4f64-8d6e-24242d7f7c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:53.328958 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 331/674] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 09:59:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:53.330012 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f13901-274a-4f55-a447-7ab20d0362d1 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:53.387474 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 344/675] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:53.388584 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c29132-2a46-4f64-8d6e-24242d7f7c33 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:53.403010 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:53.421044 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:53.435778 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f13901-274a-4f55-a447-7ab20d0362d1 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:53.470316 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9470d-cddb-4216-9739-5f000fc56309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:53.471099 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9470d-cddb-4216-9739-5f000fc56309 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:53.471385 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9470d-cddb-4216-9739-5f000fc56309 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:53.471655 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9470d-cddb-4216-9739-5f000fc56309 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:53.482188 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9470d-cddb-4216-9739-5f000fc56309 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:53.483626 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9470d-cddb-4216-9739-5f000fc56309 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:53.496603 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c29132-2a46-4f64-8d6e-24242d7f7c33 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:53.500129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-e2e9470d-cddb-4216-9739-5f000fc56309 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:53.500129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:53.500129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:53.500129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:53.500129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:53.500129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:53.500129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:53.500129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:53.500129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:53.500129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:53.500129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:53.500129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:53.500129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:53.500129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:53.500129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:53.501213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:53.501213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:53.501213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:53.501213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:53.501213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:53.501213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:53.501213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:53.501213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:53.501213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:53.501213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:53.501213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:53.501213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:53.501213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:53.501213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:53.501213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:53.501213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:53.501213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:53.502138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:53.502138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:53.502138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:53.502138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:53.502138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 332/676] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:53.502492 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9470d-cddb-4216-9739-5f000fc56309 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:53.530906 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2c4a8-ddcb-4ab3-a34b-40253fc995eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:53.531699 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2c4a8-ddcb-4ab3-a34b-40253fc995eb None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:53.531978 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2c4a8-ddcb-4ab3-a34b-40253fc995eb None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:53.532253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2c4a8-ddcb-4ab3-a34b-40253fc995eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:53.542557 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a2c4a8-ddcb-4ab3-a34b-40253fc995eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:53.543997 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a2c4a8-ddcb-4ab3-a34b-40253fc995eb None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:53.562477 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-30a2c4a8-ddcb-4ab3-a34b-40253fc995eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:53.562477 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:53.562477 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:53.562477 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:53.562477 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:53.562477 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:53.562477 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:53.562477 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:53.562477 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:53.562477 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:53.562477 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:53.562477 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:53.562477 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:53.562477 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:53.562477 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:53.563413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:53.563413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:53.563413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:53.563413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:53.563413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:53.563413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:53.563413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:53.563413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:53.563413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:53.563413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:53.563413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:53.563413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:53.563413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:53.563413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:53.563413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:53.563413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:53.563413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:53.564352 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:53.564352 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:53.564352 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:53.564352 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:53.568806 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 345/677] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:53.569414 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2c4a8-ddcb-4ab3-a34b-40253fc995eb None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:53.602851 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9470d-cddb-4216-9739-5f000fc56309 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:53.630570 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:53.641233 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20432c90-725b-48b2-be8f-fc17e0fb49c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:53.641890 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20432c90-725b-48b2-be8f-fc17e0fb49c7 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:53.642178 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20432c90-725b-48b2-be8f-fc17e0fb49c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:53.642458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20432c90-725b-48b2-be8f-fc17e0fb49c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:53.643301 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20432c90-725b-48b2-be8f-fc17e0fb49c7 None admin] RBAC: Adding query filter params (role.id=604a13bdd0fd46e182a9749de3b5232d, scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9, user.id=4a4fbf9b051940bd82547a700796d118) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:53.643618 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20432c90-725b-48b2-be8f-fc17e0fb49c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:53.645082 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20432c90-725b-48b2-be8f-fc17e0fb49c7 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:53.647771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:53.651648 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 333/678] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 09:59:53 2022] GET /identity/v3/role_assignments?user.id=4a4fbf9b051940bd82547a700796d118&scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9&role.id=604a13bdd0fd46e182a9749de3b5232d => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:53.652433 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20432c90-725b-48b2-be8f-fc17e0fb49c7 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:53.676519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2c4a8-ddcb-4ab3-a34b-40253fc995eb None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:53.721885 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a29376-360c-4b68-98c4-82e453ba9633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:53.722463 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a29376-360c-4b68-98c4-82e453ba9633 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:53.722748 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a29376-360c-4b68-98c4-82e453ba9633 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:53.723019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a29376-360c-4b68-98c4-82e453ba9633 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:53.723911 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a29376-360c-4b68-98c4-82e453ba9633 None admin] RBAC: Adding query filter params (role.id=604a13bdd0fd46e182a9749de3b5232d, scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9, user.id=6eea844b342b418895d08eef368bbd24) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:53.724224 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a29376-360c-4b68-98c4-82e453ba9633 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:53.725726 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a29376-360c-4b68-98c4-82e453ba9633 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:53.732410 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 346/679] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 09:59:53 2022] GET /identity/v3/role_assignments?user.id=6eea844b342b418895d08eef368bbd24&scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9&role.id=604a13bdd0fd46e182a9749de3b5232d => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:53.733316 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a29376-360c-4b68-98c4-82e453ba9633 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:53.806285 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20432c90-725b-48b2-be8f-fc17e0fb49c7 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:53.862231 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94aca4-3eb8-4baf-80d1-17c93f08ef25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:53.863050 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94aca4-3eb8-4baf-80d1-17c93f08ef25 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:53.863345 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94aca4-3eb8-4baf-80d1-17c93f08ef25 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:53.863782 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94aca4-3eb8-4baf-80d1-17c93f08ef25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:53.876573 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a29376-360c-4b68-98c4-82e453ba9633 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:53.881807 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94aca4-3eb8-4baf-80d1-17c93f08ef25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:53.892614 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-be94aca4-3eb8-4baf-80d1-17c93f08ef25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 09:59:53.892614 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:53.892614 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:53.892614 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:53.892614 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:53.892614 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:53.892614 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:53.892614 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:53.892614 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:53.892614 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:53.892614 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:53.892614 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:53.892614 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:53.892614 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:53.892614 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:53.892614 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:53.897902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:53.897902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:53.897902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:53.897902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:53.897902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:53.897902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:53.897902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:53.897902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:53.897902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:53.897902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:53.897902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:53.897902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:53.897902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:53.897902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:53.897902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:53.897902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:53.898751 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:53.898751 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:53.898751 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:53.898751 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:53.898751 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:53.898751 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:53.898751 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:53.898751 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:53.898751 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:53.898751 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:53.898751 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 09:59:53.898751 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:53.898751 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 334/680] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 22 09:59:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:53.898751 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94aca4-3eb8-4baf-80d1-17c93f08ef25 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:53.927489 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520982c-c297-45c4-8038-a45fcd7bb75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:53.928174 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520982c-c297-45c4-8038-a45fcd7bb75f None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:53.928460 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520982c-c297-45c4-8038-a45fcd7bb75f None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:53.928738 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520982c-c297-45c4-8038-a45fcd7bb75f None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:53.929756 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520982c-c297-45c4-8038-a45fcd7bb75f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:53.930072 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520982c-c297-45c4-8038-a45fcd7bb75f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:53.931457 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520982c-c297-45c4-8038-a45fcd7bb75f None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:53.940561 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:53.945263 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 347/681] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:53.946348 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520982c-c297-45c4-8038-a45fcd7bb75f None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:53.959520 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:54.033533 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94aca4-3eb8-4baf-80d1-17c93f08ef25 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:54.063755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520982c-c297-45c4-8038-a45fcd7bb75f None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:54.078923 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0ff78-6938-4cff-b181-91864912fe16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:54.080039 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0ff78-6938-4cff-b181-91864912fe16 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:54.080500 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0ff78-6938-4cff-b181-91864912fe16 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:54.080783 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0ff78-6938-4cff-b181-91864912fe16 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:54.081741 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0ff78-6938-4cff-b181-91864912fe16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:54.082063 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0ff78-6938-4cff-b181-91864912fe16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:54.083838 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0ff78-6938-4cff-b181-91864912fe16 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:54.100700 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 335/682] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:54.101675 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0ff78-6938-4cff-b181-91864912fe16 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:54.106450 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b464c-0da2-4568-a78a-e638f3a6ec9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:54.107200 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b464c-0da2-4568-a78a-e638f3a6ec9a None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:54.107483 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b464c-0da2-4568-a78a-e638f3a6ec9a None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:54.107758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b464c-0da2-4568-a78a-e638f3a6ec9a None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:54.108626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b464c-0da2-4568-a78a-e638f3a6ec9a None admin] RBAC: Adding query filter params (name=service) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:54.108974 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b464c-0da2-4568-a78a-e638f3a6ec9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:54.110429 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b464c-0da2-4568-a78a-e638f3a6ec9a None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:54.125288 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 348/683] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 22 09:59:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:54.126314 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b464c-0da2-4568-a78a-e638f3a6ec9a None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:54.194327 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:54.231647 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0ff78-6938-4cff-b181-91864912fe16 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:54.245671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:54.253339 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b464c-0da2-4568-a78a-e638f3a6ec9a None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:54.274464 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc282c4-2668-4915-80ec-240ddd770dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:54.275276 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc282c4-2668-4915-80ec-240ddd770dcd None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:54.275565 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc282c4-2668-4915-80ec-240ddd770dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:54.275851 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc282c4-2668-4915-80ec-240ddd770dcd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:54.283924 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc282c4-2668-4915-80ec-240ddd770dcd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:54.285529 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc282c4-2668-4915-80ec-240ddd770dcd None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:54.298738 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102dea5-4599-405d-98b1-3749d5be9250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:54.299879 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102dea5-4599-405d-98b1-3749d5be9250 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:54.300313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102dea5-4599-405d-98b1-3749d5be9250 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:54.300800 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102dea5-4599-405d-98b1-3749d5be9250 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:54.303103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-1cc282c4-2668-4915-80ec-240ddd770dcd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 09:59:54.303103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:54.303103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:54.303103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:54.303103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:54.303103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:54.303103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:54.303103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:54.303103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:54.303103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:54.303103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:54.303103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:54.303103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 09:59:54.303103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 09:59:54.303103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 09:59:54.303103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 09:59:54.304217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:54.304217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:54.304217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 09:59:54.304217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 09:59:54.304217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 09:59:54.304217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 09:59:54.304217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:54.304217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:54.304217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:54.304217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:54.304217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:54.304217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:54.304217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:54.304217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:54.304217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:54.304217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:54.304217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:54.304217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:54.305324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:54.305324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:54.305324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 09:59:54.305324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 09:59:54.305324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 09:59:54.305324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 09:59:54.305324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 09:59:54.305324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 09:59:54.305324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 09:59:54.305324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:54.313166 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 336/684] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Jun 22 09:59:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:54.313166 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc282c4-2668-4915-80ec-240ddd770dcd None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:54.318343 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9102dea5-4599-405d-98b1-3749d5be9250 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:54.319811 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9102dea5-4599-405d-98b1-3749d5be9250 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:54.338306 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-9102dea5-4599-405d-98b1-3749d5be9250 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 09:59:54.338306 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:54.338306 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:54.338306 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:54.338306 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:54.338306 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:54.338306 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:54.338306 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:54.338306 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:54.338306 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:54.338306 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:54.338306 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:54.338306 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 09:59:54.338306 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 09:59:54.338306 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 09:59:54.339253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 09:59:54.339253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:54.339253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:54.339253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:54.339253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:54.339253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:54.339253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:54.339253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:54.339253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:54.339253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:54.339253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:54.339253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:54.339253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:54.339253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:54.339253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:54.339253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:54.339253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:54.340167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 09:59:54.340167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 09:59:54.340167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 09:59:54.340167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 09:59:54.340167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 09:59:54.340167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 09:59:54.340167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 09:59:54.340167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:54.340167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 349/685] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 09:59:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:54.341161 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102dea5-4599-405d-98b1-3749d5be9250 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:54.449051 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102dea5-4599-405d-98b1-3749d5be9250 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:54.450169 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc282c4-2668-4915-80ec-240ddd770dcd None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:54.481652 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:54.493169 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3871b-a5be-4aaf-a86a-1cb4a97073c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:54.494054 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3871b-a5be-4aaf-a86a-1cb4a97073c7 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:54.494412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3871b-a5be-4aaf-a86a-1cb4a97073c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:54.494762 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3871b-a5be-4aaf-a86a-1cb4a97073c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:54.497369 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152687f-2981-43ad-9100-6324f20a7128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:54.498710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152687f-2981-43ad-9100-6324f20a7128 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:54.499184 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152687f-2981-43ad-9100-6324f20a7128 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:54.499658 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152687f-2981-43ad-9100-6324f20a7128 None admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:54.500709 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152687f-2981-43ad-9100-6324f20a7128 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:54.501318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152687f-2981-43ad-9100-6324f20a7128 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:54.503654 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152687f-2981-43ad-9100-6324f20a7128 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:54.509189 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3871b-a5be-4aaf-a86a-1cb4a97073c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:54.509189 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3871b-a5be-4aaf-a86a-1cb4a97073c7 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:54.531204 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-13a3871b-a5be-4aaf-a86a-1cb4a97073c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:54.531204 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:54.531204 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:54.531204 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:54.531204 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:54.531204 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:54.531204 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:54.531204 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:54.531204 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:54.531204 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:54.531204 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:54.531204 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:54.531204 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:54.531204 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:54.531204 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:54.532135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:54.532135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:54.532135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:54.532135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:54.532135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:54.532135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:54.532135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:54.532135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:54.532135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:54.532135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:54.532135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:54.532135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:54.532135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:54.532135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:54.532135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:54.532135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:54.532135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:54.533051 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:54.533051 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:54.533051 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:54.533051 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:54.533051 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 337/686] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:54.533051 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3871b-a5be-4aaf-a86a-1cb4a97073c7 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:54.534145 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 350/687] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Jun 22 09:59:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:54.535293 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152687f-2981-43ad-9100-6324f20a7128 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:54.558872 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:54.644603 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3871b-a5be-4aaf-a86a-1cb4a97073c7 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:54.669096 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152687f-2981-43ad-9100-6324f20a7128 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:54.706287 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a849b37-f788-4fea-bb31-900bb794bf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:54.707738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a849b37-f788-4fea-bb31-900bb794bf5b None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:54.708434 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a849b37-f788-4fea-bb31-900bb794bf5b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:54.708969 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a849b37-f788-4fea-bb31-900bb794bf5b None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:54.710560 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a849b37-f788-4fea-bb31-900bb794bf5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:54.711060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a849b37-f788-4fea-bb31-900bb794bf5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:54.712915 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a849b37-f788-4fea-bb31-900bb794bf5b None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:54.715364 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7261e01-3210-4875-bf23-b24a6c696d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:54.716139 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7261e01-3210-4875-bf23-b24a6c696d9e None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:54.716525 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7261e01-3210-4875-bf23-b24a6c696d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:54.716939 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7261e01-3210-4875-bf23-b24a6c696d9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:54.736037 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 338/688] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 09:59:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:54.736037 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a849b37-f788-4fea-bb31-900bb794bf5b None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:54.784326 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:54.812581 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7261e01-3210-4875-bf23-b24a6c696d9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:54.815405 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7261e01-3210-4875-bf23-b24a6c696d9e None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:54.822867 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:54.849679 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a849b37-f788-4fea-bb31-900bb794bf5b None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:54.883734 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b15d4-286f-4bb4-9890-ae5bd82e2fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:54.884501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b15d4-286f-4bb4-9890-ae5bd82e2fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:54.884926 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b15d4-286f-4bb4-9890-ae5bd82e2fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:54.885285 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b15d4-286f-4bb4-9890-ae5bd82e2fb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:54.886254 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b15d4-286f-4bb4-9890-ae5bd82e2fb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:54.886562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b15d4-286f-4bb4-9890-ae5bd82e2fb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:54.888598 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b15d4-286f-4bb4-9890-ae5bd82e2fb8 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:54.907206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 339/689] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:54.907206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b15d4-286f-4bb4-9890-ae5bd82e2fb8 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:54.964876 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 351/690] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:59:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 09:59:54.965939 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7261e01-3210-4875-bf23-b24a6c696d9e None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:55.017802 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b15d4-286f-4bb4-9890-ae5bd82e2fb8 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:55.050028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:55.056976 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992e12a-5890-4d17-9ba3-5a4a9c3802a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:55.057795 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992e12a-5890-4d17-9ba3-5a4a9c3802a8 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:55.058158 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992e12a-5890-4d17-9ba3-5a4a9c3802a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:55.058489 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992e12a-5890-4d17-9ba3-5a4a9c3802a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:55.059385 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992e12a-5890-4d17-9ba3-5a4a9c3802a8 None admin] RBAC: Adding query filter params (role.id=604a13bdd0fd46e182a9749de3b5232d, scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9, user.id=0bddc02875304e8c92ac367c8095efee) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:55.059763 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992e12a-5890-4d17-9ba3-5a4a9c3802a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:55.061346 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5992e12a-5890-4d17-9ba3-5a4a9c3802a8 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:55.074855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7261e01-3210-4875-bf23-b24a6c696d9e None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:55.075447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 340/691] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 09:59:54 2022] GET /identity/v3/role_assignments?user.id=0bddc02875304e8c92ac367c8095efee&scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9&role.id=604a13bdd0fd46e182a9749de3b5232d => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:55.076503 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992e12a-5890-4d17-9ba3-5a4a9c3802a8 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:55.094218 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:55.119823 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084394b7-68a7-4cad-b5d1-570e87650c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:55.120701 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084394b7-68a7-4cad-b5d1-570e87650c3a None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:55.121048 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084394b7-68a7-4cad-b5d1-570e87650c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:55.121337 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084394b7-68a7-4cad-b5d1-570e87650c3a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:55.131400 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084394b7-68a7-4cad-b5d1-570e87650c3a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:55.133593 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084394b7-68a7-4cad-b5d1-570e87650c3a None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:55.153719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-084394b7-68a7-4cad-b5d1-570e87650c3a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 09:59:55.153719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:55.153719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:55.153719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:55.153719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:55.153719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:55.153719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:55.153719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:55.153719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:55.153719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:55.153719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:55.153719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:55.153719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 09:59:55.153719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 09:59:55.153719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 09:59:55.153719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 09:59:55.154986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:55.154986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:55.154986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 09:59:55.154986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 09:59:55.154986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 09:59:55.154986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 09:59:55.154986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:55.154986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:55.154986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:55.154986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:55.154986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:55.154986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:55.154986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:55.154986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:55.154986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:55.154986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:55.154986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:55.154986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:55.156116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:55.156116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:55.156116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 09:59:55.156116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 09:59:55.156116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 09:59:55.156116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 09:59:55.156116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 09:59:55.156116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 09:59:55.156116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 09:59:55.156116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:55.156116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 352/692] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 09:59:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:55.164991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084394b7-68a7-4cad-b5d1-570e87650c3a None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:55.310934 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992e12a-5890-4d17-9ba3-5a4a9c3802a8 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:55.348978 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084394b7-68a7-4cad-b5d1-570e87650c3a None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:55.357214 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe67899-64dc-4b5e-b67b-b8f45c3a1dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:55.358531 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe67899-64dc-4b5e-b67b-b8f45c3a1dbe None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:55.358819 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe67899-64dc-4b5e-b67b-b8f45c3a1dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:55.359100 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe67899-64dc-4b5e-b67b-b8f45c3a1dbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:55.375271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe67899-64dc-4b5e-b67b-b8f45c3a1dbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:55.376790 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe67899-64dc-4b5e-b67b-b8f45c3a1dbe None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:55.393523 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa0e21-4f56-43e8-9c25-bf3d2fbfb80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:55.394347 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa0e21-4f56-43e8-9c25-bf3d2fbfb80e None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:55.394733 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa0e21-4f56-43e8-9c25-bf3d2fbfb80e None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:55.395133 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa0e21-4f56-43e8-9c25-bf3d2fbfb80e None admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:55.396138 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa0e21-4f56-43e8-9c25-bf3d2fbfb80e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:55.396557 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa0e21-4f56-43e8-9c25-bf3d2fbfb80e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:55.398165 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa0e21-4f56-43e8-9c25-bf3d2fbfb80e None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:55.399649 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-abe67899-64dc-4b5e-b67b-b8f45c3a1dbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:55.399649 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:55.399649 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:55.399649 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:55.399649 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:55.399649 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:55.399649 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:55.399649 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:55.399649 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:55.399649 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:55.399649 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:55.399649 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:55.399649 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:55.399649 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:55.399649 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:55.400505 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:55.400505 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:55.400505 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:55.400505 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:55.400505 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:55.400505 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:55.400505 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:55.400505 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:55.400505 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:55.400505 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:55.400505 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:55.400505 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:55.400505 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:55.400505 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:55.400505 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:55.400505 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:55.400505 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:55.401582 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:55.401582 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:55.401582 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:55.401582 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:55.401582 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 341/693] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:55.407359 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe67899-64dc-4b5e-b67b-b8f45c3a1dbe None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:55.416376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:55.426108 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 353/694] 10.222.0.46 () {56 vars in 1135 bytes} [Wed Jun 22 09:59:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 09:59:55.432562 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa0e21-4f56-43e8-9c25-bf3d2fbfb80e None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:55.477776 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:55.536632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe67899-64dc-4b5e-b67b-b8f45c3a1dbe None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:55.566895 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa0e21-4f56-43e8-9c25-bf3d2fbfb80e None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:55.581240 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff59cea-4823-4ce8-a513-c681a31ae226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:55.582493 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff59cea-4823-4ce8-a513-c681a31ae226 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:55.582788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff59cea-4823-4ce8-a513-c681a31ae226 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:55.583104 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff59cea-4823-4ce8-a513-c681a31ae226 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:55.583863 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff59cea-4823-4ce8-a513-c681a31ae226 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:55.584177 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff59cea-4823-4ce8-a513-c681a31ae226 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:55.586356 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff59cea-4823-4ce8-a513-c681a31ae226 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:55.603899 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 342/695] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:55.609778 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff59cea-4823-4ce8-a513-c681a31ae226 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:55.618615 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0c79b-636e-4598-a1ba-e0f35cd5c535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:55.619681 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0c79b-636e-4598-a1ba-e0f35cd5c535 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:55.620167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0c79b-636e-4598-a1ba-e0f35cd5c535 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:55.620701 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0c79b-636e-4598-a1ba-e0f35cd5c535 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:55.706032 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:55.710151 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0c79b-636e-4598-a1ba-e0f35cd5c535 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:55.711931 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0c79b-636e-4598-a1ba-e0f35cd5c535 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:55.820439 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 354/696] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 09:59:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 09:59:55.826311 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0c79b-636e-4598-a1ba-e0f35cd5c535 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:55.859053 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff59cea-4823-4ce8-a513-c681a31ae226 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:55.907081 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:55.937643 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:55.943784 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0c79b-636e-4598-a1ba-e0f35cd5c535 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:55.946740 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205a7f9-a3b8-411b-942a-eb9127f28f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:55.947650 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205a7f9-a3b8-411b-942a-eb9127f28f3e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:55.948034 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205a7f9-a3b8-411b-942a-eb9127f28f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:55.948412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205a7f9-a3b8-411b-942a-eb9127f28f3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:55.957202 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205a7f9-a3b8-411b-942a-eb9127f28f3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:55.958816 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205a7f9-a3b8-411b-942a-eb9127f28f3e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:55.973298 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-a205a7f9-a3b8-411b-942a-eb9127f28f3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 09:59:55.973298 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:55.973298 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:55.973298 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:55.973298 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:55.973298 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:55.973298 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:55.973298 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:55.973298 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:55.973298 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:55.973298 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:55.973298 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:55.973298 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 09:59:55.973298 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 09:59:55.973298 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 09:59:55.975017 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 09:59:55.975017 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:55.975017 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:55.975017 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:55.975017 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:55.975017 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:55.975017 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:55.975017 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:55.975017 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:55.975017 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:55.975017 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:55.975017 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:55.975017 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:55.975017 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:55.975017 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:55.975017 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:55.975017 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:55.976618 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 09:59:55.976618 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 09:59:55.976618 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 09:59:55.976618 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 09:59:55.976618 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 09:59:55.976618 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 09:59:55.976618 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 09:59:55.976618 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:55.977619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 343/697] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 09:59:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:55.980948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33197f9d-99ae-47b4-95d0-3b95a67aaf8c None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:55.980948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33197f9d-99ae-47b4-95d0-3b95a67aaf8c None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:55.980948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33197f9d-99ae-47b4-95d0-3b95a67aaf8c None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:55.980948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 344/698] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:55.984278 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33197f9d-99ae-47b4-95d0-3b95a67aaf8c None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:55.988295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a9e2f-a59a-47ae-a38f-591c1f04a454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:55.990718 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a9e2f-a59a-47ae-a38f-591c1f04a454 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:55.992028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a9e2f-a59a-47ae-a38f-591c1f04a454 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:55.992519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a9e2f-a59a-47ae-a38f-591c1f04a454 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:56.003889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a9e2f-a59a-47ae-a38f-591c1f04a454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:56.005798 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a9e2f-a59a-47ae-a38f-591c1f04a454 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:56.024401 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-984a9e2f-a59a-47ae-a38f-591c1f04a454 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:56.024401 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:56.024401 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:56.024401 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:56.024401 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:56.024401 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:56.024401 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:56.024401 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:56.024401 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:56.024401 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:56.024401 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:56.024401 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:56.024401 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:56.024401 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:56.024401 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:56.025591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:56.025591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:56.025591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:56.025591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:56.025591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:56.025591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:56.025591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:56.025591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:56.025591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:56.025591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:56.025591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:56.025591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:56.025591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:56.025591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:56.025591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:56.025591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:56.025591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:56.026690 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:56.026690 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:56.026690 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:56.026690 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:56.028241 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 355/699] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:56.029687 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c7bb2-a3c7-4574-b342-e9ac68362f6d None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:56.030173 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c7bb2-a3c7-4574-b342-e9ac68362f6d None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:56.030613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c7bb2-a3c7-4574-b342-e9ac68362f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:56.050182 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-500c7bb2-a3c7-4574-b342-e9ac68362f6d None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:56.051390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-500c7bb2-a3c7-4574-b342-e9ac68362f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:56.094236 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33197f9d-99ae-47b4-95d0-3b95a67aaf8c None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:56.124155 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 356/700] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:56.125956 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71495e88-9023-471d-b68b-d937e79198d5 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:56.126256 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71495e88-9023-471d-b68b-d937e79198d5 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:56.126537 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71495e88-9023-471d-b68b-d937e79198d5 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:56.127940 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 357/701] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:56.132571 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71495e88-9023-471d-b68b-d937e79198d5 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:56.137247 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380618e-18ea-4990-810f-828db9dd6968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:56.137918 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380618e-18ea-4990-810f-828db9dd6968 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:56.138203 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380618e-18ea-4990-810f-828db9dd6968 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:56.138485 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380618e-18ea-4990-810f-828db9dd6968 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:56.139285 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380618e-18ea-4990-810f-828db9dd6968 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:56.139599 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380618e-18ea-4990-810f-828db9dd6968 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:56.141079 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380618e-18ea-4990-810f-828db9dd6968 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:56.156111 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 345/702] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 09:59:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:56.157557 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f1e77-d890-40a8-af9a-182f743f7f2e None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:56.157854 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f1e77-d890-40a8-af9a-182f743f7f2e None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:56.158135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f1e77-d890-40a8-af9a-182f743f7f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:56.175431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-0d1f1e77-d890-40a8-af9a-182f743f7f2e None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:56.176844 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-0d1f1e77-d890-40a8-af9a-182f743f7f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:56.209036 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:56.230055 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:56.250236 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 346/703] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:56.251577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f1e77-d890-40a8-af9a-182f743f7f2e None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:56.261938 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71495e88-9023-471d-b68b-d937e79198d5 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:56.305306 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7eb589-f1ee-4d08-94ee-49e92197d853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:56.306339 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7eb589-f1ee-4d08-94ee-49e92197d853 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:56.306626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7eb589-f1ee-4d08-94ee-49e92197d853 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:56.306910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7eb589-f1ee-4d08-94ee-49e92197d853 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:56.307960 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7eb589-f1ee-4d08-94ee-49e92197d853 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:56.308279 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7eb589-f1ee-4d08-94ee-49e92197d853 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:56.309690 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7eb589-f1ee-4d08-94ee-49e92197d853 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:56.321227 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 358/704] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:56.322103 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7eb589-f1ee-4d08-94ee-49e92197d853 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:56.373602 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f1e77-d890-40a8-af9a-182f743f7f2e None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:56.414541 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ad7a3-40bf-4168-b915-0858902b73de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:56.415727 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ad7a3-40bf-4168-b915-0858902b73de None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:56.416220 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ad7a3-40bf-4168-b915-0858902b73de None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:56.416689 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ad7a3-40bf-4168-b915-0858902b73de None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:56.417385 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ad7a3-40bf-4168-b915-0858902b73de None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:56.418815 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ad7a3-40bf-4168-b915-0858902b73de None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:56.425404 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7eb589-f1ee-4d08-94ee-49e92197d853 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:56.432636 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-e50ad7a3-40bf-4168-b915-0858902b73de None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 09:59:56.432636 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:56.432636 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 09:59:56.432636 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 09:59:56.432636 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 09:59:56.432636 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 09:59:56.432636 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 09:59:56.432636 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 09:59:56.432636 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 09:59:56.432636 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:56.432636 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 09:59:56.432636 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:56.432636 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:56.432636 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:56.432636 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:56.432636 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:56.433653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:56.433653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:56.433653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:56.433653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:56.433653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:56.433653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:56.433653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:56.433653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 09:59:56.433653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 09:59:56.433653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 09:59:56.433653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 09:59:56.433653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:56.433653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:56.433653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:56.433653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:56.433653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:56.434468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:56.434468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:56.434468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:56.434468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:56.434468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:56.434468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:56.434468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:56.434468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:56.434468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:56.434468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:56.434468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:56.434468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 09:59:56.434468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 09:59:56.434468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 09:59:56.434468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:56.438848 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 347/705] 10.222.0.46 () {56 vars in 1129 bytes} [Wed Jun 22 09:59:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:56.439696 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ad7a3-40bf-4168-b915-0858902b73de None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:56.463331 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf733fb5-7cfa-4d8c-9473-017a200f154b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:56.464006 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf733fb5-7cfa-4d8c-9473-017a200f154b None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:56.464288 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf733fb5-7cfa-4d8c-9473-017a200f154b None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:56.464564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf733fb5-7cfa-4d8c-9473-017a200f154b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:56.465431 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf733fb5-7cfa-4d8c-9473-017a200f154b None admin] RBAC: Adding query filter params (role.id=106aa464a69a49b09de7de5417083d3c, scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9, user.id=4ed9a00723ab4af2b633ab7614d178a8) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:56.465744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf733fb5-7cfa-4d8c-9473-017a200f154b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:56.467169 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf733fb5-7cfa-4d8c-9473-017a200f154b None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:56.472735 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 359/706] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 09:59:56 2022] GET /identity/v3/role_assignments?user.id=4ed9a00723ab4af2b633ab7614d178a8&scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9&role.id=106aa464a69a49b09de7de5417083d3c => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:56.473568 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf733fb5-7cfa-4d8c-9473-017a200f154b None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:56.473946 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:56.484838 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:56.561051 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ad7a3-40bf-4168-b915-0858902b73de None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:56.599134 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769eaf8-e8e9-485e-9c7b-bfea26fa1923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:56.599945 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769eaf8-e8e9-485e-9c7b-bfea26fa1923 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:56.600234 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769eaf8-e8e9-485e-9c7b-bfea26fa1923 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:56.600516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769eaf8-e8e9-485e-9c7b-bfea26fa1923 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:56.612622 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b769eaf8-e8e9-485e-9c7b-bfea26fa1923 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:56.614894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b769eaf8-e8e9-485e-9c7b-bfea26fa1923 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:56.625088 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf733fb5-7cfa-4d8c-9473-017a200f154b None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:56.637588 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-b769eaf8-e8e9-485e-9c7b-bfea26fa1923 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:56.637588 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:56.637588 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:56.637588 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:56.637588 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:56.637588 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:56.637588 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:56.637588 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:56.637588 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:56.637588 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:56.637588 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:56.637588 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:56.637588 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:56.637588 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:56.637588 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:56.638562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:56.638562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:56.638562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:56.638562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:56.638562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:56.638562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:56.638562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:56.638562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:56.638562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:56.638562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:56.638562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:56.638562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:56.638562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:56.638562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:56.638562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:56.638562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:56.638562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:56.639436 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:56.639436 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:56.639436 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:56.639436 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:56.639436 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 348/707] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:56.639436 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769eaf8-e8e9-485e-9c7b-bfea26fa1923 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:56.686610 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273af8f7-1a7a-4b87-bdd0-123a86e63314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:56.687420 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273af8f7-1a7a-4b87-bdd0-123a86e63314 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:56.687698 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273af8f7-1a7a-4b87-bdd0-123a86e63314 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:56.687970 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273af8f7-1a7a-4b87-bdd0-123a86e63314 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:56.696867 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273af8f7-1a7a-4b87-bdd0-123a86e63314 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:56.698504 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273af8f7-1a7a-4b87-bdd0-123a86e63314 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:56.717862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-273af8f7-1a7a-4b87-bdd0-123a86e63314 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 09:59:56.717862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:56.717862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:56.717862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:56.717862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:56.717862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:56.717862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:56.717862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:56.717862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:56.717862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:56.717862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:56.717862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:56.717862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 09:59:56.717862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 09:59:56.717862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 09:59:56.718837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 09:59:56.718837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:56.718837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:56.718837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:56.718837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:56.718837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:56.718837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:56.718837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:56.718837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:56.718837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:56.718837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:56.718837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:56.718837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:56.718837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:56.718837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:56.718837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:56.718837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:56.719714 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 09:59:56.719714 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 09:59:56.719714 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 09:59:56.719714 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 09:59:56.719714 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 09:59:56.719714 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 09:59:56.719714 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 09:59:56.719714 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:56.724454 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 360/708] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 09:59:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:56.725425 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273af8f7-1a7a-4b87-bdd0-123a86e63314 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:56.744394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:56.765104 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769eaf8-e8e9-485e-9c7b-bfea26fa1923 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:56.803512 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e071c-aa5e-488a-aa1c-352285713cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:56.804289 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:56.805837 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e071c-aa5e-488a-aa1c-352285713cce None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:56.806328 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e071c-aa5e-488a-aa1c-352285713cce None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:56.806820 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e071c-aa5e-488a-aa1c-352285713cce None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:56.807801 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e071c-aa5e-488a-aa1c-352285713cce None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:56.808310 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e071c-aa5e-488a-aa1c-352285713cce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:56.809938 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e071c-aa5e-488a-aa1c-352285713cce None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:56.819680 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 349/709] 10.222.0.46 () {56 vars in 1124 bytes} [Wed Jun 22 09:59:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:56.820728 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e071c-aa5e-488a-aa1c-352285713cce None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:56.846524 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273af8f7-1a7a-4b87-bdd0-123a86e63314 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:56.887859 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062ccd7-cce1-4189-ad11-e24395f13188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:56.889040 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062ccd7-cce1-4189-ad11-e24395f13188 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:56.889559 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062ccd7-cce1-4189-ad11-e24395f13188 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:56.890057 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062ccd7-cce1-4189-ad11-e24395f13188 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:56.891119 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062ccd7-cce1-4189-ad11-e24395f13188 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:56.891803 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062ccd7-cce1-4189-ad11-e24395f13188 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:56.893679 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062ccd7-cce1-4189-ad11-e24395f13188 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:56.912111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 361/710] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:56.913570 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062ccd7-cce1-4189-ad11-e24395f13188 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:56.944007 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e071c-aa5e-488a-aa1c-352285713cce None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:56.990881 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012dcbf-0ed0-439e-af8f-503792dd90bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:56.992454 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012dcbf-0ed0-439e-af8f-503792dd90bd None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:56.992920 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012dcbf-0ed0-439e-af8f-503792dd90bd None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:56.993343 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012dcbf-0ed0-439e-af8f-503792dd90bd None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:56.994982 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012dcbf-0ed0-439e-af8f-503792dd90bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:56.995719 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012dcbf-0ed0-439e-af8f-503792dd90bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:56.997510 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012dcbf-0ed0-439e-af8f-503792dd90bd None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:57.015226 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 350/711] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 09:59:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:57.016333 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012dcbf-0ed0-439e-af8f-503792dd90bd None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:57.029628 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:57.045257 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062ccd7-cce1-4189-ad11-e24395f13188 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:57.077775 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:57.092403 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92ce3c-0af6-44a0-b450-0425e0127ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:57.093835 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92ce3c-0af6-44a0-b450-0425e0127ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:57.094275 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92ce3c-0af6-44a0-b450-0425e0127ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:57.094696 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92ce3c-0af6-44a0-b450-0425e0127ca3 None admin] PATH_INFO: `/v3/services` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:57.095847 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92ce3c-0af6-44a0-b450-0425e0127ca3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:57.096320 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92ce3c-0af6-44a0-b450-0425e0127ca3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:57.098854 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92ce3c-0af6-44a0-b450-0425e0127ca3 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:57.106050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 362/712] 10.222.0.46 () {56 vars in 1124 bytes} [Wed Jun 22 09:59:56 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:57.107563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92ce3c-0af6-44a0-b450-0425e0127ca3 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:57.150774 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012dcbf-0ed0-439e-af8f-503792dd90bd None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:57.260912 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f51b7-63eb-4a56-8b2d-4b8cc78ae807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:57.261612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f51b7-63eb-4a56-8b2d-4b8cc78ae807 None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:57.261896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f51b7-63eb-4a56-8b2d-4b8cc78ae807 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:57.262174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f51b7-63eb-4a56-8b2d-4b8cc78ae807 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:57.262914 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f51b7-63eb-4a56-8b2d-4b8cc78ae807 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:57.264467 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f51b7-63eb-4a56-8b2d-4b8cc78ae807 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:57.287638 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92ce3c-0af6-44a0-b450-0425e0127ca3 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:57.325896 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1037d-2dbc-4202-84c2-9bb3529d79a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:57.326607 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1037d-2dbc-4202-84c2-9bb3529d79a4 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:57.326890 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1037d-2dbc-4202-84c2-9bb3529d79a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:57.327169 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1037d-2dbc-4202-84c2-9bb3529d79a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:57.328060 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1037d-2dbc-4202-84c2-9bb3529d79a4 None admin] RBAC: Adding query filter params (role.id=604a13bdd0fd46e182a9749de3b5232d, scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9, user.id=9c724063ce51470ca09c5c5ab231fd9b) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:57.328379 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1037d-2dbc-4202-84c2-9bb3529d79a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:57.330137 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1037d-2dbc-4202-84c2-9bb3529d79a4 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:57.337360 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 363/713] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 09:59:57 2022] GET /identity/v3/role_assignments?user.id=9c724063ce51470ca09c5c5ab231fd9b&scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9&role.id=604a13bdd0fd46e182a9749de3b5232d => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:57.376404 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 351/714] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 22 09:59:57 2022] POST /identity/v3/users => generated 254 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 09:59:57.811654 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e360b64-dc1d-4a98-9476-bbba51b87db5 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:57.812070 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e360b64-dc1d-4a98-9476-bbba51b87db5 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:57.812257 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e360b64-dc1d-4a98-9476-bbba51b87db5 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:57.813903 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 364/715] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:57.818989 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9c6f6-20a8-4af9-a825-dd65bbabac3c None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:57.819286 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9c6f6-20a8-4af9-a825-dd65bbabac3c None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:57.819640 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9c6f6-20a8-4af9-a825-dd65bbabac3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:57.841907 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-b9b9c6f6-20a8-4af9-a825-dd65bbabac3c None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:57.843145 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-b9b9c6f6-20a8-4af9-a825-dd65bbabac3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:57.909100 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:57.923379 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 352/716] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:57.966295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e360b64-dc1d-4a98-9476-bbba51b87db5 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:58.037880 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:58.102568 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e360b64-dc1d-4a98-9476-bbba51b87db5 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:58.152049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee1e6e-ee02-4dfb-b183-815af2aa07c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:58.152875 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee1e6e-ee02-4dfb-b183-815af2aa07c6 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:58.153215 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee1e6e-ee02-4dfb-b183-815af2aa07c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:58.153498 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee1e6e-ee02-4dfb-b183-815af2aa07c6 None admin] PATH_INFO: `/v3/services/network` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:58.154162 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee1e6e-ee02-4dfb-b183-815af2aa07c6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:58.155592 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee1e6e-ee02-4dfb-b183-815af2aa07c6 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:58.172238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-edee1e6e-ee02-4dfb-b183-815af2aa07c6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 09:59:58.172238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:58.172238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 09:59:58.172238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 09:59:58.172238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 09:59:58.172238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 09:59:58.172238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 09:59:58.172238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 09:59:58.172238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 09:59:58.172238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:58.172238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 09:59:58.172238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:58.172238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:58.172238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:58.172238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:58.172238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:58.172238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:58.173315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:58.173315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:58.173315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:58.173315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:58.173315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:58.173315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:58.173315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 09:59:58.173315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 09:59:58.173315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 09:59:58.173315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 09:59:58.173315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:58.173315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:58.173315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:58.173315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:58.173315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:58.173315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:58.174183 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:58.174183 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:58.174183 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:58.174183 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:58.174183 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:58.174183 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:58.174183 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:58.174183 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:58.174183 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:58.174183 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:58.174183 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 09:59:58.174183 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 09:59:58.174183 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 09:59:58.174183 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 09:59:58.174183 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 365/717] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 09:59:57 2022] GET /identity/v3/services/network => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:58.180114 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9c6f6-20a8-4af9-a825-dd65bbabac3c None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:58.340782 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9c6f6-20a8-4af9-a825-dd65bbabac3c None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:58.384472 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb909631-79e0-45db-bbd6-7bb08546e30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:58.385627 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb909631-79e0-45db-bbd6-7bb08546e30f None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:58.386142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb909631-79e0-45db-bbd6-7bb08546e30f None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:58.386615 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb909631-79e0-45db-bbd6-7bb08546e30f None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:58.387563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb909631-79e0-45db-bbd6-7bb08546e30f None admin] RBAC: Adding query filter params (name=network) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:58.388070 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb909631-79e0-45db-bbd6-7bb08546e30f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:58.389688 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb909631-79e0-45db-bbd6-7bb08546e30f None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:58.395588 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 353/718] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Jun 22 09:59:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:58.401353 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee1e6e-ee02-4dfb-b183-815af2aa07c6 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:58.516305 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee1e6e-ee02-4dfb-b183-815af2aa07c6 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:58.533173 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:58.560418 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941292f-f73b-40ec-b63f-a3463eab5e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:58.561116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941292f-f73b-40ec-b63f-a3463eab5e03 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:58.561401 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941292f-f73b-40ec-b63f-a3463eab5e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:58.561678 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941292f-f73b-40ec-b63f-a3463eab5e03 None admin] PATH_INFO: `/v3/services` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:58.562399 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941292f-f73b-40ec-b63f-a3463eab5e03 None admin] RBAC: Adding query filter params (type=network) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:58.562709 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941292f-f73b-40ec-b63f-a3463eab5e03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:58.564102 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941292f-f73b-40ec-b63f-a3463eab5e03 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:58.569357 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 366/719] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Jun 22 09:59:58 2022] GET /identity/v3/services?type=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:58.900586 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323276c1-abf4-4037-acec-323d08fc8938 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:58.900913 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323276c1-abf4-4037-acec-323d08fc8938 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:58.901163 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323276c1-abf4-4037-acec-323d08fc8938 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:58.903730 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 354/720] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:58.908444 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12514de9-65c2-4f71-b52d-9a3d01cc0abc None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:58.908733 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12514de9-65c2-4f71-b52d-9a3d01cc0abc None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:58.909046 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12514de9-65c2-4f71-b52d-9a3d01cc0abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:58.928867 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-12514de9-65c2-4f71-b52d-9a3d01cc0abc None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:58.932003 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-12514de9-65c2-4f71-b52d-9a3d01cc0abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:59.027031 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 367/721] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 09:59:59.073309 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323276c1-abf4-4037-acec-323d08fc8938 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:59.155884 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:59.214449 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323276c1-abf4-4037-acec-323d08fc8938 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:59.263174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108579d-b6e8-4372-9b11-566417673393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:59.263966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108579d-b6e8-4372-9b11-566417673393 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:59.264245 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108579d-b6e8-4372-9b11-566417673393 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:59.264520 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108579d-b6e8-4372-9b11-566417673393 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:59.284953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108579d-b6e8-4372-9b11-566417673393 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 09:59:59.293246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-d108579d-b6e8-4372-9b11-566417673393 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 09:59:59.293246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:59.293246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:59.293246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:59.293246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:59.293246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:59.293246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:59.293246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:59.293246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:59.293246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:59.293246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:59.293246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:59.293246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 09:59:59.293246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 09:59:59.293246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 09:59:59.293246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 09:59:59.294188 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 09:59:59.294188 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 09:59:59.294188 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 09:59:59.294188 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 09:59:59.294188 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:59.294188 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:59.294188 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:59.294188 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:59.294188 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:59.294188 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:59.294188 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:59.294188 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:59.294188 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:59.294188 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:59.294188 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:59.294188 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:59.295021 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:59.295021 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:59.295021 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:59.295021 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:59.295021 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 09:59:59.295021 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 09:59:59.295021 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 09:59:59.295021 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 09:59:59.295021 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 09:59:59.295021 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 09:59:59.295021 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 09:59:59.295021 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:59.299158 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 355/722] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 09:59:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:59.300419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12514de9-65c2-4f71-b52d-9a3d01cc0abc None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:59.439172 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b532a-ad32-48ac-82af-729780e185df None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:59.439844 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b532a-ad32-48ac-82af-729780e185df None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:59.440348 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b532a-ad32-48ac-82af-729780e185df None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:59.442780 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 356/723] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 09:59:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 09:59:59.448023 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cb9cc-9c6b-46db-9520-5f5bc1b81c19 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:59.448569 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cb9cc-9c6b-46db-9520-5f5bc1b81c19 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:59.449103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cb9cc-9c6b-46db-9520-5f5bc1b81c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:59.466902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-ae4cb9cc-9c6b-46db-9520-5f5bc1b81c19 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 09:59:59.468431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-ae4cb9cc-9c6b-46db-9520-5f5bc1b81c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 09:59:59.478214 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12514de9-65c2-4f71-b52d-9a3d01cc0abc None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:59.491666 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:59.541572 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682856a6-6fb3-4c2c-901c-fbd96a7f217f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:59.542271 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682856a6-6fb3-4c2c-901c-fbd96a7f217f None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:59.542556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682856a6-6fb3-4c2c-901c-fbd96a7f217f None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:59.542831 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682856a6-6fb3-4c2c-901c-fbd96a7f217f None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:59.543593 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682856a6-6fb3-4c2c-901c-fbd96a7f217f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:59.543900 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682856a6-6fb3-4c2c-901c-fbd96a7f217f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:59.545330 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682856a6-6fb3-4c2c-901c-fbd96a7f217f None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:59.545547 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 357/724] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 09:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 09:59:59.558643 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 368/725] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 09:59:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:59.563822 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cb9cc-9c6b-46db-9520-5f5bc1b81c19 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:59.588454 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682856a6-6fb3-4c2c-901c-fbd96a7f217f None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:59.619856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:59.681667 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cb9cc-9c6b-46db-9520-5f5bc1b81c19 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:59.722416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a300eab-6848-46ec-b8bc-2c074fb180dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:59.723745 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a300eab-6848-46ec-b8bc-2c074fb180dd None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:59.725363 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a300eab-6848-46ec-b8bc-2c074fb180dd None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:59.725853 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a300eab-6848-46ec-b8bc-2c074fb180dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:59.750572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a300eab-6848-46ec-b8bc-2c074fb180dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:59.752578 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a300eab-6848-46ec-b8bc-2c074fb180dd None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:59.786486 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-4a300eab-6848-46ec-b8bc-2c074fb180dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:59.786486 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 09:59:59.786486 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 09:59:59.786486 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 09:59:59.786486 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 09:59:59.786486 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 09:59:59.786486 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 09:59:59.786486 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 09:59:59.786486 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 09:59:59.786486 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 09:59:59.786486 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 09:59:59.786486 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 09:59:59.786486 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 09:59:59.786486 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 09:59:59.786486 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 09:59:59.787447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 09:59:59.787447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 09:59:59.787447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 09:59:59.787447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 09:59:59.787447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 09:59:59.787447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 09:59:59.787447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 09:59:59.787447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 09:59:59.787447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 09:59:59.787447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 09:59:59.787447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 09:59:59.787447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 09:59:59.787447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 09:59:59.787447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 09:59:59.787447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 09:59:59.787447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 09:59:59.787447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 09:59:59.788353 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 09:59:59.788353 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 09:59:59.788353 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 09:59:59.788353 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 09:59:59.792604 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 358/726] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 09:59:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 09:59:59.798803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a300eab-6848-46ec-b8bc-2c074fb180dd None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 09:59:59.805649 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682856a6-6fb3-4c2c-901c-fbd96a7f217f None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:59.903220 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7dc801-bd32-4fab-bca6-1fbcd6532f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:59.904262 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dc801-bd32-4fab-bca6-1fbcd6532f1e None admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:59.904262 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dc801-bd32-4fab-bca6-1fbcd6532f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:59.904431 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dc801-bd32-4fab-bca6-1fbcd6532f1e None admin] PATH_INFO: `/v3/services` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:59.905347 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7dc801-bd32-4fab-bca6-1fbcd6532f1e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:59.906638 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7dc801-bd32-4fab-bca6-1fbcd6532f1e None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:59.912656 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 09:59:59.917238 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a300eab-6848-46ec-b8bc-2c074fb180dd None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 09:59:59.954694 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43df084-7d30-4413-a3fb-267ab4f6de46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 09:59:59.955749 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43df084-7d30-4413-a3fb-267ab4f6de46 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 09:59:59.956235 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43df084-7d30-4413-a3fb-267ab4f6de46 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 09:59:59.956752 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43df084-7d30-4413-a3fb-267ab4f6de46 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 09:59:59.957776 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43df084-7d30-4413-a3fb-267ab4f6de46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 09:59:59.958284 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43df084-7d30-4413-a3fb-267ab4f6de46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 09:59:59.959871 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43df084-7d30-4413-a3fb-267ab4f6de46 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 09:59:59.974533 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 359/727] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 09:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 09:59:59.979954 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43df084-7d30-4413-a3fb-267ab4f6de46 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:00.077725 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 369/728] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Jun 22 09:59:59 2022] POST /identity/v3/services => generated 251 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:00:00.079683 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8342bb9-8de4-432a-8052-73d71e07725d None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:00.080182 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8342bb9-8de4-432a-8052-73d71e07725d None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:00.080671 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8342bb9-8de4-432a-8052-73d71e07725d None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:00.083336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 370/729] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:00.084963 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea3eda-d208-40a7-bb27-b14903198995 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:00.085497 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea3eda-d208-40a7-bb27-b14903198995 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:00.086102 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea3eda-d208-40a7-bb27-b14903198995 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:00.088163 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 371/730] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:00.094133 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8d0c3-b843-4552-9f2b-1efae60a9a07 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:00.096485 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43df084-7d30-4413-a3fb-267ab4f6de46 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:00.097079 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8d0c3-b843-4552-9f2b-1efae60a9a07 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:00.097583 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8d0c3-b843-4552-9f2b-1efae60a9a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:00.117457 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-bef8d0c3-b843-4552-9f2b-1efae60a9a07 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:00.119354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-bef8d0c3-b843-4552-9f2b-1efae60a9a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:00.154322 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:00.158715 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e61195-5d58-4ce3-bc3d-9678bbed6f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:00.161240 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e61195-5d58-4ce3-bc3d-9678bbed6f98 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:00.162150 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e61195-5d58-4ce3-bc3d-9678bbed6f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:00.168971 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e61195-5d58-4ce3-bc3d-9678bbed6f98 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:00.178063 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e61195-5d58-4ce3-bc3d-9678bbed6f98 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:00.179994 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e61195-5d58-4ce3-bc3d-9678bbed6f98 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:00.196540 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-88e61195-5d58-4ce3-bc3d-9678bbed6f98 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:00:00.196540 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:00.196540 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:00.196540 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:00.196540 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:00.196540 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:00.196540 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:00.196540 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:00.196540 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:00.196540 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:00.196540 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:00.196540 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:00.196540 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:00:00.196540 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:00:00.196540 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:00:00.196540 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:00:00.197737 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:00.197737 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:00.197737 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:00:00.197737 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:00:00.197737 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:00:00.197737 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:00:00.197737 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:00.197737 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:00.197737 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:00.197737 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:00.197737 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:00.197737 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:00.197737 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:00.197737 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:00.197737 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:00.197737 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:00.197737 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:00.197737 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:00.198687 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:00.198687 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:00.198687 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:00:00.198687 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:00:00.198687 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:00:00.198687 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:00:00.198687 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:00:00.198687 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:00:00.198687 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:00:00.198687 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:00.206303 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 360/731] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Jun 22 09:59:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:00.216442 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285a9eb-a150-4768-b019-0261b0d381c1 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:00.216442 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285a9eb-a150-4768-b019-0261b0d381c1 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:00.216442 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285a9eb-a150-4768-b019-0261b0d381c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:00.224027 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 372/732] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:00:00.225311 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8d0c3-b843-4552-9f2b-1efae60a9a07 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:00.235863 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-0285a9eb-a150-4768-b019-0261b0d381c1 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:00.240318 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-0285a9eb-a150-4768-b019-0261b0d381c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:00.254819 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:00.320703 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 361/733] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:00:00.321660 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285a9eb-a150-4768-b019-0261b0d381c1 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:00.370107 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8d0c3-b843-4552-9f2b-1efae60a9a07 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:00.408917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979438c-9237-4941-a631-0b1a8ec84830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:00.409692 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979438c-9237-4941-a631-0b1a8ec84830 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:00.410045 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979438c-9237-4941-a631-0b1a8ec84830 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:00.410388 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979438c-9237-4941-a631-0b1a8ec84830 None admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:00.411930 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979438c-9237-4941-a631-0b1a8ec84830 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:00.412325 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979438c-9237-4941-a631-0b1a8ec84830 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:00.413888 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979438c-9237-4941-a631-0b1a8ec84830 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:00.432522 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 373/734] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Jun 22 10:00:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:00.433471 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979438c-9237-4941-a631-0b1a8ec84830 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:00.435706 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285a9eb-a150-4768-b019-0261b0d381c1 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:00.458504 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:00.485317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddda73-79a7-469b-b753-3f2182b53e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:00.486453 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddda73-79a7-469b-b753-3f2182b53e5c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:00.486887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddda73-79a7-469b-b753-3f2182b53e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:00.487472 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddda73-79a7-469b-b753-3f2182b53e5c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:00.502539 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ddda73-79a7-469b-b753-3f2182b53e5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:00:00.513683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-d6ddda73-79a7-469b-b753-3f2182b53e5c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:00:00.513683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:00.513683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:00.513683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:00.513683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:00.513683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:00.513683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:00.513683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:00.513683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:00.513683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:00.513683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:00.513683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:00.513683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:00:00.513683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:00:00.513683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:00:00.513683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:00:00.514824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:00:00.514824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:00:00.514824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:00:00.514824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:00:00.514824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:00.514824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:00.514824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:00.514824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:00.514824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:00.514824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:00.514824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:00.514824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:00.514824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:00.514824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:00.514824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:00.514824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:00.515861 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:00.515861 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:00.515861 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:00.515861 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:00.515861 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:00:00.515861 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:00:00.515861 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:00:00.515861 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:00:00.515861 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:00:00.515861 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:00:00.515861 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:00:00.515861 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:00.519459 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 362/735] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 22 10:00:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:00.521022 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddda73-79a7-469b-b753-3f2182b53e5c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:00.526530 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:00.559053 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979438c-9237-4941-a631-0b1a8ec84830 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:00.605397 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4276ac-468a-434e-b004-d1ad79ccdd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:00.606592 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4276ac-468a-434e-b004-d1ad79ccdd04 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:00.606971 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4276ac-468a-434e-b004-d1ad79ccdd04 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:00.607369 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4276ac-468a-434e-b004-d1ad79ccdd04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:00.624709 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4276ac-468a-434e-b004-d1ad79ccdd04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:00:00.635917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-0d4276ac-468a-434e-b004-d1ad79ccdd04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:00:00.635917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:00.635917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:00.635917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:00.635917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:00.635917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:00.635917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:00.635917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:00.635917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:00.635917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:00.635917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:00.635917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:00.635917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:00:00.635917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:00:00.635917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:00:00.635917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:00:00.637124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:00:00.637124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:00:00.637124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:00:00.637124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:00:00.637124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:00.637124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:00.637124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:00.637124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:00.637124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:00.637124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:00.637124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:00.637124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:00.637124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:00.637124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:00.637124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:00.637124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:00.638258 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:00.638258 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:00.638258 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:00.638258 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:00.638258 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:00:00.638258 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:00:00.638258 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:00:00.638258 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:00:00.638258 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:00:00.638258 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:00:00.638258 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:00:00.638258 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:00.640900 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 374/736] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 10:00:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:00.641932 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4276ac-468a-434e-b004-d1ad79ccdd04 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:00.655447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddda73-79a7-469b-b753-3f2182b53e5c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:00.702313 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462048cf-2405-424b-ab9b-1b799dd1b709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:00.703211 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462048cf-2405-424b-ab9b-1b799dd1b709 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:00.703818 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462048cf-2405-424b-ab9b-1b799dd1b709 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:00.704351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462048cf-2405-424b-ab9b-1b799dd1b709 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:00.718952 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462048cf-2405-424b-ab9b-1b799dd1b709 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:00.720792 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462048cf-2405-424b-ab9b-1b799dd1b709 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:00.742307 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:00.743963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-462048cf-2405-424b-ab9b-1b799dd1b709 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:00.743963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:00.743963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:00.743963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:00.743963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:00.743963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:00.743963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:00.743963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:00.743963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:00.743963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:00.743963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:00.743963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:00.743963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:00:00.743963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:00:00.743963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:00:00.744849 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:00:00.744849 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:00.744849 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:00.744849 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:00.744849 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:00.744849 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:00.744849 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:00.744849 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:00.744849 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:00.744849 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:00.744849 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:00.744849 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:00.744849 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:00.744849 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:00.744849 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:00.744849 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:00.744849 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:00.745778 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:00:00.745778 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:00:00.745778 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:00.745778 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:00.748973 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 363/737] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:00.750052 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462048cf-2405-424b-ab9b-1b799dd1b709 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:00.774815 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4276ac-468a-434e-b004-d1ad79ccdd04 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:00.815907 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:00.826916 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f377a82-b708-4540-9f56-98c8b1161603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:00.827856 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f377a82-b708-4540-9f56-98c8b1161603 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:00.828252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f377a82-b708-4540-9f56-98c8b1161603 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:00.828805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f377a82-b708-4540-9f56-98c8b1161603 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:00.835980 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f377a82-b708-4540-9f56-98c8b1161603 None admin] RBAC: Adding query filter params (name=service) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:00.835980 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f377a82-b708-4540-9f56-98c8b1161603 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:00.835980 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f377a82-b708-4540-9f56-98c8b1161603 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:00.843654 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 375/738] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 22 10:00:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:00.845057 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f377a82-b708-4540-9f56-98c8b1161603 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:00.864266 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462048cf-2405-424b-ab9b-1b799dd1b709 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:00.909157 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29667010-57ab-4971-a3e1-d7bea9c60af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:00.909845 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29667010-57ab-4971-a3e1-d7bea9c60af1 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:00.910974 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29667010-57ab-4971-a3e1-d7bea9c60af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:00.911368 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29667010-57ab-4971-a3e1-d7bea9c60af1 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:00.912135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29667010-57ab-4971-a3e1-d7bea9c60af1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:00.912446 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29667010-57ab-4971-a3e1-d7bea9c60af1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:00.914671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29667010-57ab-4971-a3e1-d7bea9c60af1 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:00.924954 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 364/739] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 10:00:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:00.926111 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29667010-57ab-4971-a3e1-d7bea9c60af1 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:00.979587 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f377a82-b708-4540-9f56-98c8b1161603 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:01.026279 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a61d97-7035-41b5-9e2e-896a14e0ade6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:01.027292 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a61d97-7035-41b5-9e2e-896a14e0ade6 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:01.027845 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a61d97-7035-41b5-9e2e-896a14e0ade6 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:01.028345 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a61d97-7035-41b5-9e2e-896a14e0ade6 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:01.029385 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a61d97-7035-41b5-9e2e-896a14e0ade6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:01.029908 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a61d97-7035-41b5-9e2e-896a14e0ade6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:01.031511 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a61d97-7035-41b5-9e2e-896a14e0ade6 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:01.045633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 376/740] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:01.046782 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a61d97-7035-41b5-9e2e-896a14e0ade6 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:01.053446 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:01.059477 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29667010-57ab-4971-a3e1-d7bea9c60af1 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:01.078217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:01.099720 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a22e7-1ec2-4d46-9438-199f83b82c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:01.100927 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a22e7-1ec2-4d46-9438-199f83b82c54 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:01.101482 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a22e7-1ec2-4d46-9438-199f83b82c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:01.101977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a22e7-1ec2-4d46-9438-199f83b82c54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:01.114683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a22e7-1ec2-4d46-9438-199f83b82c54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:01.116585 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a22e7-1ec2-4d46-9438-199f83b82c54 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:01.137105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-091a22e7-1ec2-4d46-9438-199f83b82c54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:01.137105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:01.137105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:01.137105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:01.137105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:01.137105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:01.137105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:01.137105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:01.137105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:01.137105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:01.137105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:01.137105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:01.137105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:00:01.137105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:00:01.137105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:00:01.138043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:00:01.138043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:01.138043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:01.138043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:01.138043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:01.138043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:01.138043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:01.138043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:01.138043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:01.138043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:01.138043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:01.138043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:01.138043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:01.138043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:01.138043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:01.138043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:01.138043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:01.138947 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:00:01.138947 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:00:01.138947 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:01.138947 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:01.141343 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 365/741] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:01.142557 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a22e7-1ec2-4d46-9438-199f83b82c54 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:01.174626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a61d97-7035-41b5-9e2e-896a14e0ade6 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:01.211482 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c711d-c140-4de9-b2cb-5d3bc2167e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:01.212275 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c711d-c140-4de9-b2cb-5d3bc2167e14 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:01.212561 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c711d-c140-4de9-b2cb-5d3bc2167e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:01.212863 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c711d-c140-4de9-b2cb-5d3bc2167e14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:01.223546 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c711d-c140-4de9-b2cb-5d3bc2167e14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:01.225014 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c711d-c140-4de9-b2cb-5d3bc2167e14 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:01.243216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-c20c711d-c140-4de9-b2cb-5d3bc2167e14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:01.243216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:01.243216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:01.243216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:01.243216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:01.243216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:01.243216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:01.243216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:01.243216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:01.243216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:01.243216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:01.243216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:01.243216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:00:01.243216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:00:01.243216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:00:01.244143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:00:01.244143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:01.244143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:01.244143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:01.244143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:01.244143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:01.244143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:01.244143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:01.244143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:01.244143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:01.244143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:01.244143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:01.244143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:01.244143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:01.244143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:01.244143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:01.244143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:01.245079 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:00:01.245079 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:00:01.245079 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:01.245079 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:01.249074 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 377/742] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:01.249723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c711d-c140-4de9-b2cb-5d3bc2167e14 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:01.259929 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a22e7-1ec2-4d46-9438-199f83b82c54 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:01.301631 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a917e24-465e-4ca6-9396-f37f36642dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:01.302489 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a917e24-465e-4ca6-9396-f37f36642dac None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:01.302774 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a917e24-465e-4ca6-9396-f37f36642dac None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:01.303049 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a917e24-465e-4ca6-9396-f37f36642dac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:01.306093 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:01.317639 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a917e24-465e-4ca6-9396-f37f36642dac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:01.319083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a917e24-465e-4ca6-9396-f37f36642dac None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:01.335094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-7a917e24-465e-4ca6-9396-f37f36642dac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:00:01.335094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:01.335094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:01.335094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:01.335094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:01.335094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:01.335094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:01.335094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:01.335094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:01.335094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:01.335094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:01.335094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:01.335094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:00:01.335094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:00:01.335094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:00:01.336092 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:00:01.336092 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:01.336092 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:01.336092 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:01.336092 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:01.336092 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:01.336092 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:01.336092 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:01.336092 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:01.336092 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:01.336092 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:01.336092 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:01.336092 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:01.336092 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:01.336092 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:01.336092 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:01.336092 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:01.337026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:00:01.337026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:00:01.337026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:00:01.337026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:00:01.337026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:00:01.337026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:00:01.337026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:00:01.337026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:01.337026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 366/743] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 10:00:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:01.338002 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8be0d8-caa5-48e0-9b1f-294f7fd7274a None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:01.338002 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8be0d8-caa5-48e0-9b1f-294f7fd7274a None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:01.338275 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8be0d8-caa5-48e0-9b1f-294f7fd7274a None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:01.343812 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 367/744] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:01.343812 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8be0d8-caa5-48e0-9b1f-294f7fd7274a None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:01.360541 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c711d-c140-4de9-b2cb-5d3bc2167e14 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:01.373330 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:01.399568 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c5bd4-4270-425f-957f-fd3a5f57690d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:01.400301 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c5bd4-4270-425f-957f-fd3a5f57690d None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:01.400507 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c5bd4-4270-425f-957f-fd3a5f57690d None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:01.400784 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c5bd4-4270-425f-957f-fd3a5f57690d None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:01.401853 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c5bd4-4270-425f-957f-fd3a5f57690d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:01.401982 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c5bd4-4270-425f-957f-fd3a5f57690d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:01.403400 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c5bd4-4270-425f-957f-fd3a5f57690d None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:01.415934 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 378/745] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:01.416771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c5bd4-4270-425f-957f-fd3a5f57690d None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:01.456712 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8be0d8-caa5-48e0-9b1f-294f7fd7274a None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:01.493872 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f1e74-ba5f-4b5c-94d9-a6f65c938a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:01.494544 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f1e74-ba5f-4b5c-94d9-a6f65c938a69 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:01.494830 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f1e74-ba5f-4b5c-94d9-a6f65c938a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:01.495111 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f1e74-ba5f-4b5c-94d9-a6f65c938a69 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:01.496279 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f1e74-ba5f-4b5c-94d9-a6f65c938a69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:01.496598 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f1e74-ba5f-4b5c-94d9-a6f65c938a69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:01.498388 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f1e74-ba5f-4b5c-94d9-a6f65c938a69 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:01.515795 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 368/746] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:01.515795 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2d27c-c81d-41ea-bb14-4caba1cfc344 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:01.515795 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2d27c-c81d-41ea-bb14-4caba1cfc344 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:01.515795 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2d27c-c81d-41ea-bb14-4caba1cfc344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:01.526297 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c5bd4-4270-425f-957f-fd3a5f57690d None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:01.530997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-54a2d27c-c81d-41ea-bb14-4caba1cfc344 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:01.532211 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-54a2d27c-c81d-41ea-bb14-4caba1cfc344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:01.540869 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:01.561190 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc84d72-ef52-47d4-846c-4fa7be746651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:01.561778 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc84d72-ef52-47d4-846c-4fa7be746651 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:01.562202 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc84d72-ef52-47d4-846c-4fa7be746651 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:01.562492 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc84d72-ef52-47d4-846c-4fa7be746651 None admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:01.563583 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc84d72-ef52-47d4-846c-4fa7be746651 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:01.563901 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc84d72-ef52-47d4-846c-4fa7be746651 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:01.565344 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc84d72-ef52-47d4-846c-4fa7be746651 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:01.577531 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 379/747] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 10:00:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:01.578776 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc84d72-ef52-47d4-846c-4fa7be746651 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:01.610907 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 369/748] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:01 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:00:01.611732 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2d27c-c81d-41ea-bb14-4caba1cfc344 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:01.643239 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:01.701857 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc84d72-ef52-47d4-846c-4fa7be746651 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:01.744284 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2d27c-c81d-41ea-bb14-4caba1cfc344 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:01.766485 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10d97a-2b51-43f3-8384-4a33cd7b480f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:01.766485 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10d97a-2b51-43f3-8384-4a33cd7b480f None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:01.766485 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10d97a-2b51-43f3-8384-4a33cd7b480f None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:01.766485 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10d97a-2b51-43f3-8384-4a33cd7b480f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:01.774687 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10d97a-2b51-43f3-8384-4a33cd7b480f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:01.776223 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10d97a-2b51-43f3-8384-4a33cd7b480f None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:01.782235 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0eccf-c1b8-42ea-9200-98e9a62a4ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:01.783039 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0eccf-c1b8-42ea-9200-98e9a62a4ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:01.783324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0eccf-c1b8-42ea-9200-98e9a62a4ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:01.783596 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0eccf-c1b8-42ea-9200-98e9a62a4ba6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:01.791661 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0eccf-c1b8-42ea-9200-98e9a62a4ba6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:01.792594 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-bd10d97a-2b51-43f3-8384-4a33cd7b480f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:00:01.792594 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:01.792594 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:01.792594 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:01.792594 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:01.792594 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:01.792594 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:01.792594 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:01.792594 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:01.792594 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:01.792594 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:01.792594 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:01.792594 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:00:01.792594 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:00:01.792594 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:00:01.792594 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:00:01.793517 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:01.793517 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:01.793517 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:00:01.793517 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:00:01.793517 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:00:01.793517 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:00:01.793517 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:01.793517 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:01.793517 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:01.793517 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:01.793517 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:01.793517 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:01.793517 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:01.793517 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:01.793517 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:01.793517 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:01.793517 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:01.793517 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:01.795164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:01.795164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:01.795164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:00:01.795164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:00:01.795164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:00:01.795164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:00:01.795164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:00:01.795164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:00:01.795164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:00:01.795164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:01.795718 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0eccf-c1b8-42ea-9200-98e9a62a4ba6 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:01.795787 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 380/749] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Jun 22 10:00:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:01.795787 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10d97a-2b51-43f3-8384-4a33cd7b480f None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:01.817674 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-4af0eccf-c1b8-42ea-9200-98e9a62a4ba6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 10:00:01.817674 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:01.817674 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:01.817674 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:01.817674 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:01.817674 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:01.817674 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:01.817674 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:01.817674 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:01.817674 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:01.817674 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:01.817674 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:01.817674 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:00:01.817674 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:00:01.817674 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:00:01.817674 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:00:01.818619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:01.818619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:01.818619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:00:01.818619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:00:01.818619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:00:01.818619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:00:01.818619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:01.818619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:01.818619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:01.818619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:01.818619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:01.818619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:01.818619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:01.818619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:01.818619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:01.818619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:01.818619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:01.818619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:01.819572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:01.819572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:01.819572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:00:01.819572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:00:01.819572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:00:01.819572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:00:01.819572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:00:01.819572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:00:01.819572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 10:00:01.819572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:01.820746 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 370/750] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 10:00:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:01.821617 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0eccf-c1b8-42ea-9200-98e9a62a4ba6 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:01.836662 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:01.908540 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10d97a-2b51-43f3-8384-4a33cd7b480f None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:01.913105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:01.934524 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0eccf-c1b8-42ea-9200-98e9a62a4ba6 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:01.943909 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c56573-49a7-46cf-9dbd-1057058c01b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:01.944805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c56573-49a7-46cf-9dbd-1057058c01b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:01.945106 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c56573-49a7-46cf-9dbd-1057058c01b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:01.945379 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c56573-49a7-46cf-9dbd-1057058c01b2 None admin] PATH_INFO: `/v3/projects/a2bb614e4d7747c1a3fff154c8bc18d9/users/4ed9a00723ab4af2b633ab7614d178a8/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:01.947425 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c56573-49a7-46cf-9dbd-1057058c01b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2bb614e4d7747c1a3fff154c8bc18d9, user_id=4ed9a00723ab4af2b633ab7614d178a8, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:01.948950 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c56573-49a7-46cf-9dbd-1057058c01b2 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:01.975984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f298641-f40a-438b-a992-1b17b232837d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:01.976659 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f298641-f40a-438b-a992-1b17b232837d None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:01.976990 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f298641-f40a-438b-a992-1b17b232837d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:01.977265 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f298641-f40a-438b-a992-1b17b232837d None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:01.977992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f298641-f40a-438b-a992-1b17b232837d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:01.979480 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f298641-f40a-438b-a992-1b17b232837d None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:02.090903 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 381/751] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 22 10:00:01 2022] PUT /identity/v3/projects/a2bb614e4d7747c1a3fff154c8bc18d9/users/4ed9a00723ab4af2b633ab7614d178a8/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:00:02.091661 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c56573-49a7-46cf-9dbd-1057058c01b2 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:02.145382 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 371/752] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Jun 22 10:00:01 2022] POST /identity/v3/services => generated 240 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:00:02.145382 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f298641-f40a-438b-a992-1b17b232837d None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:02.269311 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:02.278437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c56573-49a7-46cf-9dbd-1057058c01b2 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:02.342023 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f298641-f40a-438b-a992-1b17b232837d None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:02.348971 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0f1bb-813b-4aff-ad01-a00aff446270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:02.349693 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0f1bb-813b-4aff-ad01-a00aff446270 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:02.350010 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0f1bb-813b-4aff-ad01-a00aff446270 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:02.350287 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0f1bb-813b-4aff-ad01-a00aff446270 None admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:02.351873 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0f1bb-813b-4aff-ad01-a00aff446270 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:02.352181 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0f1bb-813b-4aff-ad01-a00aff446270 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:02.354138 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0f1bb-813b-4aff-ad01-a00aff446270 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:02.376357 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 382/753] 10.222.0.46 () {56 vars in 1149 bytes} [Wed Jun 22 10:00:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:02.377732 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83804a9-7a08-4b8a-9bd8-f4d11e427bb1 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:02.378016 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83804a9-7a08-4b8a-9bd8-f4d11e427bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:02.378293 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83804a9-7a08-4b8a-9bd8-f4d11e427bb1 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:02.379715 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 383/754] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:02.384244 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83804a9-7a08-4b8a-9bd8-f4d11e427bb1 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:02.388610 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821efd1b-c837-4a17-940b-18b085f3acb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:02.389587 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821efd1b-c837-4a17-940b-18b085f3acb4 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:02.390075 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821efd1b-c837-4a17-940b-18b085f3acb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:02.390529 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821efd1b-c837-4a17-940b-18b085f3acb4 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:02.391544 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821efd1b-c837-4a17-940b-18b085f3acb4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:02.392025 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821efd1b-c837-4a17-940b-18b085f3acb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:02.394554 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821efd1b-c837-4a17-940b-18b085f3acb4 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:02.399842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:02.422756 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 372/755] 10.222.0.46 () {56 vars in 1135 bytes} [Wed Jun 22 10:00:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:02.424067 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee785e8-d0dd-4e7d-9fae-fff55ac2d209 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:02.424565 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee785e8-d0dd-4e7d-9fae-fff55ac2d209 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:02.424882 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee785e8-d0dd-4e7d-9fae-fff55ac2d209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:02.445369 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-bee785e8-d0dd-4e7d-9fae-fff55ac2d209 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:02.446570 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-bee785e8-d0dd-4e7d-9fae-fff55ac2d209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:02.517323 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83804a9-7a08-4b8a-9bd8-f4d11e427bb1 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:02.526182 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 373/756] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:00:02.527507 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee785e8-d0dd-4e7d-9fae-fff55ac2d209 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:02.581461 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7479b8-e4bd-4a93-b459-8ac1bcf5ce34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:02.583146 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7479b8-e4bd-4a93-b459-8ac1bcf5ce34 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:02.583639 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7479b8-e4bd-4a93-b459-8ac1bcf5ce34 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:02.584119 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7479b8-e4bd-4a93-b459-8ac1bcf5ce34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:02.609669 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:02.679510 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7479b8-e4bd-4a93-b459-8ac1bcf5ce34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:02.682302 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7479b8-e4bd-4a93-b459-8ac1bcf5ce34 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:02.694840 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee785e8-d0dd-4e7d-9fae-fff55ac2d209 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:02.729844 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:02.746191 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9b69f-e1d3-4e7b-bca2-de0e06934d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:02.746975 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9b69f-e1d3-4e7b-bca2-de0e06934d05 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:02.747331 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9b69f-e1d3-4e7b-bca2-de0e06934d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:02.747683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9b69f-e1d3-4e7b-bca2-de0e06934d05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:02.818142 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 384/757] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 10:00:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:00:02.819412 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7479b8-e4bd-4a93-b459-8ac1bcf5ce34 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:02.830779 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9b69f-e1d3-4e7b-bca2-de0e06934d05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:02.832887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9b69f-e1d3-4e7b-bca2-de0e06934d05 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:02.876057 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:02.932595 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7479b8-e4bd-4a93-b459-8ac1bcf5ce34 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:02.944637 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 374/758] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 10:00:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:00:02.945461 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9b69f-e1d3-4e7b-bca2-de0e06934d05 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:02.972422 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:02.973547 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea52ca-4d2a-4d52-8d18-aca8f83114ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:02.974697 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea52ca-4d2a-4d52-8d18-aca8f83114ae None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:02.975212 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea52ca-4d2a-4d52-8d18-aca8f83114ae None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:02.975692 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea52ca-4d2a-4d52-8d18-aca8f83114ae None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:02.976588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea52ca-4d2a-4d52-8d18-aca8f83114ae None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:02.978210 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea52ca-4d2a-4d52-8d18-aca8f83114ae None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:02.991760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-74ea52ca-4d2a-4d52-8d18-aca8f83114ae None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 10:00:02.991760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:02.991760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:00:02.991760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:00:02.991760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:00:02.991760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:00:02.991760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:00:02.991760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:02.991760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 10:00:02.991760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:02.991760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:00:02.991760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:02.991760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:02.991760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:02.991760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:02.991760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:03.001185 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:03.001185 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:03.001185 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:03.001185 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:03.001185 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:03.001185 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:03.001185 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:03.001185 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:00:03.001185 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:00:03.001185 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:00:03.001185 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:00:03.001185 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:03.001185 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:03.001185 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:03.001185 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:03.001185 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:03.002880 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:03.002880 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:03.002880 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:03.002880 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:03.002880 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:03.002880 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:03.002880 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:03.002880 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:03.002880 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:03.002880 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:03.002880 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:03.002880 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:00:03.002880 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:03.002880 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 10:00:03.002880 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:03.006243 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 385/759] 10.222.0.46 () {56 vars in 1129 bytes} [Wed Jun 22 10:00:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:03.008235 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea52ca-4d2a-4d52-8d18-aca8f83114ae None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:03.057153 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9b69f-e1d3-4e7b-bca2-de0e06934d05 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:03.092667 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8567d2-ca74-42df-b7f3-0311486d4385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:03.093495 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8567d2-ca74-42df-b7f3-0311486d4385 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:03.093827 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8567d2-ca74-42df-b7f3-0311486d4385 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:03.094110 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8567d2-ca74-42df-b7f3-0311486d4385 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:03.104626 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8567d2-ca74-42df-b7f3-0311486d4385 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:03.106125 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8567d2-ca74-42df-b7f3-0311486d4385 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:03.123340 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea52ca-4d2a-4d52-8d18-aca8f83114ae None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:03.124362 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-9b8567d2-ca74-42df-b7f3-0311486d4385 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:03.124362 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:03.124362 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:03.124362 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:03.124362 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:03.124362 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:03.124362 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:03.124362 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:03.124362 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:03.124362 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:03.124362 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:03.124362 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:03.124362 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:00:03.124362 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:00:03.124362 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:00:03.125457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:00:03.125457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:03.125457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:03.125457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:03.125457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:03.125457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:03.125457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:03.125457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:03.125457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:03.125457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:03.125457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:03.125457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:03.125457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:03.125457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:03.125457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:03.125457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:03.125457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:03.126389 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:00:03.126389 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:00:03.126389 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:03.126389 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:03.126389 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 375/760] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:03.131229 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8567d2-ca74-42df-b7f3-0311486d4385 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:03.141073 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:03.165877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9d888-674c-45ad-a287-27f5cf45b465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:03.167147 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9d888-674c-45ad-a287-27f5cf45b465 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:03.167640 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9d888-674c-45ad-a287-27f5cf45b465 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:03.168192 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9d888-674c-45ad-a287-27f5cf45b465 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:03.181109 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9d888-674c-45ad-a287-27f5cf45b465 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:03.182933 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9d888-674c-45ad-a287-27f5cf45b465 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:03.202300 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-9fc9d888-674c-45ad-a287-27f5cf45b465 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:03.202300 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:03.202300 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:03.202300 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:03.202300 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:03.202300 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:03.202300 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:03.202300 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:03.202300 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:03.202300 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:03.202300 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:03.202300 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:03.202300 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:00:03.202300 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:00:03.202300 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:00:03.203247 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:00:03.203247 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:03.203247 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:03.203247 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:03.203247 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:03.203247 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:03.203247 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:03.203247 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:03.203247 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:03.203247 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:03.203247 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:03.203247 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:03.203247 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:03.203247 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:03.203247 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:03.203247 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:03.203247 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:03.204383 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:00:03.204383 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:00:03.204383 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:03.204383 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:03.206741 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 386/761] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:03.208362 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9d888-674c-45ad-a287-27f5cf45b465 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:03.213320 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:03.255972 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8567d2-ca74-42df-b7f3-0311486d4385 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:03.306901 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57002e-b791-41bf-8b2c-406517dec54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:03.307675 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57002e-b791-41bf-8b2c-406517dec54d None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:03.307962 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57002e-b791-41bf-8b2c-406517dec54d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:03.308241 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57002e-b791-41bf-8b2c-406517dec54d None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:03.309666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57002e-b791-41bf-8b2c-406517dec54d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:03.309979 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57002e-b791-41bf-8b2c-406517dec54d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:03.312213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57002e-b791-41bf-8b2c-406517dec54d None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:03.319789 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 376/762] 10.222.0.46 () {56 vars in 1124 bytes} [Wed Jun 22 10:00:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:03.320669 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57002e-b791-41bf-8b2c-406517dec54d None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:03.336707 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9d888-674c-45ad-a287-27f5cf45b465 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:03.374391 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73dc06-6de1-4b00-bcee-b2c147a80b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:03.375070 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73dc06-6de1-4b00-bcee-b2c147a80b62 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:03.375517 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73dc06-6de1-4b00-bcee-b2c147a80b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:03.375803 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73dc06-6de1-4b00-bcee-b2c147a80b62 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:03.376742 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73dc06-6de1-4b00-bcee-b2c147a80b62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:03.377033 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73dc06-6de1-4b00-bcee-b2c147a80b62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:03.378424 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73dc06-6de1-4b00-bcee-b2c147a80b62 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:03.397590 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 387/763] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:03.398780 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73dc06-6de1-4b00-bcee-b2c147a80b62 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:03.426981 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:03.446523 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57002e-b791-41bf-8b2c-406517dec54d None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:03.484529 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95307e31-41e8-4869-8c05-0025c9daca53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:03.485570 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95307e31-41e8-4869-8c05-0025c9daca53 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:03.485994 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95307e31-41e8-4869-8c05-0025c9daca53 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:03.486408 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95307e31-41e8-4869-8c05-0025c9daca53 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:03.487290 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95307e31-41e8-4869-8c05-0025c9daca53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:03.487803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95307e31-41e8-4869-8c05-0025c9daca53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:03.489481 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95307e31-41e8-4869-8c05-0025c9daca53 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:03.498516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:03.502335 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 377/764] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:03.503148 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95307e31-41e8-4869-8c05-0025c9daca53 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:03.514185 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73dc06-6de1-4b00-bcee-b2c147a80b62 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:03.553841 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9323a7c-cf22-4b59-a6f3-44c9d651b405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:03.555363 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9323a7c-cf22-4b59-a6f3-44c9d651b405 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:03.555798 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9323a7c-cf22-4b59-a6f3-44c9d651b405 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:03.556362 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9323a7c-cf22-4b59-a6f3-44c9d651b405 None admin] PATH_INFO: `/v3/services` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:03.557306 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9323a7c-cf22-4b59-a6f3-44c9d651b405 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:03.557900 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9323a7c-cf22-4b59-a6f3-44c9d651b405 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:03.559416 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9323a7c-cf22-4b59-a6f3-44c9d651b405 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:03.565432 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 388/765] 10.222.0.46 () {56 vars in 1124 bytes} [Wed Jun 22 10:00:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:03.567092 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9323a7c-cf22-4b59-a6f3-44c9d651b405 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:03.607795 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95307e31-41e8-4869-8c05-0025c9daca53 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:03.643072 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc8aad-e8c0-4383-9bb1-942018cebdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:03.643881 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc8aad-e8c0-4383-9bb1-942018cebdfa None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:03.644164 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc8aad-e8c0-4383-9bb1-942018cebdfa None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:03.644433 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc8aad-e8c0-4383-9bb1-942018cebdfa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:03.652143 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc8aad-e8c0-4383-9bb1-942018cebdfa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:03.653640 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc8aad-e8c0-4383-9bb1-942018cebdfa None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:03.667824 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:03.669859 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-86cc8aad-e8c0-4383-9bb1-942018cebdfa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:00:03.669859 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:03.669859 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:03.669859 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:03.669859 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:03.669859 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:03.669859 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:03.669859 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:03.669859 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:03.669859 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:03.669859 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:03.669859 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:03.669859 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:00:03.669859 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:00:03.669859 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:00:03.670879 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:00:03.670879 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:03.670879 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:03.670879 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:03.670879 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:03.670879 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:03.670879 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:03.670879 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:03.670879 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:03.670879 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:03.670879 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:03.670879 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:03.670879 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:03.670879 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:03.670879 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:03.670879 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:03.670879 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:03.672452 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:00:03.672452 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:00:03.672452 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:00:03.672452 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:00:03.672452 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:00:03.672452 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:00:03.672452 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:00:03.672452 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:03.679746 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 378/766] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 10:00:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:03.680883 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc8aad-e8c0-4383-9bb1-942018cebdfa None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:03.686030 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9323a7c-cf22-4b59-a6f3-44c9d651b405 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:03.724272 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c79348-d811-4aa3-82af-0e50b219a454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:03.725216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c79348-d811-4aa3-82af-0e50b219a454 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:03.725574 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c79348-d811-4aa3-82af-0e50b219a454 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:03.725946 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c79348-d811-4aa3-82af-0e50b219a454 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:03.735579 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c79348-d811-4aa3-82af-0e50b219a454 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:03.737201 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c79348-d811-4aa3-82af-0e50b219a454 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:03.745727 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:03.755208 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-d5c79348-d811-4aa3-82af-0e50b219a454 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:00:03.755208 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:03.755208 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:03.755208 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:03.755208 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:03.755208 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:03.755208 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:03.755208 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:03.755208 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:03.755208 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:03.755208 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:03.755208 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:03.755208 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:00:03.755208 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:00:03.755208 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:00:03.761281 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:00:03.761281 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:03.761281 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:03.761281 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:03.761281 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:03.761281 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:03.761281 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:03.761281 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:03.761281 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:03.761281 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:03.761281 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:03.761281 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:03.761281 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:03.761281 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:03.761281 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:03.761281 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:03.761281 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:03.762468 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:00:03.762468 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:00:03.762468 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:00:03.762468 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:00:03.762468 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:00:03.762468 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:00:03.762468 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:00:03.762468 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:03.762468 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 389/767] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 10:00:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:03.762468 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c79348-d811-4aa3-82af-0e50b219a454 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:03.792606 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc8aad-e8c0-4383-9bb1-942018cebdfa None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:03.830882 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858a1b0-e3b1-4996-a8de-ea79dc3bf801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:03.831686 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858a1b0-e3b1-4996-a8de-ea79dc3bf801 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:03.832707 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858a1b0-e3b1-4996-a8de-ea79dc3bf801 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:03.833057 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858a1b0-e3b1-4996-a8de-ea79dc3bf801 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:03.834005 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858a1b0-e3b1-4996-a8de-ea79dc3bf801 None admin] RBAC: Adding query filter params (interface=public, service_id=37a03fde83c442c596f755bc372f1ed7, region_id=RegionOne) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:03.834415 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858a1b0-e3b1-4996-a8de-ea79dc3bf801 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:03.835876 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858a1b0-e3b1-4996-a8de-ea79dc3bf801 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:03.844380 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 379/768] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Jun 22 10:00:03 2022] GET /identity/v3/endpoints?service_id=37a03fde83c442c596f755bc372f1ed7&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:03.845370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858a1b0-e3b1-4996-a8de-ea79dc3bf801 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:03.876994 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c79348-d811-4aa3-82af-0e50b219a454 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:03.916846 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c718c-d556-4578-8418-6672c17082ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:03.917789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c718c-d556-4578-8418-6672c17082ad None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:03.918223 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c718c-d556-4578-8418-6672c17082ad None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:03.918713 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c718c-d556-4578-8418-6672c17082ad None admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:03.919869 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0c718c-d556-4578-8418-6672c17082ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:03.920374 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0c718c-d556-4578-8418-6672c17082ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:03.922084 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0c718c-d556-4578-8418-6672c17082ad None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:03.936925 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 390/769] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 10:00:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:03.938336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c718c-d556-4578-8418-6672c17082ad None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:03.950407 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:03.959336 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858a1b0-e3b1-4996-a8de-ea79dc3bf801 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:03.984099 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:03.995056 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d2a05-22f9-4ded-bb2b-381d58841c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:03.996350 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d2a05-22f9-4ded-bb2b-381d58841c60 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:03.997920 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d2a05-22f9-4ded-bb2b-381d58841c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:03.998372 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d2a05-22f9-4ded-bb2b-381d58841c60 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:03.999332 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d2a05-22f9-4ded-bb2b-381d58841c60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:03.999784 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d2a05-22f9-4ded-bb2b-381d58841c60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:04.001665 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d2a05-22f9-4ded-bb2b-381d58841c60 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:04.015212 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 380/770] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 10:00:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:04.016351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d2a05-22f9-4ded-bb2b-381d58841c60 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:04.052124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c718c-d556-4578-8418-6672c17082ad None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:04.091942 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed899f1f-fdb2-4238-8d09-9c48bc9cf247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:04.092611 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed899f1f-fdb2-4238-8d09-9c48bc9cf247 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:04.092927 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed899f1f-fdb2-4238-8d09-9c48bc9cf247 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:04.093209 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed899f1f-fdb2-4238-8d09-9c48bc9cf247 None admin] PATH_INFO: `/v3/services` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:04.094402 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed899f1f-fdb2-4238-8d09-9c48bc9cf247 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:04.095434 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed899f1f-fdb2-4238-8d09-9c48bc9cf247 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:04.101543 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 391/771] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Jun 22 10:00:03 2022] GET /identity/v3/services => generated 772 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:04.102370 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed899f1f-fdb2-4238-8d09-9c48bc9cf247 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:04.137027 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d2a05-22f9-4ded-bb2b-381d58841c60 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:04.185682 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:04.225590 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81beaf80-df89-4ad0-bb81-9e1774c3c3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:04.226412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81beaf80-df89-4ad0-bb81-9e1774c3c3c8 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:04.226697 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81beaf80-df89-4ad0-bb81-9e1774c3c3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:04.226973 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81beaf80-df89-4ad0-bb81-9e1774c3c3c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:04.227092 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed899f1f-fdb2-4238-8d09-9c48bc9cf247 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:04.227820 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81beaf80-df89-4ad0-bb81-9e1774c3c3c8 None admin] RBAC: Adding query filter params (role.id=604a13bdd0fd46e182a9749de3b5232d, scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9, user.id=7b4d3b1fe8064cc592d89e7bab91bace) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:04.228129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81beaf80-df89-4ad0-bb81-9e1774c3c3c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:04.229629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81beaf80-df89-4ad0-bb81-9e1774c3c3c8 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:04.243981 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 381/772] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 10:00:04 2022] GET /identity/v3/role_assignments?user.id=7b4d3b1fe8064cc592d89e7bab91bace&scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9&role.id=604a13bdd0fd46e182a9749de3b5232d => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:04.267196 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7613c1-69d6-4cc3-9ab4-32e65e044099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:04.267889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7613c1-69d6-4cc3-9ab4-32e65e044099 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:04.268182 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7613c1-69d6-4cc3-9ab4-32e65e044099 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:04.268471 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7613c1-69d6-4cc3-9ab4-32e65e044099 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:04.269383 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7613c1-69d6-4cc3-9ab4-32e65e044099 None admin] RBAC: Adding query filter params (role.id=106aa464a69a49b09de7de5417083d3c, scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9, user.id=9c724063ce51470ca09c5c5ab231fd9b) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:04.270123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7613c1-69d6-4cc3-9ab4-32e65e044099 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:04.272280 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7613c1-69d6-4cc3-9ab4-32e65e044099 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:04.279532 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 392/773] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 10:00:04 2022] GET /identity/v3/role_assignments?user.id=9c724063ce51470ca09c5c5ab231fd9b&scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9&role.id=106aa464a69a49b09de7de5417083d3c => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:04.338112 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda677a2-7341-4157-b131-d0a7068d85af None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:04.338395 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda677a2-7341-4157-b131-d0a7068d85af None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:04.338676 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda677a2-7341-4157-b131-d0a7068d85af None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:04.340475 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 382/774] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:04.346553 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06775738-2985-4dd7-bbe7-c4480ad39bf9 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:04.346909 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06775738-2985-4dd7-bbe7-c4480ad39bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:04.347200 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06775738-2985-4dd7-bbe7-c4480ad39bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:04.368160 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-06775738-2985-4dd7-bbe7-c4480ad39bf9 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:04.369595 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-06775738-2985-4dd7-bbe7-c4480ad39bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:04.423595 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fbe59-3428-4107-b28d-ed4a0420b483 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:04.423927 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fbe59-3428-4107-b28d-ed4a0420b483 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:04.424193 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fbe59-3428-4107-b28d-ed4a0420b483 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:04.426499 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 383/775] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:04.432261 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe0513-4cd1-4882-8a21-467ebf70feba None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:04.432577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe0513-4cd1-4882-8a21-467ebf70feba None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:04.432853 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe0513-4cd1-4882-8a21-467ebf70feba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:04.454996 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-e0fe0513-4cd1-4882-8a21-467ebf70feba None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:04.456295 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-e0fe0513-4cd1-4882-8a21-467ebf70feba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:04.458710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 393/776] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:00:04.487784 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06775738-2985-4dd7-bbe7-c4480ad39bf9 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:04.520557 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:04.555754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 384/777] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:00:04.562025 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:04.616245 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06775738-2985-4dd7-bbe7-c4480ad39bf9 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:04.620520 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe0513-4cd1-4882-8a21-467ebf70feba None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:04.671968 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a108319-991f-42b7-9dec-2643d2af9ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:04.672779 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a108319-991f-42b7-9dec-2643d2af9ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:04.673131 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a108319-991f-42b7-9dec-2643d2af9ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:04.674353 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a108319-991f-42b7-9dec-2643d2af9ef9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:04.700126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a108319-991f-42b7-9dec-2643d2af9ef9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:00:04.709335 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-8a108319-991f-42b7-9dec-2643d2af9ef9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:00:04.709335 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:04.709335 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:04.709335 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:04.709335 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:04.709335 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:04.709335 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:04.709335 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:04.709335 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:04.709335 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:04.709335 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:04.709335 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:04.709335 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:00:04.709335 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:00:04.709335 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:00:04.709335 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:00:04.710272 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:00:04.710272 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:00:04.710272 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:00:04.710272 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:00:04.710272 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:04.710272 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:04.710272 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:04.710272 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:04.710272 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:04.710272 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:04.710272 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:04.710272 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:04.710272 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:04.710272 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:04.710272 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:04.710272 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:04.711109 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:04.711109 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:04.711109 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:04.711109 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:04.711109 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:00:04.711109 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:00:04.711109 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:00:04.711109 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:00:04.711109 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:00:04.711109 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:00:04.711109 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:00:04.711109 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:04.713299 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 394/778] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 10:00:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:00:04.717652 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a108319-991f-42b7-9dec-2643d2af9ef9 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:04.801346 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe0513-4cd1-4882-8a21-467ebf70feba None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:04.857529 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7a092-71d2-401d-b659-f5abe1c2fd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:04.858334 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7a092-71d2-401d-b659-f5abe1c2fd98 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:04.858620 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7a092-71d2-401d-b659-f5abe1c2fd98 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:04.858898 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7a092-71d2-401d-b659-f5abe1c2fd98 None admin] PATH_INFO: `/v3/services/network` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:04.859571 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7a092-71d2-401d-b659-f5abe1c2fd98 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:04.861017 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7a092-71d2-401d-b659-f5abe1c2fd98 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:04.880445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-8ca7a092-71d2-401d-b659-f5abe1c2fd98 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 10:00:04.880445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:04.880445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:00:04.880445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:00:04.880445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:00:04.880445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:00:04.880445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:00:04.880445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:04.880445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 10:00:04.880445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:04.880445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:00:04.880445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:04.880445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:04.880445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:04.880445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:04.880445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:04.880445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:04.881608 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:04.881608 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:04.881608 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:04.881608 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:04.881608 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:04.881608 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:04.881608 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:00:04.881608 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:00:04.881608 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:00:04.881608 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:00:04.881608 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:04.881608 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:04.881608 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:04.881608 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:04.881608 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:04.881608 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:04.882443 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:04.882443 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:04.882443 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:04.882443 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:04.882443 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:04.882443 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:04.882443 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:04.882443 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:04.882443 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:04.882443 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:04.882443 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:00:04.882443 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:04.882443 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 10:00:04.882443 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:04.883921 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 385/779] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 10:00:04 2022] GET /identity/v3/services/network => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:00:04.889742 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7a092-71d2-401d-b659-f5abe1c2fd98 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:04.923004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a108319-991f-42b7-9dec-2643d2af9ef9 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:04.967313 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:04.970182 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:04.986041 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c800aec-3866-4c8d-a67f-be9baa15965b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:04.986720 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c800aec-3866-4c8d-a67f-be9baa15965b None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:04.990062 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c800aec-3866-4c8d-a67f-be9baa15965b None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:04.990062 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c800aec-3866-4c8d-a67f-be9baa15965b None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:04.990062 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c800aec-3866-4c8d-a67f-be9baa15965b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:04.990062 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c800aec-3866-4c8d-a67f-be9baa15965b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:04.990062 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c800aec-3866-4c8d-a67f-be9baa15965b None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:05.002563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 395/780] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 10:00:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:05.007035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c800aec-3866-4c8d-a67f-be9baa15965b None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:05.070876 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7a092-71d2-401d-b659-f5abe1c2fd98 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:05.111133 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913aa6d2-057c-4c76-8d16-d61f1ba599e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:05.111970 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913aa6d2-057c-4c76-8d16-d61f1ba599e6 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:05.112262 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913aa6d2-057c-4c76-8d16-d61f1ba599e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:05.112545 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913aa6d2-057c-4c76-8d16-d61f1ba599e6 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:05.113918 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913aa6d2-057c-4c76-8d16-d61f1ba599e6 None admin] RBAC: Adding query filter params (name=network) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:05.114235 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913aa6d2-057c-4c76-8d16-d61f1ba599e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:05.115632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913aa6d2-057c-4c76-8d16-d61f1ba599e6 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:05.121512 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 386/781] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Jun 22 10:00:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:05.127560 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913aa6d2-057c-4c76-8d16-d61f1ba599e6 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:05.299014 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c800aec-3866-4c8d-a67f-be9baa15965b None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:05.377581 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b0e5c-61aa-4711-a7fc-3017f360e0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:05.378396 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b0e5c-61aa-4711-a7fc-3017f360e0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:05.378685 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b0e5c-61aa-4711-a7fc-3017f360e0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:05.379008 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b0e5c-61aa-4711-a7fc-3017f360e0a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:05.388148 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913aa6d2-057c-4c76-8d16-d61f1ba599e6 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:05.398109 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b0e5c-61aa-4711-a7fc-3017f360e0a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:05.399574 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b0e5c-61aa-4711-a7fc-3017f360e0a3 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:05.401423 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:05.420564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-a51b0e5c-61aa-4711-a7fc-3017f360e0a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:05.420564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:05.420564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:05.420564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:05.420564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:05.420564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:05.420564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:05.420564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:05.420564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:05.420564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:05.420564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:05.420564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:05.420564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:00:05.420564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:00:05.420564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:00:05.421564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:00:05.421564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:05.421564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:05.421564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:05.421564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:05.421564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:05.421564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:05.421564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:05.421564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:05.421564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:05.421564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:05.421564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:05.421564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:05.421564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:05.421564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:05.421564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:05.421564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:05.422443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:00:05.422443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:00:05.422443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:05.422443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:05.422443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 396/782] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 415 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:05.429758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b0e5c-61aa-4711-a7fc-3017f360e0a3 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:05.445954 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80e32d-0820-40cd-b795-a179be79adf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:05.446963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80e32d-0820-40cd-b795-a179be79adf9 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:05.447441 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80e32d-0820-40cd-b795-a179be79adf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:05.447925 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80e32d-0820-40cd-b795-a179be79adf9 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:05.448869 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80e32d-0820-40cd-b795-a179be79adf9 None admin] RBAC: Adding query filter params (type=network) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:05.449375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80e32d-0820-40cd-b795-a179be79adf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:05.450959 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80e32d-0820-40cd-b795-a179be79adf9 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:05.458619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 387/783] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Jun 22 10:00:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:05.464486 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80e32d-0820-40cd-b795-a179be79adf9 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:05.521187 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:05.597100 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80e32d-0820-40cd-b795-a179be79adf9 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:05.634808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0f4cc-85bd-44bd-ba39-039f7a41dd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:05.635492 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0f4cc-85bd-44bd-ba39-039f7a41dd30 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:05.635775 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0f4cc-85bd-44bd-ba39-039f7a41dd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:05.636053 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0f4cc-85bd-44bd-ba39-039f7a41dd30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:05.637116 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0f4cc-85bd-44bd-ba39-039f7a41dd30 None admin] RBAC: Adding query filter params (interface=public, service_id=455cd4dd7b0844909c0d14e80b4fe36f, region_id=RegionOne) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:05.637431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0f4cc-85bd-44bd-ba39-039f7a41dd30 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:05.639023 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0f4cc-85bd-44bd-ba39-039f7a41dd30 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:05.645576 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 388/784] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Jun 22 10:00:05 2022] GET /identity/v3/endpoints?service_id=455cd4dd7b0844909c0d14e80b4fe36f&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:05.656436 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0f4cc-85bd-44bd-ba39-039f7a41dd30 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:05.674183 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b0e5c-61aa-4711-a7fc-3017f360e0a3 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:05.729198 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:05.752039 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3df3a1-224c-4839-99bd-e2b2a6ca8051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:05.753322 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3df3a1-224c-4839-99bd-e2b2a6ca8051 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:05.755475 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3df3a1-224c-4839-99bd-e2b2a6ca8051 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:05.756163 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3df3a1-224c-4839-99bd-e2b2a6ca8051 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:05.757135 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3df3a1-224c-4839-99bd-e2b2a6ca8051 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:05.758265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3df3a1-224c-4839-99bd-e2b2a6ca8051 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:05.764886 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3df3a1-224c-4839-99bd-e2b2a6ca8051 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:05.785388 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 397/785] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:05.789132 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3df3a1-224c-4839-99bd-e2b2a6ca8051 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:05.854270 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0f4cc-85bd-44bd-ba39-039f7a41dd30 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:05.929856 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:05.934544 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3df3a1-224c-4839-99bd-e2b2a6ca8051 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:05.935857 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5d03c-f92f-445c-b1b2-cece0ab26d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:05.936704 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5d03c-f92f-445c-b1b2-cece0ab26d6d None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:05.938066 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5d03c-f92f-445c-b1b2-cece0ab26d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:05.938495 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5d03c-f92f-445c-b1b2-cece0ab26d6d None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:05.939984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5d03c-f92f-445c-b1b2-cece0ab26d6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:05.942809 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5d03c-f92f-445c-b1b2-cece0ab26d6d None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:05.955979 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 389/786] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Jun 22 10:00:05 2022] GET /identity/v3/services => generated 772 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:00:05.982600 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d669355-92ba-4f71-a014-838ba9470499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:05.983715 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d669355-92ba-4f71-a014-838ba9470499 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:05.984244 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d669355-92ba-4f71-a014-838ba9470499 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:05.984671 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d669355-92ba-4f71-a014-838ba9470499 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:06.001200 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d669355-92ba-4f71-a014-838ba9470499 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:06.003042 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d669355-92ba-4f71-a014-838ba9470499 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:06.025613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-0d669355-92ba-4f71-a014-838ba9470499 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:00:06.025613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:06.025613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:06.025613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:06.025613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:06.025613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:06.025613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:06.025613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:06.025613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:06.025613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:06.025613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:06.025613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:06.025613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:00:06.025613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:00:06.025613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:00:06.025613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:00:06.026790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:06.026790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:06.026790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:00:06.026790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:00:06.026790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:00:06.026790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:00:06.026790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:06.026790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:06.026790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:06.026790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:06.026790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:06.026790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:06.026790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:06.026790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:06.026790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:06.026790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:06.026790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:06.026790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:06.027771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:06.027771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:06.027771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:00:06.027771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:00:06.027771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:00:06.027771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:00:06.027771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:00:06.027771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:00:06.027771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:00:06.027771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:06.030085 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 398/787] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Jun 22 10:00:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:06.035927 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5d03c-f92f-445c-b1b2-cece0ab26d6d None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:06.178265 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:06.182463 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5d03c-f92f-445c-b1b2-cece0ab26d6d None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:06.229051 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfb952-33ea-4cf0-a6fc-1c07bbd0caa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:06.229732 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfb952-33ea-4cf0-a6fc-1c07bbd0caa7 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:06.230015 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfb952-33ea-4cf0-a6fc-1c07bbd0caa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:06.230293 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfb952-33ea-4cf0-a6fc-1c07bbd0caa7 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:06.231146 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dfb952-33ea-4cf0-a6fc-1c07bbd0caa7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:06.231461 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dfb952-33ea-4cf0-a6fc-1c07bbd0caa7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:06.232959 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dfb952-33ea-4cf0-a6fc-1c07bbd0caa7 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:06.264190 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 390/788] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Jun 22 10:00:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:06.270594 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d669355-92ba-4f71-a014-838ba9470499 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:06.403789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d669355-92ba-4f71-a014-838ba9470499 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:06.439388 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caecc435-0ab6-47d6-8813-b18d5b165fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:06.440409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecc435-0ab6-47d6-8813-b18d5b165fbb None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:06.441035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecc435-0ab6-47d6-8813-b18d5b165fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:06.442035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecc435-0ab6-47d6-8813-b18d5b165fbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:06.472333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:06.532366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caecc435-0ab6-47d6-8813-b18d5b165fbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:06.534367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caecc435-0ab6-47d6-8813-b18d5b165fbb None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:06.649226 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 399/789] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 10:00:06 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:00:06.656863 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfb952-33ea-4cf0-a6fc-1c07bbd0caa7 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:06.726871 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f36d2f-5088-470d-9d9a-e49e654df74f None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:06.727357 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f36d2f-5088-470d-9d9a-e49e654df74f None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:06.727357 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f36d2f-5088-470d-9d9a-e49e654df74f None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:06.729120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 400/790] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:00:06.744184 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71626718-bf85-4cd9-9cf8-c1e118463147 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:06.744504 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71626718-bf85-4cd9-9cf8-c1e118463147 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:06.744751 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71626718-bf85-4cd9-9cf8-c1e118463147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:06.763144 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-71626718-bf85-4cd9-9cf8-c1e118463147 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:06.764457 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-71626718-bf85-4cd9-9cf8-c1e118463147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:06.782404 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfb952-33ea-4cf0-a6fc-1c07bbd0caa7 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:06.826348 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466876af-66b9-4a7c-9062-d61da195d57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:06.827846 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466876af-66b9-4a7c-9062-d61da195d57e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:06.828907 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466876af-66b9-4a7c-9062-d61da195d57e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:06.829422 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466876af-66b9-4a7c-9062-d61da195d57e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:06.842706 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:06.845400 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466876af-66b9-4a7c-9062-d61da195d57e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:06.848044 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466876af-66b9-4a7c-9062-d61da195d57e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:06.860961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 401/791] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:00:06.862340 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a386d-eed3-4b3c-90fb-97f70bf18829 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:06.862635 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a386d-eed3-4b3c-90fb-97f70bf18829 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:06.862912 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a386d-eed3-4b3c-90fb-97f70bf18829 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:06.864479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 402/792] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:06.865577 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da7893-c299-48de-aa8c-d370c6a50d93 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:06.865862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da7893-c299-48de-aa8c-d370c6a50d93 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:06.866142 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da7893-c299-48de-aa8c-d370c6a50d93 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:06.867594 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 403/793] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:06.872632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d514cc-291f-4ad6-a715-09239ed8e13b None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:06.872966 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d514cc-291f-4ad6-a715-09239ed8e13b None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:06.873246 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d514cc-291f-4ad6-a715-09239ed8e13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:06.874330 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-466876af-66b9-4a7c-9062-d61da195d57e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:06.874330 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:06.874330 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:06.874330 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:06.874330 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:06.874330 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:06.874330 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:06.874330 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:06.874330 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:06.874330 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:06.874330 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:06.874330 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:06.874330 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:00:06.874330 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:00:06.874330 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:00:06.875202 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:00:06.875202 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:06.875202 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:06.875202 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:06.875202 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:06.875202 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:06.875202 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:06.875202 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:06.875202 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:06.875202 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:06.875202 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:06.875202 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:06.875202 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:06.875202 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:06.875202 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:06.875202 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:06.875202 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:06.876074 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:00:06.876074 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:00:06.876074 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:06.876074 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:06.878167 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 391/794] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:06.882838 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91af26-5e16-41a4-9d13-30052c016415 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:06.882838 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91af26-5e16-41a4-9d13-30052c016415 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:06.882838 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91af26-5e16-41a4-9d13-30052c016415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:06.893341 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-16d514cc-291f-4ad6-a715-09239ed8e13b None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:06.895065 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-16d514cc-291f-4ad6-a715-09239ed8e13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:06.901405 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-ed91af26-5e16-41a4-9d13-30052c016415 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:06.902621 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-ed91af26-5e16-41a4-9d13-30052c016415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:06.905441 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:06.969718 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 404/795] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:00:06.970563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d514cc-291f-4ad6-a715-09239ed8e13b None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:06.986558 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 392/796] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:00:06.987692 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91af26-5e16-41a4-9d13-30052c016415 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:07.105005 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d514cc-291f-4ad6-a715-09239ed8e13b None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:07.115315 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91af26-5e16-41a4-9d13-30052c016415 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:07.130210 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:07.147747 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9169d-656f-4bb1-bd94-e55b68b3c711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:07.148628 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9169d-656f-4bb1-bd94-e55b68b3c711 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:07.148944 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9169d-656f-4bb1-bd94-e55b68b3c711 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:07.149270 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9169d-656f-4bb1-bd94-e55b68b3c711 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:07.149894 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9169d-656f-4bb1-bd94-e55b68b3c711 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:07.151273 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9169d-656f-4bb1-bd94-e55b68b3c711 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:07.151515 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b57ca-c363-429d-a920-c968c1e2b716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:07.156167 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b57ca-c363-429d-a920-c968c1e2b716 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:07.156167 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b57ca-c363-429d-a920-c968c1e2b716 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:07.156167 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b57ca-c363-429d-a920-c968c1e2b716 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:07.156167 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b57ca-c363-429d-a920-c968c1e2b716 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:07.156167 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b57ca-c363-429d-a920-c968c1e2b716 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:07.156167 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b57ca-c363-429d-a920-c968c1e2b716 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:07.162275 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:07.163647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-1fe9169d-656f-4bb1-bd94-e55b68b3c711 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 10:00:07.163647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:07.163647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:00:07.163647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:00:07.163647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:00:07.163647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:00:07.163647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:00:07.163647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:07.163647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 10:00:07.163647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:07.163647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:00:07.163647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:07.163647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:07.163647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:07.163647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:07.163647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:07.164563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:07.164563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:07.164563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:07.164563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:07.164563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:07.164563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:07.164563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:07.164563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:00:07.164563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:00:07.164563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:00:07.164563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:00:07.164563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:07.164563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:07.164563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:07.164563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:07.164563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:07.165718 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:07.165718 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:07.165718 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:07.165718 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:07.165718 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:07.165718 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:07.165718 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:07.165718 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:07.165718 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:07.165718 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:07.165718 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:07.165718 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:00:07.165718 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:07.165718 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 10:00:07.165718 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:07.165718 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 405/797] 10.222.0.46 () {56 vars in 1129 bytes} [Wed Jun 22 10:00:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:07.166563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9169d-656f-4bb1-bd94-e55b68b3c711 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:07.177428 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 393/798] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:07.177428 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b57ca-c363-429d-a920-c968c1e2b716 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:07.284838 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9169d-656f-4bb1-bd94-e55b68b3c711 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:07.285473 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b57ca-c363-429d-a920-c968c1e2b716 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:07.325987 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bd503-cc91-441f-a5ff-9f541514ad1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:07.327087 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bd503-cc91-441f-a5ff-9f541514ad1d None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:07.327519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bd503-cc91-441f-a5ff-9f541514ad1d None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:07.328334 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bd503-cc91-441f-a5ff-9f541514ad1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:07.331607 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99012142-654f-4e6d-a5f8-ea3860ba54ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:07.333117 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99012142-654f-4e6d-a5f8-ea3860ba54ed None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:07.333509 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99012142-654f-4e6d-a5f8-ea3860ba54ed None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:07.333889 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99012142-654f-4e6d-a5f8-ea3860ba54ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:07.342129 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861bd503-cc91-441f-a5ff-9f541514ad1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:00:07.345066 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99012142-654f-4e6d-a5f8-ea3860ba54ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:00:07.350367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-861bd503-cc91-441f-a5ff-9f541514ad1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:00:07.350367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:07.350367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:07.350367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:07.350367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:07.350367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:07.350367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:07.350367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:07.350367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:07.350367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:07.350367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:07.350367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:07.350367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:00:07.350367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:00:07.350367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:00:07.350367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:00:07.351507 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:00:07.351507 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:00:07.351507 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:00:07.351507 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:00:07.351507 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:07.351507 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:07.351507 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:07.351507 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:07.351507 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:07.351507 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:07.351507 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:07.351507 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:07.351507 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:07.351507 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:07.351507 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:07.351507 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:07.352534 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:07.352534 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:07.352534 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:07.352534 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:07.352534 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:00:07.352534 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:00:07.352534 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:00:07.352534 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:00:07.352534 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:00:07.352534 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:00:07.352534 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:00:07.352534 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:07.359474 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-99012142-654f-4e6d-a5f8-ea3860ba54ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:00:07.359474 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:07.359474 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:07.359474 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:07.359474 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:07.359474 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:07.359474 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:07.359474 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:07.359474 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:07.359474 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:07.359474 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:07.359474 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:07.359474 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:00:07.359474 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:00:07.359474 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:00:07.359474 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:00:07.360454 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:00:07.360454 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:00:07.360454 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:00:07.360454 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:00:07.360454 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:07.360454 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:07.360454 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:07.360454 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:07.360454 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:07.360454 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:07.360454 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:07.360454 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:07.360454 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:07.360454 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:07.360454 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:07.360454 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:07.361303 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:07.361303 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:07.361303 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:07.361303 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:07.361303 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:00:07.361303 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:00:07.361303 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:00:07.361303 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:00:07.361303 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:00:07.361303 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:00:07.361303 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:00:07.361303 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:07.362018 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 394/799] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 10:00:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:07.362543 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 406/800] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 22 10:00:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:07.363404 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99012142-654f-4e6d-a5f8-ea3860ba54ed None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:07.363763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bd503-cc91-441f-a5ff-9f541514ad1d None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:07.420227 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:07.434925 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:07.479799 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99012142-654f-4e6d-a5f8-ea3860ba54ed None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:07.481183 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bd503-cc91-441f-a5ff-9f541514ad1d None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:07.515355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd861a-a47e-4f9f-b1f0-22964ed33cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:07.516323 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd861a-a47e-4f9f-b1f0-22964ed33cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:07.516967 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd861a-a47e-4f9f-b1f0-22964ed33cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:07.517438 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd861a-a47e-4f9f-b1f0-22964ed33cb6 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:07.518319 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd861a-a47e-4f9f-b1f0-22964ed33cb6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:07.518830 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd861a-a47e-4f9f-b1f0-22964ed33cb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:07.519152 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7dc294-5d21-4438-99b4-e3fa782c58ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:07.519965 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dc294-5d21-4438-99b4-e3fa782c58ea None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:07.520250 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dc294-5d21-4438-99b4-e3fa782c58ea None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:07.520527 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dc294-5d21-4438-99b4-e3fa782c58ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:07.521342 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd861a-a47e-4f9f-b1f0-22964ed33cb6 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:07.531683 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7dc294-5d21-4438-99b4-e3fa782c58ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:07.531683 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7dc294-5d21-4438-99b4-e3fa782c58ea None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:07.532351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 395/801] 10.222.0.46 () {56 vars in 1124 bytes} [Wed Jun 22 10:00:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:07.533445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd861a-a47e-4f9f-b1f0-22964ed33cb6 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:07.547945 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-aa7dc294-5d21-4438-99b4-e3fa782c58ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:00:07.547945 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:07.547945 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:07.547945 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:07.547945 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:07.547945 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:07.547945 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:07.547945 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:07.547945 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:07.547945 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:07.547945 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:07.547945 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:07.547945 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:00:07.547945 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:00:07.547945 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:00:07.548914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:00:07.548914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:07.548914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:07.548914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:07.548914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:07.548914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:07.548914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:07.548914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:07.548914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:07.548914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:07.548914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:07.548914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:07.548914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:07.548914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:07.548914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:07.548914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:07.548914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:07.549793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:00:07.549793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:00:07.549793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:00:07.549793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:00:07.549793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:00:07.549793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:00:07.549793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:00:07.549793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:07.555119 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 407/802] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 10:00:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:07.555477 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7dc294-5d21-4438-99b4-e3fa782c58ea None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:07.656215 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd861a-a47e-4f9f-b1f0-22964ed33cb6 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:07.666893 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7dc294-5d21-4438-99b4-e3fa782c58ea None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:07.668790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:07.683967 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:07.697778 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7372c-2bb7-4ecd-b44b-155354710e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:07.698660 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7372c-2bb7-4ecd-b44b-155354710e11 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:07.699114 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7372c-2bb7-4ecd-b44b-155354710e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:07.699533 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7372c-2bb7-4ecd-b44b-155354710e11 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:07.700502 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7372c-2bb7-4ecd-b44b-155354710e11 None admin] RBAC: Adding query filter params (name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:07.700989 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7372c-2bb7-4ecd-b44b-155354710e11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:07.702548 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7372c-2bb7-4ecd-b44b-155354710e11 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:07.707212 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4090bd-cccd-46d3-b5d6-64bf8668fcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:07.707887 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4090bd-cccd-46d3-b5d6-64bf8668fcc5 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:07.708170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4090bd-cccd-46d3-b5d6-64bf8668fcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:07.708454 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4090bd-cccd-46d3-b5d6-64bf8668fcc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:07.709282 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4090bd-cccd-46d3-b5d6-64bf8668fcc5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:07.716693 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4090bd-cccd-46d3-b5d6-64bf8668fcc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:07.716693 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4090bd-cccd-46d3-b5d6-64bf8668fcc5 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:07.716918 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 396/803] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 22 10:00:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:07.716918 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7372c-2bb7-4ecd-b44b-155354710e11 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:07.724291 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 408/804] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 10:00:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:07.725480 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4090bd-cccd-46d3-b5d6-64bf8668fcc5 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:07.828724 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7372c-2bb7-4ecd-b44b-155354710e11 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:07.836384 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4090bd-cccd-46d3-b5d6-64bf8668fcc5 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:07.866130 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf587b8-6675-4801-9865-21cb3d420ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:07.866821 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf587b8-6675-4801-9865-21cb3d420ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:07.867103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf587b8-6675-4801-9865-21cb3d420ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:07.867372 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf587b8-6675-4801-9865-21cb3d420ad8 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:07.868100 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf587b8-6675-4801-9865-21cb3d420ad8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:07.868409 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf587b8-6675-4801-9865-21cb3d420ad8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:07.869845 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf587b8-6675-4801-9865-21cb3d420ad8 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:07.874192 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310df64-0237-462b-af78-21b794489a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:07.874863 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310df64-0237-462b-af78-21b794489a4d None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:07.875148 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310df64-0237-462b-af78-21b794489a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:07.880665 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310df64-0237-462b-af78-21b794489a4d None admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:07.880957 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 397/805] 10.222.0.46 () {56 vars in 1124 bytes} [Wed Jun 22 10:00:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:07.881077 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b310df64-0237-462b-af78-21b794489a4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:07.881154 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf587b8-6675-4801-9865-21cb3d420ad8 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:07.881224 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b310df64-0237-462b-af78-21b794489a4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:07.881224 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b310df64-0237-462b-af78-21b794489a4d None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:07.891736 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 409/806] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 10:00:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:07.899685 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310df64-0237-462b-af78-21b794489a4d None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:07.923466 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:07.934924 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:07.985632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf587b8-6675-4801-9865-21cb3d420ad8 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:08.001033 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310df64-0237-462b-af78-21b794489a4d None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:08.026076 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa08aab-ac23-4638-98c8-36efd95178a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:08.027173 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa08aab-ac23-4638-98c8-36efd95178a7 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:08.027599 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa08aab-ac23-4638-98c8-36efd95178a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:08.028038 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa08aab-ac23-4638-98c8-36efd95178a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:08.038791 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19608e-2e8a-4d49-ac2e-c3560aad8044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:08.039481 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19608e-2e8a-4d49-ac2e-c3560aad8044 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:08.039761 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19608e-2e8a-4d49-ac2e-c3560aad8044 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:08.039928 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa08aab-ac23-4638-98c8-36efd95178a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:08.040040 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19608e-2e8a-4d49-ac2e-c3560aad8044 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:08.041439 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa08aab-ac23-4638-98c8-36efd95178a7 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:08.050487 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19608e-2e8a-4d49-ac2e-c3560aad8044 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:08.051928 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19608e-2e8a-4d49-ac2e-c3560aad8044 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:08.062480 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-9aa08aab-ac23-4638-98c8-36efd95178a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:08.062480 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:08.062480 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:08.062480 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:08.062480 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:08.062480 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:08.062480 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:08.062480 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:08.062480 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:08.062480 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:08.062480 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:08.062480 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:08.062480 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:00:08.062480 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:00:08.062480 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:00:08.063356 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:00:08.063356 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:08.063356 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:08.063356 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:08.063356 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:08.063356 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:08.063356 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:08.063356 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:08.063356 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:08.063356 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:08.063356 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:08.063356 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:08.063356 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:08.063356 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:08.063356 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:08.063356 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:08.063356 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:08.064229 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:00:08.064229 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:00:08.064229 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:08.064229 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:08.066633 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 398/807] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:08.067543 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa08aab-ac23-4638-98c8-36efd95178a7 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:08.070081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-af19608e-2e8a-4d49-ac2e-c3560aad8044 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:08.070081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:08.070081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:08.070081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:08.070081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:08.070081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:08.070081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:08.070081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:08.070081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:08.070081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:08.070081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:08.070081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:08.070081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:00:08.070081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:00:08.070081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:00:08.070915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:00:08.070915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:08.070915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:08.070915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:08.070915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:08.070915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:08.070915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:08.070915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:08.070915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:08.070915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:08.070915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:08.070915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:08.070915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:08.070915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:08.070915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:08.070915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:08.070915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:08.071816 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:00:08.071816 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:00:08.071816 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:08.071816 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:08.071816 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 410/808] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:08.072589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19608e-2e8a-4d49-ac2e-c3560aad8044 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:08.165454 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:08.185301 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:08.187575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19608e-2e8a-4d49-ac2e-c3560aad8044 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:08.187818 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa08aab-ac23-4638-98c8-36efd95178a7 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:08.223278 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54f059-2d46-40e9-82d2-62267830a4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:08.223937 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54f059-2d46-40e9-82d2-62267830a4e2 None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:08.224216 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54f059-2d46-40e9-82d2-62267830a4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:08.224489 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54f059-2d46-40e9-82d2-62267830a4e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:08.225261 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f54f059-2d46-40e9-82d2-62267830a4e2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:08.226694 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f54f059-2d46-40e9-82d2-62267830a4e2 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:08.228165 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b23409-4c8c-49aa-a58c-4d94c221c3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:08.228905 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b23409-4c8c-49aa-a58c-4d94c221c3dc None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:08.229197 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b23409-4c8c-49aa-a58c-4d94c221c3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:08.229478 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b23409-4c8c-49aa-a58c-4d94c221c3dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:08.230984 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b23409-4c8c-49aa-a58c-4d94c221c3dc None admin] RBAC: Adding query filter params (role.id=106aa464a69a49b09de7de5417083d3c, scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9, user.id=4ed9a00723ab4af2b633ab7614d178a8) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:08.232465 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b23409-4c8c-49aa-a58c-4d94c221c3dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:08.233938 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b23409-4c8c-49aa-a58c-4d94c221c3dc None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:08.241383 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 411/809] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 10:00:08 2022] GET /identity/v3/role_assignments?user.id=4ed9a00723ab4af2b633ab7614d178a8&scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9&role.id=106aa464a69a49b09de7de5417083d3c => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:08.242276 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b23409-4c8c-49aa-a58c-4d94c221c3dc None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:08.364460 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b23409-4c8c-49aa-a58c-4d94c221c3dc None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:08.380671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 399/810] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Jun 22 10:00:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:00:08.380671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54f059-2d46-40e9-82d2-62267830a4e2 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:08.417917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b7e0e-daf5-42c1-88e8-2181cfba1888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:08.418555 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b7e0e-daf5-42c1-88e8-2181cfba1888 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:08.424113 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b7e0e-daf5-42c1-88e8-2181cfba1888 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:08.424419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b7e0e-daf5-42c1-88e8-2181cfba1888 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:08.425235 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b7e0e-daf5-42c1-88e8-2181cfba1888 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:08.425546 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b7e0e-daf5-42c1-88e8-2181cfba1888 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:08.427158 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b7e0e-daf5-42c1-88e8-2181cfba1888 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:08.438041 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:08.442011 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 412/811] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:08.443724 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcc6d6-1f2d-4cf4-a19b-204935c4f333 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:08.444014 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcc6d6-1f2d-4cf4-a19b-204935c4f333 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:08.444296 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcc6d6-1f2d-4cf4-a19b-204935c4f333 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:08.449868 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 413/812] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:08.454617 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcc6d6-1f2d-4cf4-a19b-204935c4f333 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:08.520021 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54f059-2d46-40e9-82d2-62267830a4e2 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:08.571097 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a336c6-c968-49fb-9fbf-cf78f3cb92b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:08.571780 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a336c6-c968-49fb-9fbf-cf78f3cb92b1 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:08.572065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a336c6-c968-49fb-9fbf-cf78f3cb92b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:08.572345 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a336c6-c968-49fb-9fbf-cf78f3cb92b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:08.573189 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a336c6-c968-49fb-9fbf-cf78f3cb92b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:08.573514 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a336c6-c968-49fb-9fbf-cf78f3cb92b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:08.575077 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a336c6-c968-49fb-9fbf-cf78f3cb92b1 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:08.590673 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcc6d6-1f2d-4cf4-a19b-204935c4f333 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:08.595842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 400/813] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:08.597445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714ca91-8588-4b74-af79-bb2e7e30cc99 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:08.597919 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714ca91-8588-4b74-af79-bb2e7e30cc99 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:08.598369 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714ca91-8588-4b74-af79-bb2e7e30cc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:08.617455 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-8714ca91-8588-4b74-af79-bb2e7e30cc99 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:08.618782 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-8714ca91-8588-4b74-af79-bb2e7e30cc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:08.632913 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c8be6-c62b-4b41-a087-b1bb3d6a8e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:08.633144 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:08.634458 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c8be6-c62b-4b41-a087-b1bb3d6a8e8f None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:08.634851 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c8be6-c62b-4b41-a087-b1bb3d6a8e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:08.635153 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c8be6-c62b-4b41-a087-b1bb3d6a8e8f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:08.643470 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c8be6-c62b-4b41-a087-b1bb3d6a8e8f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:08.646388 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c8be6-c62b-4b41-a087-b1bb3d6a8e8f None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:08.663100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-4e3c8be6-c62b-4b41-a087-b1bb3d6a8e8f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:00:08.663100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:08.663100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:08.663100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:08.663100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:08.663100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:08.663100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:08.663100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:08.663100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:08.663100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:08.663100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:08.663100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:08.663100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:00:08.663100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:00:08.663100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:00:08.663100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:00:08.664305 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:08.664305 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:08.664305 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:00:08.664305 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:00:08.664305 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:00:08.664305 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:00:08.664305 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:08.664305 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:08.664305 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:08.664305 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:08.664305 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:08.664305 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:08.664305 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:08.664305 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:08.664305 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:08.664305 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:08.664305 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:08.664305 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:08.665589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:08.665589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:08.665589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:00:08.665589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:00:08.665589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:00:08.665589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:00:08.665589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:00:08.665589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:00:08.665589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:00:08.665589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:08.665589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 414/814] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Jun 22 10:00:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:08.666323 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c8be6-c62b-4b41-a087-b1bb3d6a8e8f None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:08.709147 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 401/815] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:00:08.710800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714ca91-8588-4b74-af79-bb2e7e30cc99 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:08.729832 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:08.781380 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c8be6-c62b-4b41-a087-b1bb3d6a8e8f None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:08.818821 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505df69-44d9-465f-932a-28af15f19e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:08.819777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505df69-44d9-465f-932a-28af15f19e03 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:08.820140 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505df69-44d9-465f-932a-28af15f19e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:08.820460 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505df69-44d9-465f-932a-28af15f19e03 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:08.829290 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505df69-44d9-465f-932a-28af15f19e03 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:08.830848 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505df69-44d9-465f-932a-28af15f19e03 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:08.843225 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714ca91-8588-4b74-af79-bb2e7e30cc99 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:08.846378 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-1505df69-44d9-465f-932a-28af15f19e03 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 10:00:08.846378 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:08.846378 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:08.846378 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:08.846378 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:08.846378 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:08.846378 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:08.846378 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:08.846378 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:08.846378 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:08.846378 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:08.846378 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:08.846378 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:00:08.846378 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:00:08.846378 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:00:08.846378 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:00:08.848371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:08.848371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:08.848371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:00:08.848371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:00:08.848371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:00:08.848371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:00:08.848371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:08.848371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:08.848371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:08.848371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:08.848371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:08.848371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:08.848371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:08.848371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:08.848371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:08.848371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:08.848371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:08.848371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:08.849613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:08.849613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:08.849613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:00:08.849613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:00:08.849613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:00:08.849613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:00:08.849613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:00:08.849613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:00:08.849613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 10:00:08.849613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:08.849613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 415/816] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 10:00:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:08.850544 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505df69-44d9-465f-932a-28af15f19e03 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:08.885773 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7abff07-1d94-47fa-8e6b-48cc0e46ef08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:08.886857 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abff07-1d94-47fa-8e6b-48cc0e46ef08 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:08.887321 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abff07-1d94-47fa-8e6b-48cc0e46ef08 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:08.887797 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abff07-1d94-47fa-8e6b-48cc0e46ef08 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:08.888841 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7abff07-1d94-47fa-8e6b-48cc0e46ef08 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:08.889401 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7abff07-1d94-47fa-8e6b-48cc0e46ef08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:08.891011 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7abff07-1d94-47fa-8e6b-48cc0e46ef08 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:08.911870 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 402/817] 10.222.0.46 () {56 vars in 1149 bytes} [Wed Jun 22 10:00:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:08.913235 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7abff07-1d94-47fa-8e6b-48cc0e46ef08 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:08.918372 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:08.957013 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505df69-44d9-465f-932a-28af15f19e03 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:08.980081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:09.003181 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec06a5-b6a2-4bb9-8588-b69af0ce34fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:09.004145 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec06a5-b6a2-4bb9-8588-b69af0ce34fb None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:09.004502 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec06a5-b6a2-4bb9-8588-b69af0ce34fb None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:09.004914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec06a5-b6a2-4bb9-8588-b69af0ce34fb None admin] PATH_INFO: `/v3/services/network` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:09.005659 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec06a5-b6a2-4bb9-8588-b69af0ce34fb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:09.007759 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec06a5-b6a2-4bb9-8588-b69af0ce34fb None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:09.024626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-01ec06a5-b6a2-4bb9-8588-b69af0ce34fb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 10:00:09.024626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:09.024626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:00:09.024626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:00:09.024626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:00:09.024626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:00:09.024626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:00:09.024626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:09.024626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 10:00:09.024626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:09.024626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:00:09.024626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:09.024626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:09.024626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:09.024626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:09.024626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:09.024626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:09.025695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:09.025695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:09.025695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:09.025695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:09.025695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:09.025695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:09.025695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:00:09.025695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:00:09.025695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:00:09.025695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:00:09.025695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:09.025695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:09.025695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:09.025695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:09.025695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:09.025695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:09.026746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:09.026746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:09.026746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:09.026746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:09.026746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:09.026746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:09.026746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:09.026746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:09.026746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:09.026746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:09.026746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:00:09.026746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:09.026746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 10:00:09.026746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:09.026746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 416/818] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 10:00:08 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:09.027730 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec06a5-b6a2-4bb9-8588-b69af0ce34fb None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:09.044268 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7abff07-1d94-47fa-8e6b-48cc0e46ef08 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:09.100729 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5c04a-bbe1-49ad-81d7-34696e9436d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:09.101709 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5c04a-bbe1-49ad-81d7-34696e9436d7 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:09.102135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5c04a-bbe1-49ad-81d7-34696e9436d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:09.102594 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5c04a-bbe1-49ad-81d7-34696e9436d7 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:09.104250 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c5c04a-bbe1-49ad-81d7-34696e9436d7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:09.104735 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c5c04a-bbe1-49ad-81d7-34696e9436d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:09.107507 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c5c04a-bbe1-49ad-81d7-34696e9436d7 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:09.131583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 403/819] 10.222.0.46 () {56 vars in 1135 bytes} [Wed Jun 22 10:00:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:09.132744 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5c04a-bbe1-49ad-81d7-34696e9436d7 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:09.173439 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec06a5-b6a2-4bb9-8588-b69af0ce34fb None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:09.209549 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a502a51-2ce2-4ba0-90d3-1a4428f7e91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:09.210512 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a502a51-2ce2-4ba0-90d3-1a4428f7e91e None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:09.210894 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a502a51-2ce2-4ba0-90d3-1a4428f7e91e None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:09.211341 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a502a51-2ce2-4ba0-90d3-1a4428f7e91e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:09.213152 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:09.225124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a502a51-2ce2-4ba0-90d3-1a4428f7e91e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:09.228604 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a502a51-2ce2-4ba0-90d3-1a4428f7e91e None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:09.245198 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-7a502a51-2ce2-4ba0-90d3-1a4428f7e91e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:09.245198 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:09.245198 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:09.245198 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:09.245198 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:09.245198 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:09.245198 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:09.245198 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:09.245198 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:09.245198 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:09.245198 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:09.245198 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:09.245198 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:00:09.245198 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:00:09.245198 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:00:09.246318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:00:09.246318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:09.246318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:09.246318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:09.246318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:09.246318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:09.246318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:09.246318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:09.246318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:09.246318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:09.246318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:09.246318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:09.246318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:09.246318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:09.246318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:09.246318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:09.246318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:09.247430 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:00:09.247430 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:00:09.247430 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:09.247430 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:09.253825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 417/820] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:09.254816 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a502a51-2ce2-4ba0-90d3-1a4428f7e91e None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:09.262248 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5c04a-bbe1-49ad-81d7-34696e9436d7 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:09.302296 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae889fac-d4ee-47d5-98e1-cfcf66efbd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:09.303275 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae889fac-d4ee-47d5-98e1-cfcf66efbd56 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:09.303708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae889fac-d4ee-47d5-98e1-cfcf66efbd56 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:09.304143 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae889fac-d4ee-47d5-98e1-cfcf66efbd56 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:09.305049 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae889fac-d4ee-47d5-98e1-cfcf66efbd56 None admin] RBAC: Adding query filter params (name=network) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:09.305536 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae889fac-d4ee-47d5-98e1-cfcf66efbd56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:09.307108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae889fac-d4ee-47d5-98e1-cfcf66efbd56 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:09.313236 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 404/821] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Jun 22 10:00:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:09.314413 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae889fac-d4ee-47d5-98e1-cfcf66efbd56 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:09.417502 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:09.451681 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae889fac-d4ee-47d5-98e1-cfcf66efbd56 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:09.484238 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:09.492162 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a502a51-2ce2-4ba0-90d3-1a4428f7e91e None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:09.493595 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99bacb-5375-4fb3-b975-55c4b78e6d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:09.494543 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99bacb-5375-4fb3-b975-55c4b78e6d91 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:09.494976 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99bacb-5375-4fb3-b975-55c4b78e6d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:09.498314 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99bacb-5375-4fb3-b975-55c4b78e6d91 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:09.498314 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99bacb-5375-4fb3-b975-55c4b78e6d91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:09.498314 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99bacb-5375-4fb3-b975-55c4b78e6d91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:09.498314 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99bacb-5375-4fb3-b975-55c4b78e6d91 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:09.511921 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 405/822] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:09.513301 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99bacb-5375-4fb3-b975-55c4b78e6d91 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:09.529340 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b239c38-0988-4fe9-bfbb-89c72b495963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:09.530136 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b239c38-0988-4fe9-bfbb-89c72b495963 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:09.530413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b239c38-0988-4fe9-bfbb-89c72b495963 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:09.530684 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b239c38-0988-4fe9-bfbb-89c72b495963 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:09.541967 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b239c38-0988-4fe9-bfbb-89c72b495963 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:09.543629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b239c38-0988-4fe9-bfbb-89c72b495963 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:09.561431 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-9b239c38-0988-4fe9-bfbb-89c72b495963 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:09.561431 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:09.561431 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:09.561431 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:09.561431 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:09.561431 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:09.561431 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:09.561431 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:09.561431 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:09.561431 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:09.561431 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:09.561431 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:09.561431 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:00:09.561431 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:00:09.561431 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:00:09.562382 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:00:09.562382 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:09.562382 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:09.562382 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:09.562382 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:09.562382 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:09.562382 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:09.562382 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:09.562382 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:09.562382 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:09.562382 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:09.562382 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:09.562382 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:09.562382 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:09.562382 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:09.562382 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:09.562382 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:09.563874 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:00:09.563874 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:00:09.563874 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:09.563874 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:09.563874 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 418/823] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:09.563874 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b239c38-0988-4fe9-bfbb-89c72b495963 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:09.631480 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99bacb-5375-4fb3-b975-55c4b78e6d91 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:09.665211 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:09.681874 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b239c38-0988-4fe9-bfbb-89c72b495963 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:09.685931 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1da135-9fea-4008-a222-651f6086f68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:09.686617 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1da135-9fea-4008-a222-651f6086f68b None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:09.686898 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1da135-9fea-4008-a222-651f6086f68b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:09.687176 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1da135-9fea-4008-a222-651f6086f68b None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:09.696159 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1da135-9fea-4008-a222-651f6086f68b None admin] RBAC: Adding query filter params (type=network) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:09.696159 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1da135-9fea-4008-a222-651f6086f68b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:09.696159 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1da135-9fea-4008-a222-651f6086f68b None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:09.697128 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 406/824] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Jun 22 10:00:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:09.697946 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1da135-9fea-4008-a222-651f6086f68b None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:09.730799 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16f5b7-810f-425c-99d1-293d58a4275e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:09.732198 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16f5b7-810f-425c-99d1-293d58a4275e None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:09.732887 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16f5b7-810f-425c-99d1-293d58a4275e None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:09.733766 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16f5b7-810f-425c-99d1-293d58a4275e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:09.743861 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16f5b7-810f-425c-99d1-293d58a4275e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:09.745557 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16f5b7-810f-425c-99d1-293d58a4275e None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:09.757567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:09.767589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-fb16f5b7-810f-425c-99d1-293d58a4275e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:00:09.767589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:09.767589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:09.767589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:09.767589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:09.767589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:09.767589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:09.767589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:09.767589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:09.767589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:09.767589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:09.767589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:09.767589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:00:09.767589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:00:09.767589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:00:09.777012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:00:09.777012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:09.777012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:09.777012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:09.777012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:09.777012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:09.777012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:09.777012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:09.777012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:09.777012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:09.777012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:09.777012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:09.777012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:09.777012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:09.777012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:09.777012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:09.777012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:09.777920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:00:09.777920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:00:09.777920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:00:09.777920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:00:09.777920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:00:09.777920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:00:09.777920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:00:09.777920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:09.777920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 419/825] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 10:00:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:09.777920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16f5b7-810f-425c-99d1-293d58a4275e None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:09.813134 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1da135-9fea-4008-a222-651f6086f68b None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:09.854773 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d06cc0-c63e-4d69-8999-9a6b22145db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:09.855463 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d06cc0-c63e-4d69-8999-9a6b22145db0 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:09.855820 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d06cc0-c63e-4d69-8999-9a6b22145db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:09.856169 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d06cc0-c63e-4d69-8999-9a6b22145db0 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:09.857017 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d06cc0-c63e-4d69-8999-9a6b22145db0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:09.857419 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d06cc0-c63e-4d69-8999-9a6b22145db0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:09.859064 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d06cc0-c63e-4d69-8999-9a6b22145db0 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:09.874323 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 407/826] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:09.875540 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d06cc0-c63e-4d69-8999-9a6b22145db0 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:09.903842 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16f5b7-810f-425c-99d1-293d58a4275e None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:09.939052 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d3d0f-4ee2-4298-abf8-298c3fa3a582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:09.939833 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d3d0f-4ee2-4298-abf8-298c3fa3a582 None admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:09.940192 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d3d0f-4ee2-4298-abf8-298c3fa3a582 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:09.940564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d3d0f-4ee2-4298-abf8-298c3fa3a582 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:09.941450 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d3d0f-4ee2-4298-abf8-298c3fa3a582 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:09.942897 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d3d0f-4ee2-4298-abf8-298c3fa3a582 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:09.992043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d06cc0-c63e-4d69-8999-9a6b22145db0 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:10.004425 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:10.031196 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afa037-ed42-4888-9e8c-c2b276be0372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:10.032238 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afa037-ed42-4888-9e8c-c2b276be0372 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:10.032525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afa037-ed42-4888-9e8c-c2b276be0372 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:10.032806 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afa037-ed42-4888-9e8c-c2b276be0372 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:10.038208 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afa037-ed42-4888-9e8c-c2b276be0372 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:10.038208 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afa037-ed42-4888-9e8c-c2b276be0372 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:10.038208 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afa037-ed42-4888-9e8c-c2b276be0372 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:10.038933 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 420/827] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Jun 22 10:00:09 2022] POST /identity/v3/endpoints => generated 327 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:00:10.040670 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d3d0f-4ee2-4298-abf8-298c3fa3a582 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:10.050166 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:10.050649 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 408/828] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 10:00:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:10.057412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afa037-ed42-4888-9e8c-c2b276be0372 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:10.259849 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afa037-ed42-4888-9e8c-c2b276be0372 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:10.271937 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d3d0f-4ee2-4298-abf8-298c3fa3a582 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:10.296086 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680db103-b096-4152-a702-c74e502fd27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:10.297177 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680db103-b096-4152-a702-c74e502fd27a None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:10.297598 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680db103-b096-4152-a702-c74e502fd27a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:10.297880 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680db103-b096-4152-a702-c74e502fd27a None admin] PATH_INFO: `/v3/projects/a2bb614e4d7747c1a3fff154c8bc18d9/users/7b4d3b1fe8064cc592d89e7bab91bace/roles/604a13bdd0fd46e182a9749de3b5232d` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:10.313716 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6223f99-aca0-4c07-8ff2-85a1d72202af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:10.314887 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6223f99-aca0-4c07-8ff2-85a1d72202af None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:10.315377 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6223f99-aca0-4c07-8ff2-85a1d72202af None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:10.315627 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680db103-b096-4152-a702-c74e502fd27a None admin] RBAC: Authorizing `identity:create_grant(project_id=a2bb614e4d7747c1a3fff154c8bc18d9, user_id=7b4d3b1fe8064cc592d89e7bab91bace, role_id=604a13bdd0fd46e182a9749de3b5232d)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:10.316641 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6223f99-aca0-4c07-8ff2-85a1d72202af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:10.317681 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680db103-b096-4152-a702-c74e502fd27a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:10.324708 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6223f99-aca0-4c07-8ff2-85a1d72202af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:10.326318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6223f99-aca0-4c07-8ff2-85a1d72202af None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:10.342606 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-e6223f99-aca0-4c07-8ff2-85a1d72202af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:00:10.342606 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:10.342606 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:10.342606 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:10.342606 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:10.342606 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:10.342606 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:10.342606 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:10.342606 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:10.342606 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:10.342606 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:10.342606 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:10.342606 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:00:10.342606 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:00:10.342606 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:00:10.343629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:00:10.343629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:10.343629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:10.343629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:10.343629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:10.343629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:10.343629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:10.343629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:10.343629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:10.343629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:10.343629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:10.343629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:10.343629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:10.343629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:10.343629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:10.343629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:10.343629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:10.344496 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:00:10.344496 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:00:10.344496 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:00:10.344496 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:00:10.344496 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:00:10.344496 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:00:10.344496 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:00:10.344496 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:10.349801 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 421/829] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 10:00:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:10.352904 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6223f99-aca0-4c07-8ff2-85a1d72202af None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:10.396303 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 409/830] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 22 10:00:10 2022] PUT /identity/v3/projects/a2bb614e4d7747c1a3fff154c8bc18d9/users/7b4d3b1fe8064cc592d89e7bab91bace/roles/604a13bdd0fd46e182a9749de3b5232d => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:00:10.428918 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:10.464519 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9eeabe-2471-45e1-936f-149700622a8e None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:10.464880 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9eeabe-2471-45e1-936f-149700622a8e None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:10.465234 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9eeabe-2471-45e1-936f-149700622a8e None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:10.470931 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 410/831] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:00:10.472892 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef427fb-bffe-410c-a036-ee4184653cb4 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:10.473190 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef427fb-bffe-410c-a036-ee4184653cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:10.473476 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef427fb-bffe-410c-a036-ee4184653cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:10.481497 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6223f99-aca0-4c07-8ff2-85a1d72202af None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:10.498535 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-aef427fb-bffe-410c-a036-ee4184653cb4 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:10.500345 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-aef427fb-bffe-410c-a036-ee4184653cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:10.524294 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:10.543389 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efcc9a-c434-417f-8c1a-58a672b6b78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:10.544408 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efcc9a-c434-417f-8c1a-58a672b6b78e None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:10.544597 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efcc9a-c434-417f-8c1a-58a672b6b78e None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:10.544939 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efcc9a-c434-417f-8c1a-58a672b6b78e None admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:10.545760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efcc9a-c434-417f-8c1a-58a672b6b78e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:10.546495 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efcc9a-c434-417f-8c1a-58a672b6b78e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:10.548431 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efcc9a-c434-417f-8c1a-58a672b6b78e None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:10.570607 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 422/832] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 10:00:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:10.571646 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efcc9a-c434-417f-8c1a-58a672b6b78e None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:10.598231 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 411/833] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:00:10.616239 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a2bae-cfdf-4da6-aaf7-30179d9ec506 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:10.616538 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a2bae-cfdf-4da6-aaf7-30179d9ec506 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:10.616896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a2bae-cfdf-4da6-aaf7-30179d9ec506 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:10.618521 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 412/834] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:00:10.619231 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a2bae-cfdf-4da6-aaf7-30179d9ec506 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:10.694692 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efcc9a-c434-417f-8c1a-58a672b6b78e None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:10.714033 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:10.732254 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a2bae-cfdf-4da6-aaf7-30179d9ec506 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:10.733539 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255b5ee-7447-4440-9de0-691be161fe99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:10.735581 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255b5ee-7447-4440-9de0-691be161fe99 None admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:10.736025 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255b5ee-7447-4440-9de0-691be161fe99 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:10.736453 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255b5ee-7447-4440-9de0-691be161fe99 None admin] PATH_INFO: `/v3/projects/a2bb614e4d7747c1a3fff154c8bc18d9/users/9c724063ce51470ca09c5c5ab231fd9b/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:10.739501 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255b5ee-7447-4440-9de0-691be161fe99 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2bb614e4d7747c1a3fff154c8bc18d9, user_id=9c724063ce51470ca09c5c5ab231fd9b, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:10.741614 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255b5ee-7447-4440-9de0-691be161fe99 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:10.768272 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955913b9-6be4-47ab-b5c6-b42455bfe119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:10.769643 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955913b9-6be4-47ab-b5c6-b42455bfe119 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:10.769927 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955913b9-6be4-47ab-b5c6-b42455bfe119 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:10.770203 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955913b9-6be4-47ab-b5c6-b42455bfe119 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:10.770861 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955913b9-6be4-47ab-b5c6-b42455bfe119 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:10.772405 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955913b9-6be4-47ab-b5c6-b42455bfe119 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:10.785392 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-955913b9-6be4-47ab-b5c6-b42455bfe119 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 10:00:10.785392 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:10.785392 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:00:10.785392 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:00:10.785392 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:00:10.785392 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:00:10.785392 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:00:10.785392 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:10.785392 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 10:00:10.785392 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:10.785392 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:00:10.785392 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:10.785392 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:10.785392 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:10.785392 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:10.785392 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:10.786490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:10.786490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:10.786490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:10.786490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:10.786490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:10.786490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:10.786490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:10.786490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:00:10.786490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:00:10.786490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:00:10.786490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:00:10.786490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:10.786490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:10.786490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:10.786490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:10.786490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:10.787302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:10.787302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:10.787302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:10.787302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:10.787302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:10.787302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:10.787302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:10.787302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:10.787302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:10.787302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:10.787302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:10.787302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:00:10.787302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:10.787302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 10:00:10.787302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:10.787302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 413/835] 10.222.0.46 () {56 vars in 1132 bytes} [Wed Jun 22 10:00:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:10.788555 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cac25-eb02-4497-8ef0-c9f52a928e0b None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:10.788555 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cac25-eb02-4497-8ef0-c9f52a928e0b None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:10.788555 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cac25-eb02-4497-8ef0-c9f52a928e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:10.806776 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-544cac25-eb02-4497-8ef0-c9f52a928e0b None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:10.807894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-544cac25-eb02-4497-8ef0-c9f52a928e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:10.819080 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:10.820117 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 423/836] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 22 10:00:10 2022] PUT /identity/v3/projects/a2bb614e4d7747c1a3fff154c8bc18d9/users/9c724063ce51470ca09c5c5ab231fd9b/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:00:10.821190 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255b5ee-7447-4440-9de0-691be161fe99 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:10.900881 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 414/837] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:00:10.928725 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cac25-eb02-4497-8ef0-c9f52a928e0b None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:10.959608 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255b5ee-7447-4440-9de0-691be161fe99 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:11.002394 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a2857-c954-44ad-b307-4415aef02294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:11.003746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a2857-c954-44ad-b307-4415aef02294 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:11.004035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a2857-c954-44ad-b307-4415aef02294 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:11.004311 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a2857-c954-44ad-b307-4415aef02294 None admin] PATH_INFO: `/v3/services` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:11.005606 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a2857-c954-44ad-b307-4415aef02294 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:11.005910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a2857-c954-44ad-b307-4415aef02294 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:11.007566 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a2857-c954-44ad-b307-4415aef02294 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:11.014230 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 424/838] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Jun 22 10:00:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:11.021740 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a2857-c954-44ad-b307-4415aef02294 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:11.044345 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cac25-eb02-4497-8ef0-c9f52a928e0b None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:11.088038 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:11.096052 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce7dca-90e3-462e-ad32-30bc8a9e1e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:11.097006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce7dca-90e3-462e-ad32-30bc8a9e1e9b None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:11.099447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce7dca-90e3-462e-ad32-30bc8a9e1e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:11.099447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce7dca-90e3-462e-ad32-30bc8a9e1e9b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:11.099447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce7dca-90e3-462e-ad32-30bc8a9e1e9b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:11.102307 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce7dca-90e3-462e-ad32-30bc8a9e1e9b None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:11.119032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-9fce7dca-90e3-462e-ad32-30bc8a9e1e9b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 10:00:11.119032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:11.119032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:00:11.119032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:00:11.119032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:00:11.119032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:00:11.119032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:00:11.119032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:11.119032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 10:00:11.119032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:11.119032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:00:11.119032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:11.119032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:11.119032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:11.119032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:11.119032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:11.119032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:11.120086 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:11.120086 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:11.120086 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:11.120086 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:11.120086 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:11.120086 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:11.120086 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:00:11.120086 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:00:11.120086 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:00:11.120086 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:00:11.120086 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:11.120086 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:11.120086 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:11.120086 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:11.120086 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:11.120086 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:11.120937 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:11.120937 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:11.120937 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:11.120937 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:11.120937 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:11.120937 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:11.120937 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:11.120937 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:11.120937 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:11.120937 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:11.120937 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:00:11.120937 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:11.120937 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 10:00:11.120937 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:11.122180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 415/839] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 22 10:00:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:00:11.129937 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce7dca-90e3-462e-ad32-30bc8a9e1e9b None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:11.148069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:11.173418 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a2857-c954-44ad-b307-4415aef02294 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:11.223913 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebab758-2bbc-48e7-b192-ceffa2b6d728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:11.225165 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebab758-2bbc-48e7-b192-ceffa2b6d728 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:11.225747 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebab758-2bbc-48e7-b192-ceffa2b6d728 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:11.226265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebab758-2bbc-48e7-b192-ceffa2b6d728 None admin] PATH_INFO: `/v3/services` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:11.227722 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebab758-2bbc-48e7-b192-ceffa2b6d728 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:11.228049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebab758-2bbc-48e7-b192-ceffa2b6d728 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:11.233449 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebab758-2bbc-48e7-b192-ceffa2b6d728 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:11.240867 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 425/840] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Jun 22 10:00:11 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:11.271856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce7dca-90e3-462e-ad32-30bc8a9e1e9b None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:11.312212 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5a68e-a740-4464-9283-5d36d3ddf75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:11.312934 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5a68e-a740-4464-9283-5d36d3ddf75f None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:11.313363 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5a68e-a740-4464-9283-5d36d3ddf75f None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:11.313883 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5a68e-a740-4464-9283-5d36d3ddf75f None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:11.314544 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5a68e-a740-4464-9283-5d36d3ddf75f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:11.314852 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5a68e-a740-4464-9283-5d36d3ddf75f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:11.316351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b5a68e-a740-4464-9283-5d36d3ddf75f None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:11.322090 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 416/841] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 22 10:00:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:11.328156 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebab758-2bbc-48e7-b192-ceffa2b6d728 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:11.445723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebab758-2bbc-48e7-b192-ceffa2b6d728 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:11.453646 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:11.482351 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a884707-b189-4439-a67a-ea2cd8477a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:11.483029 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a884707-b189-4439-a67a-ea2cd8477a2d None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:11.483318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a884707-b189-4439-a67a-ea2cd8477a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:11.483601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a884707-b189-4439-a67a-ea2cd8477a2d None admin] PATH_INFO: `/v3/services` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:11.484318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a884707-b189-4439-a67a-ea2cd8477a2d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:11.484713 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a884707-b189-4439-a67a-ea2cd8477a2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:11.486226 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a884707-b189-4439-a67a-ea2cd8477a2d None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:11.492208 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 426/842] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 22 10:00:11 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:12.763464 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3820014-78f8-429e-a90d-adfda7ce5db5 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:12.764227 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3820014-78f8-429e-a90d-adfda7ce5db5 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:12.764562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3820014-78f8-429e-a90d-adfda7ce5db5 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:12.767182 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 417/843] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:00:12.776278 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10349a7-1d54-4cda-9d32-3e2c8e551c7c None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:12.777115 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10349a7-1d54-4cda-9d32-3e2c8e551c7c None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:12.777254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10349a7-1d54-4cda-9d32-3e2c8e551c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:12.804005 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-b10349a7-1d54-4cda-9d32-3e2c8e551c7c None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:12.805999 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-b10349a7-1d54-4cda-9d32-3e2c8e551c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:12.930898 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 427/844] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:00:12.971835 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3820014-78f8-429e-a90d-adfda7ce5db5 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:12.981372 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073cf52-ca16-44ff-b95a-d374fed612c3 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:12.981861 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073cf52-ca16-44ff-b95a-d374fed612c3 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:12.982355 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073cf52-ca16-44ff-b95a-d374fed612c3 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:12.985288 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 428/845] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:12.993776 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a32f8-47d9-40ce-a0c3-98455ff6a413 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:12.994047 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a32f8-47d9-40ce-a0c3-98455ff6a413 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:12.994327 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a32f8-47d9-40ce-a0c3-98455ff6a413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:13.012633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-ee9a32f8-47d9-40ce-a0c3-98455ff6a413 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:13.013936 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-ee9a32f8-47d9-40ce-a0c3-98455ff6a413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:13.055083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:13.087501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3820014-78f8-429e-a90d-adfda7ce5db5 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:13.090822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 429/846] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:00:13.114447 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a32f8-47d9-40ce-a0c3-98455ff6a413 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:13.130580 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca8661-a3ad-4f39-8ec9-3b2c819c6fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:13.131750 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca8661-a3ad-4f39-8ec9-3b2c819c6fbe None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:13.132358 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca8661-a3ad-4f39-8ec9-3b2c819c6fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:13.132847 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca8661-a3ad-4f39-8ec9-3b2c819c6fbe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:13.145790 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca8661-a3ad-4f39-8ec9-3b2c819c6fbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:00:13.149710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:13.155483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-7bca8661-a3ad-4f39-8ec9-3b2c819c6fbe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:00:13.155483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:13.155483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:13.155483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:13.155483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:13.155483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:13.155483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:13.155483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:13.155483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:13.155483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:13.155483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:13.155483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:13.155483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:00:13.155483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:00:13.155483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:00:13.155483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:00:13.156612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:00:13.156612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:00:13.156612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:00:13.156612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:00:13.156612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:13.156612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:13.156612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:13.156612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:13.156612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:13.156612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:13.156612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:13.156612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:13.156612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:13.156612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:13.156612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:13.156612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:13.157491 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:13.157491 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:13.157491 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:13.157491 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:13.157491 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:00:13.157491 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:00:13.157491 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:00:13.157491 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:00:13.157491 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:00:13.157491 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:00:13.157491 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:00:13.157491 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:13.160303 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 418/847] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 22 10:00:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:13.166969 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca8661-a3ad-4f39-8ec9-3b2c819c6fbe None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:13.234237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a32f8-47d9-40ce-a0c3-98455ff6a413 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:13.279085 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2b638-48be-4f2e-b727-f57f1382d62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:13.279955 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2b638-48be-4f2e-b727-f57f1382d62f None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:13.280283 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2b638-48be-4f2e-b727-f57f1382d62f None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:13.280662 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2b638-48be-4f2e-b727-f57f1382d62f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:13.292275 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2b638-48be-4f2e-b727-f57f1382d62f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:00:13.300666 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-fae2b638-48be-4f2e-b727-f57f1382d62f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:00:13.300666 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:13.300666 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:13.300666 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:13.300666 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:13.300666 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:13.300666 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:13.300666 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:13.300666 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:13.300666 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:13.300666 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:13.300666 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:13.300666 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:00:13.300666 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:00:13.300666 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:00:13.300666 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:00:13.301630 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:00:13.301630 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:00:13.301630 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:00:13.301630 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:00:13.301630 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:13.301630 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:13.301630 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:13.301630 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:13.301630 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:13.301630 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:13.301630 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:13.301630 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:13.301630 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:13.301630 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:13.301630 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:13.301630 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:13.302472 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:13.302472 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:13.302472 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:13.302472 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:13.302472 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:00:13.302472 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:00:13.302472 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:00:13.302472 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:00:13.302472 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:00:13.302472 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:00:13.302472 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:00:13.302472 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:13.302472 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 430/848] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 10:00:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:13.303635 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca8661-a3ad-4f39-8ec9-3b2c819c6fbe None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:13.312941 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2b638-48be-4f2e-b727-f57f1382d62f None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:13.339553 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:13.344609 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8710b01-9743-4638-bc26-d1bad52968f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:13.355224 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8710b01-9743-4638-bc26-d1bad52968f3 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:13.355224 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8710b01-9743-4638-bc26-d1bad52968f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:13.355224 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8710b01-9743-4638-bc26-d1bad52968f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:13.355224 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8710b01-9743-4638-bc26-d1bad52968f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:13.355224 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8710b01-9743-4638-bc26-d1bad52968f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:13.355224 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8710b01-9743-4638-bc26-d1bad52968f3 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:13.360869 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 419/849] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 22 10:00:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:13.362648 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8710b01-9743-4638-bc26-d1bad52968f3 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:13.428232 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:13.439038 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2b638-48be-4f2e-b727-f57f1382d62f None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:13.472707 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb431ae-0f67-446d-9adf-3dd5ebdcb466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:13.473405 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb431ae-0f67-446d-9adf-3dd5ebdcb466 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:13.473695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb431ae-0f67-446d-9adf-3dd5ebdcb466 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:13.473969 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb431ae-0f67-446d-9adf-3dd5ebdcb466 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:13.474766 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb431ae-0f67-446d-9adf-3dd5ebdcb466 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:13.475029 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb431ae-0f67-446d-9adf-3dd5ebdcb466 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:13.476392 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb431ae-0f67-446d-9adf-3dd5ebdcb466 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:13.483188 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8710b01-9743-4638-bc26-d1bad52968f3 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:13.486446 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 431/850] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 10:00:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:00:13.488306 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ceb24-996d-4b6f-adfd-68f30a2395b9 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:13.488592 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ceb24-996d-4b6f-adfd-68f30a2395b9 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:13.488968 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ceb24-996d-4b6f-adfd-68f30a2395b9 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:13.494006 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 432/851] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:13.494486 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ceb24-996d-4b6f-adfd-68f30a2395b9 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:13.526047 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d537239-9ad5-46e5-84e3-b0ddcfef4f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:13.527234 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d537239-9ad5-46e5-84e3-b0ddcfef4f3e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:13.527446 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d537239-9ad5-46e5-84e3-b0ddcfef4f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:13.527706 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d537239-9ad5-46e5-84e3-b0ddcfef4f3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:13.538281 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d537239-9ad5-46e5-84e3-b0ddcfef4f3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:13.539467 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d537239-9ad5-46e5-84e3-b0ddcfef4f3e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:13.559085 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-0d537239-9ad5-46e5-84e3-b0ddcfef4f3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:13.559085 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:13.559085 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:13.559085 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:13.559085 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:13.559085 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:13.559085 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:13.559085 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:13.559085 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:13.559085 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:13.559085 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:13.559085 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:13.559085 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:00:13.559085 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:00:13.559085 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:00:13.560080 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:00:13.560080 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:13.560080 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:13.560080 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:13.560080 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:13.560080 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:13.560080 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:13.560080 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:13.560080 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:13.560080 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:13.560080 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:13.560080 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:13.560080 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:13.560080 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:13.560080 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:13.560080 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:13.560080 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:13.561583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:00:13.561583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:00:13.561583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:13.561583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:13.561583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 420/852] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:00:13.561583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58218197-ebda-4537-b908-935e6100a14e None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:13.561947 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58218197-ebda-4537-b908-935e6100a14e None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:13.562025 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58218197-ebda-4537-b908-935e6100a14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:13.580415 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-58218197-ebda-4537-b908-935e6100a14e None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:13.581752 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-58218197-ebda-4537-b908-935e6100a14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:13.607277 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ceb24-996d-4b6f-adfd-68f30a2395b9 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:13.625387 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:13.645730 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1932a-9049-46a1-a349-be97ee4ab81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:13.647030 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1932a-9049-46a1-a349-be97ee4ab81a None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:13.647323 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1932a-9049-46a1-a349-be97ee4ab81a None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:13.647592 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1932a-9049-46a1-a349-be97ee4ab81a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:13.657501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 421/853] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:00:13.657501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58218197-ebda-4537-b908-935e6100a14e None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:13.662347 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d1932a-9049-46a1-a349-be97ee4ab81a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:13.663804 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d1932a-9049-46a1-a349-be97ee4ab81a None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:13.685588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-e1d1932a-9049-46a1-a349-be97ee4ab81a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:13.685588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:13.685588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:13.685588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:13.685588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:13.685588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:13.685588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:13.685588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:13.685588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:13.685588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:13.685588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:13.685588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:13.685588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:00:13.685588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:00:13.685588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:00:13.686627 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:00:13.686627 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:13.686627 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:13.686627 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:13.686627 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:13.686627 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:13.686627 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:13.686627 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:13.686627 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:13.686627 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:13.686627 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:13.686627 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:13.686627 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:13.686627 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:13.686627 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:13.686627 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:13.686627 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:13.687527 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:00:13.687527 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:00:13.687527 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:13.687527 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:13.692009 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 433/854] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:13.692861 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1932a-9049-46a1-a349-be97ee4ab81a None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:13.697386 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:13.771451 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58218197-ebda-4537-b908-935e6100a14e None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:13.801971 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1932a-9049-46a1-a349-be97ee4ab81a None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:13.805730 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1cff9-27c5-4fa5-aa52-c8d1ffddc260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:13.806400 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1cff9-27c5-4fa5-aa52-c8d1ffddc260 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:13.806686 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1cff9-27c5-4fa5-aa52-c8d1ffddc260 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:13.806964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1cff9-27c5-4fa5-aa52-c8d1ffddc260 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:13.807693 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1cff9-27c5-4fa5-aa52-c8d1ffddc260 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:13.808000 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1cff9-27c5-4fa5-aa52-c8d1ffddc260 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:13.809423 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1cff9-27c5-4fa5-aa52-c8d1ffddc260 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:13.827128 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 422/855] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:13.827128 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1cff9-27c5-4fa5-aa52-c8d1ffddc260 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:13.846163 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff8a3e-1730-4155-a0d8-457c9ac7fcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:13.846864 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff8a3e-1730-4155-a0d8-457c9ac7fcbc None admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:13.847145 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff8a3e-1730-4155-a0d8-457c9ac7fcbc None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:13.847420 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff8a3e-1730-4155-a0d8-457c9ac7fcbc None admin] PATH_INFO: `/v3/services` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:13.848151 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff8a3e-1730-4155-a0d8-457c9ac7fcbc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:13.849541 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff8a3e-1730-4155-a0d8-457c9ac7fcbc None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:13.863631 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:13.924042 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1cff9-27c5-4fa5-aa52-c8d1ffddc260 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:13.957969 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160cc34-8261-47e3-88a1-2ae75b1e7545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:13.958624 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160cc34-8261-47e3-88a1-2ae75b1e7545 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:13.958902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160cc34-8261-47e3-88a1-2ae75b1e7545 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:13.959172 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160cc34-8261-47e3-88a1-2ae75b1e7545 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:13.959885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160cc34-8261-47e3-88a1-2ae75b1e7545 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:13.960187 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160cc34-8261-47e3-88a1-2ae75b1e7545 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:13.961581 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160cc34-8261-47e3-88a1-2ae75b1e7545 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:13.963389 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 434/856] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Jun 22 10:00:13 2022] POST /identity/v3/services => generated 269 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:00:13.964068 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff8a3e-1730-4155-a0d8-457c9ac7fcbc None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:13.974387 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 423/857] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:13.976173 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0425f1-7c1d-469d-ab5d-849391e843c4 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:13.976624 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0425f1-7c1d-469d-ab5d-849391e843c4 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:13.977068 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0425f1-7c1d-469d-ab5d-849391e843c4 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:13.978725 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 424/858] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:13.980143 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0425f1-7c1d-469d-ab5d-849391e843c4 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:14.048723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:14.091980 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:14.098927 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff8a3e-1730-4155-a0d8-457c9ac7fcbc None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:14.099924 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0425f1-7c1d-469d-ab5d-849391e843c4 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:14.138842 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2692a60-3a2e-4bf2-a5d6-a16b610ac692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:14.139674 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2692a60-3a2e-4bf2-a5d6-a16b610ac692 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:14.139962 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2692a60-3a2e-4bf2-a5d6-a16b610ac692 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:14.140240 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2692a60-3a2e-4bf2-a5d6-a16b610ac692 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:14.145320 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f5d7d-5515-4e0a-81da-beeea131c840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:14.146871 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f5d7d-5515-4e0a-81da-beeea131c840 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:14.147228 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f5d7d-5515-4e0a-81da-beeea131c840 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:14.148166 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f5d7d-5515-4e0a-81da-beeea131c840 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:14.150008 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2692a60-3a2e-4bf2-a5d6-a16b610ac692 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:14.151433 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2692a60-3a2e-4bf2-a5d6-a16b610ac692 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:14.159332 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f5d7d-5515-4e0a-81da-beeea131c840 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:14.160802 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f5d7d-5515-4e0a-81da-beeea131c840 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:14.168855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-b2692a60-3a2e-4bf2-a5d6-a16b610ac692 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:00:14.168855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:14.168855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:14.168855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:14.168855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:14.168855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:14.168855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:14.168855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:14.168855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:14.168855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:14.168855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:14.168855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:14.168855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:00:14.168855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:00:14.168855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:00:14.168855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:00:14.169850 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:14.169850 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:14.169850 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:00:14.169850 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:00:14.169850 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:00:14.169850 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:00:14.169850 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:14.169850 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:14.169850 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:14.169850 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:14.169850 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:14.169850 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:14.169850 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:14.169850 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:14.169850 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:14.169850 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:14.169850 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:14.169850 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:14.172266 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:14.172266 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:14.172266 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:00:14.172266 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:00:14.172266 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:00:14.172266 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:00:14.172266 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:00:14.172266 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:00:14.172266 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:00:14.172266 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:14.172266 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 435/859] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Jun 22 10:00:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:14.172266 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311ab4c-6422-4264-9a2b-41cc93298da1 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:14.172266 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311ab4c-6422-4264-9a2b-41cc93298da1 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:14.173117 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311ab4c-6422-4264-9a2b-41cc93298da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:14.177865 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-789f5d7d-5515-4e0a-81da-beeea131c840 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 10:00:14.177865 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:14.177865 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:14.177865 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:14.177865 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:14.177865 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:14.177865 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:14.177865 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:14.177865 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:14.177865 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:14.177865 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:14.177865 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:14.177865 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:00:14.177865 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:00:14.177865 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:00:14.177865 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:00:14.178809 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:14.178809 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:14.178809 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:00:14.178809 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:00:14.178809 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:00:14.178809 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:00:14.178809 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:14.178809 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:14.178809 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:14.178809 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:14.178809 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:14.178809 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:14.178809 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:14.178809 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:14.178809 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:14.178809 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:14.178809 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:14.178809 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:14.180795 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:14.180795 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:14.180795 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:00:14.180795 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:00:14.180795 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:00:14.180795 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:00:14.180795 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:00:14.180795 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:00:14.180795 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 10:00:14.180795 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:14.180795 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 425/860] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 10:00:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:14.180795 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f5d7d-5515-4e0a-81da-beeea131c840 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:14.194832 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-c311ab4c-6422-4264-9a2b-41cc93298da1 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:14.196033 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-c311ab4c-6422-4264-9a2b-41cc93298da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:14.266646 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 436/861] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:14 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:00:14.267502 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311ab4c-6422-4264-9a2b-41cc93298da1 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:14.298391 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f5d7d-5515-4e0a-81da-beeea131c840 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:14.334015 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb119f65-3671-4bfb-9cd0-4db61c2fe3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:14.334605 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb119f65-3671-4bfb-9cd0-4db61c2fe3bc None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:14.334884 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb119f65-3671-4bfb-9cd0-4db61c2fe3bc None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:14.335050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:14.335186 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb119f65-3671-4bfb-9cd0-4db61c2fe3bc None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:14.335979 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb119f65-3671-4bfb-9cd0-4db61c2fe3bc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:14.336285 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb119f65-3671-4bfb-9cd0-4db61c2fe3bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:14.337744 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb119f65-3671-4bfb-9cd0-4db61c2fe3bc None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:14.355673 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 426/862] 10.222.0.46 () {56 vars in 1149 bytes} [Wed Jun 22 10:00:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:14.360019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb119f65-3671-4bfb-9cd0-4db61c2fe3bc None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:14.374604 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:14.396420 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311ab4c-6422-4264-9a2b-41cc93298da1 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:14.432987 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07973be-3af9-46a5-b7c0-191934e5bebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:14.433669 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07973be-3af9-46a5-b7c0-191934e5bebb None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:14.433953 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07973be-3af9-46a5-b7c0-191934e5bebb None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:14.434232 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07973be-3af9-46a5-b7c0-191934e5bebb None admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:14.435074 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07973be-3af9-46a5-b7c0-191934e5bebb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:14.435430 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07973be-3af9-46a5-b7c0-191934e5bebb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:14.436807 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07973be-3af9-46a5-b7c0-191934e5bebb None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:14.456929 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 437/863] 10.222.0.46 () {56 vars in 1135 bytes} [Wed Jun 22 10:00:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:14.456929 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07973be-3af9-46a5-b7c0-191934e5bebb None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:14.465126 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb119f65-3671-4bfb-9cd0-4db61c2fe3bc None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:14.501082 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e211132-fdcd-4424-878b-fa1b1f35969c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:14.501752 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e211132-fdcd-4424-878b-fa1b1f35969c None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:14.502039 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e211132-fdcd-4424-878b-fa1b1f35969c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:14.502320 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e211132-fdcd-4424-878b-fa1b1f35969c None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:14.503582 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e211132-fdcd-4424-878b-fa1b1f35969c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:14.504986 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e211132-fdcd-4424-878b-fa1b1f35969c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:14.563962 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07973be-3af9-46a5-b7c0-191934e5bebb None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:14.573748 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:14.586984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 427/864] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Jun 22 10:00:14 2022] POST /identity/v3/services => generated 251 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:00:14.587882 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e211132-fdcd-4424-878b-fa1b1f35969c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:14.611987 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4b0fb-0816-401e-bc6f-4b2557fb2dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:14.613863 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4b0fb-0816-401e-bc6f-4b2557fb2dec None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:14.614151 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4b0fb-0816-401e-bc6f-4b2557fb2dec None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:14.614732 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4b0fb-0816-401e-bc6f-4b2557fb2dec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:14.689796 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:14.711147 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4b0fb-0816-401e-bc6f-4b2557fb2dec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:14.713619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4b0fb-0816-401e-bc6f-4b2557fb2dec None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:14.719859 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e211132-fdcd-4424-878b-fa1b1f35969c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:14.761596 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04b829-f993-41cc-9a0e-4ee06a09e8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:14.763016 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04b829-f993-41cc-9a0e-4ee06a09e8f5 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:14.763458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04b829-f993-41cc-9a0e-4ee06a09e8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:14.763911 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04b829-f993-41cc-9a0e-4ee06a09e8f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:14.844194 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04b829-f993-41cc-9a0e-4ee06a09e8f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:14.845405 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 438/865] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 10:00:14 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:00:14.847393 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04b829-f993-41cc-9a0e-4ee06a09e8f5 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:14.851953 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4b0fb-0816-401e-bc6f-4b2557fb2dec None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:14.855074 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:14.949685 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:14.968170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4b0fb-0816-401e-bc6f-4b2557fb2dec None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:14.986131 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 428/866] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 10:00:14 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:00:14.994263 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04b829-f993-41cc-9a0e-4ee06a09e8f5 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:15.012337 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576faa51-09b3-4bce-b92f-c27fe637e54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:15.013543 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576faa51-09b3-4bce-b92f-c27fe637e54b None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:15.013543 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576faa51-09b3-4bce-b92f-c27fe637e54b None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:15.013825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576faa51-09b3-4bce-b92f-c27fe637e54b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:15.025972 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576faa51-09b3-4bce-b92f-c27fe637e54b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:15.027427 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576faa51-09b3-4bce-b92f-c27fe637e54b None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:15.046807 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-576faa51-09b3-4bce-b92f-c27fe637e54b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:15.046807 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:15.046807 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:15.046807 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:15.046807 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:15.046807 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:15.046807 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:15.046807 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:15.046807 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:15.046807 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:15.046807 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:15.046807 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:15.046807 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:00:15.046807 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:00:15.046807 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:00:15.047755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:00:15.047755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:15.047755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:15.047755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:15.047755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:15.047755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:15.047755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:15.047755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:15.047755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:15.047755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:15.047755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:15.047755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:15.047755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:15.047755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:15.047755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:15.047755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:15.047755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:15.048658 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:00:15.048658 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:00:15.048658 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:15.048658 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:15.048658 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 439/867] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:00:15.053730 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576faa51-09b3-4bce-b92f-c27fe637e54b None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:15.125332 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:15.134703 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04b829-f993-41cc-9a0e-4ee06a09e8f5 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:15.175640 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576faa51-09b3-4bce-b92f-c27fe637e54b None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:15.190831 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a601b-74ce-42f1-a16c-4cb37eebd17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:15.192774 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a601b-74ce-42f1-a16c-4cb37eebd17c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:15.193327 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a601b-74ce-42f1-a16c-4cb37eebd17c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:15.194085 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a601b-74ce-42f1-a16c-4cb37eebd17c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:15.209652 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a601b-74ce-42f1-a16c-4cb37eebd17c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:15.212068 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a601b-74ce-42f1-a16c-4cb37eebd17c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:15.215274 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e2810-b954-4798-a371-beb833c34fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:15.215949 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e2810-b954-4798-a371-beb833c34fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:15.216292 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e2810-b954-4798-a371-beb833c34fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:15.216575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e2810-b954-4798-a371-beb833c34fe5 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:15.217394 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e2810-b954-4798-a371-beb833c34fe5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:15.217707 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e2810-b954-4798-a371-beb833c34fe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:15.219072 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e2810-b954-4798-a371-beb833c34fe5 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:15.231617 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 440/868] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:15.235458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-2a2a601b-74ce-42f1-a16c-4cb37eebd17c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:15.235458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:15.235458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:15.235458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:15.235458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:15.235458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:15.235458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:15.235458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:15.235458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:15.235458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:15.235458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:15.235458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:15.235458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:00:15.235458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:00:15.235458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:00:15.236338 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:00:15.236338 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:15.236338 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:15.236338 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:15.236338 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:15.236338 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:15.236338 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:15.236338 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:15.236338 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:15.236338 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:15.236338 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:15.236338 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:15.236338 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:15.236338 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:15.236338 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:15.236338 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:15.236338 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:15.237269 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:00:15.237269 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:00:15.237269 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:15.237269 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:15.237496 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e2810-b954-4798-a371-beb833c34fe5 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:15.239688 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 429/869] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:15.244444 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a601b-74ce-42f1-a16c-4cb37eebd17c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:15.280028 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:15.347918 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e2810-b954-4798-a371-beb833c34fe5 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:15.365226 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:15.377868 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a601b-74ce-42f1-a16c-4cb37eebd17c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:15.386658 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d6343-8046-495e-a32d-b5e0b7860bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:15.387847 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d6343-8046-495e-a32d-b5e0b7860bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:15.388135 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d6343-8046-495e-a32d-b5e0b7860bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:15.388417 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d6343-8046-495e-a32d-b5e0b7860bf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:15.396046 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d6343-8046-495e-a32d-b5e0b7860bf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:15.397537 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d6343-8046-495e-a32d-b5e0b7860bf8 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:15.413986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-eb8d6343-8046-495e-a32d-b5e0b7860bf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:00:15.413986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:15.413986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:15.413986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:15.413986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:15.413986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:15.413986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:15.413986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:15.413986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:15.413986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:15.413986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:15.413986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:15.413986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:00:15.413986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:00:15.413986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:00:15.414981 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:00:15.414981 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:15.414981 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:15.414981 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:15.414981 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:15.414981 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:15.414981 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:15.414981 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:15.414981 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:15.414981 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:15.414981 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:15.414981 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:15.414981 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:15.414981 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:15.414981 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:15.414981 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:15.414981 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:15.415871 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:00:15.415871 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:00:15.415871 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:00:15.415871 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:00:15.415871 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:00:15.415871 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:00:15.415871 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:00:15.415871 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:15.415871 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 441/870] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 10:00:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:15.425295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d6343-8046-495e-a32d-b5e0b7860bf8 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:15.425475 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123894dd-8f44-4793-9445-846111bda7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:15.425475 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123894dd-8f44-4793-9445-846111bda7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:15.425799 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123894dd-8f44-4793-9445-846111bda7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:15.426035 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123894dd-8f44-4793-9445-846111bda7d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:15.428841 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123894dd-8f44-4793-9445-846111bda7d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:15.428841 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123894dd-8f44-4793-9445-846111bda7d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:15.428841 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123894dd-8f44-4793-9445-846111bda7d8 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:15.445840 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 430/871] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:00:15.446729 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123894dd-8f44-4793-9445-846111bda7d8 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:15.545009 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d6343-8046-495e-a32d-b5e0b7860bf8 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:15.554328 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:15.577895 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123894dd-8f44-4793-9445-846111bda7d8 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:15.582319 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a8d1d-a707-4441-bdf4-162cd0a6ca99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:15.582983 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a8d1d-a707-4441-bdf4-162cd0a6ca99 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:15.583265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a8d1d-a707-4441-bdf4-162cd0a6ca99 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:15.583544 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a8d1d-a707-4441-bdf4-162cd0a6ca99 None admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:15.584340 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a8d1d-a707-4441-bdf4-162cd0a6ca99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:15.584651 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a8d1d-a707-4441-bdf4-162cd0a6ca99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:15.586284 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a8d1d-a707-4441-bdf4-162cd0a6ca99 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:15.603834 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 442/872] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 10:00:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:00:15.604753 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a8d1d-a707-4441-bdf4-162cd0a6ca99 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:15.621706 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f5501-02de-4df5-9337-79b51d737bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:15.622583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f5501-02de-4df5-9337-79b51d737bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:15.622876 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f5501-02de-4df5-9337-79b51d737bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:15.623133 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f5501-02de-4df5-9337-79b51d737bc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:15.631112 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f5501-02de-4df5-9337-79b51d737bc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:15.632495 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f5501-02de-4df5-9337-79b51d737bc1 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:15.647205 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-758f5501-02de-4df5-9337-79b51d737bc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:00:15.647205 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:15.647205 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:15.647205 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:15.647205 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:15.647205 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:15.647205 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:15.647205 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:15.647205 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:15.647205 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:15.647205 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:15.647205 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:15.647205 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:00:15.647205 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:00:15.647205 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:00:15.648273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:00:15.648273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:15.648273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:15.648273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:15.648273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:15.648273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:15.648273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:15.648273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:15.648273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:15.648273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:15.648273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:15.648273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:15.648273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:15.648273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:15.648273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:15.648273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:15.648273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:15.649383 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:00:15.649383 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:00:15.649383 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:00:15.649383 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:00:15.649383 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:00:15.649383 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:00:15.649383 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:00:15.649383 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:15.653145 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 431/873] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 10:00:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:15.653384 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:15.654998 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f5501-02de-4df5-9337-79b51d737bc1 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:15.736511 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a8d1d-a707-4441-bdf4-162cd0a6ca99 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:15.773204 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2578f1-6dcc-4367-a1d4-9c23666a60fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:15.773975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2578f1-6dcc-4367-a1d4-9c23666a60fa None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:15.774571 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2578f1-6dcc-4367-a1d4-9c23666a60fa None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:15.774691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2578f1-6dcc-4367-a1d4-9c23666a60fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:15.775622 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2578f1-6dcc-4367-a1d4-9c23666a60fa None admin] RBAC: Adding query filter params (role.id=604a13bdd0fd46e182a9749de3b5232d, scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9, user.id=7b4d3b1fe8064cc592d89e7bab91bace) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:15.776031 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2578f1-6dcc-4367-a1d4-9c23666a60fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:15.777596 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2578f1-6dcc-4367-a1d4-9c23666a60fa None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:15.778096 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f5501-02de-4df5-9337-79b51d737bc1 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:15.793211 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 443/874] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 10:00:15 2022] GET /identity/v3/role_assignments?user.id=7b4d3b1fe8064cc592d89e7bab91bace&scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9&role.id=604a13bdd0fd46e182a9749de3b5232d => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:15.820739 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13adf9b-612b-44f0-b788-b4e4b21ac282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:15.821738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13adf9b-612b-44f0-b788-b4e4b21ac282 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:15.822186 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13adf9b-612b-44f0-b788-b4e4b21ac282 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:15.822626 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13adf9b-612b-44f0-b788-b4e4b21ac282 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:15.823684 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13adf9b-612b-44f0-b788-b4e4b21ac282 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:15.824167 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13adf9b-612b-44f0-b788-b4e4b21ac282 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:15.825842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13adf9b-612b-44f0-b788-b4e4b21ac282 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:15.841001 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 432/875] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 10:00:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:15.848900 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2578f1-6dcc-4367-a1d4-9c23666a60fa None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:15.958504 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:15.961597 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2578f1-6dcc-4367-a1d4-9c23666a60fa None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:15.997126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe45972-7685-4cc9-9049-6800ee545fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:15.997786 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe45972-7685-4cc9-9049-6800ee545fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:15.998072 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe45972-7685-4cc9-9049-6800ee545fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:15.998346 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe45972-7685-4cc9-9049-6800ee545fe0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:15.999176 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe45972-7685-4cc9-9049-6800ee545fe0 None admin] RBAC: Adding query filter params (role.id=106aa464a69a49b09de7de5417083d3c, scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9, user.id=9c724063ce51470ca09c5c5ab231fd9b) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:15.999485 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe45972-7685-4cc9-9049-6800ee545fe0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:16.000921 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe45972-7685-4cc9-9049-6800ee545fe0 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:16.007844 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 444/876] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 10:00:15 2022] GET /identity/v3/role_assignments?user.id=9c724063ce51470ca09c5c5ab231fd9b&scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9&role.id=106aa464a69a49b09de7de5417083d3c => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:16.119417 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81857c22-c715-4dd8-a329-2fcb4a36a793 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:16.119939 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81857c22-c715-4dd8-a329-2fcb4a36a793 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:16.120204 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81857c22-c715-4dd8-a329-2fcb4a36a793 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:16.122006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 433/877] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:16.127617 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e102c-f77b-440a-882d-6139b70b9cb3 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:16.128549 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e102c-f77b-440a-882d-6139b70b9cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:16.128932 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e102c-f77b-440a-882d-6139b70b9cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:16.146867 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-2b4e102c-f77b-440a-882d-6139b70b9cb3 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:16.148061 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-2b4e102c-f77b-440a-882d-6139b70b9cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:16.224242 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 445/878] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:16 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:00:16.248918 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81857c22-c715-4dd8-a329-2fcb4a36a793 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:16.259286 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:16.365687 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81857c22-c715-4dd8-a329-2fcb4a36a793 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:16.403385 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66240c69-0061-4788-8322-7a6e8406d9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:16.404573 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66240c69-0061-4788-8322-7a6e8406d9be None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:16.405560 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66240c69-0061-4788-8322-7a6e8406d9be None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:16.406319 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66240c69-0061-4788-8322-7a6e8406d9be None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:16.407212 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66240c69-0061-4788-8322-7a6e8406d9be None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:16.408797 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66240c69-0061-4788-8322-7a6e8406d9be None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:16.422714 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-66240c69-0061-4788-8322-7a6e8406d9be None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 10:00:16.422714 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:16.422714 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:00:16.422714 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:00:16.422714 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:00:16.422714 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:00:16.422714 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:00:16.422714 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:16.422714 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 10:00:16.422714 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:16.422714 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:00:16.422714 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:16.422714 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:16.422714 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:16.422714 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:16.422714 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:16.423740 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:16.423740 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:16.423740 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:16.423740 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:16.423740 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:16.423740 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:16.423740 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:16.423740 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:00:16.423740 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:00:16.423740 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:00:16.423740 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:00:16.423740 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:16.423740 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:16.423740 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:16.423740 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:16.423740 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:16.424629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:16.424629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:16.424629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:16.424629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:16.424629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:16.424629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:16.424629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:16.424629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:16.424629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:16.424629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:16.424629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:16.424629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:00:16.424629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:16.424629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 10:00:16.424629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:16.427773 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 434/879] 10.222.0.46 () {56 vars in 1132 bytes} [Wed Jun 22 10:00:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:16.433825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e102c-f77b-440a-882d-6139b70b9cb3 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:16.534857 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:16.542571 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e102c-f77b-440a-882d-6139b70b9cb3 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:16.580545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad93d3-ed39-4074-8d7c-b61bbc4aac5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:16.582202 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad93d3-ed39-4074-8d7c-b61bbc4aac5d None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:16.582690 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad93d3-ed39-4074-8d7c-b61bbc4aac5d None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:16.583167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad93d3-ed39-4074-8d7c-b61bbc4aac5d None admin] PATH_INFO: `/v3/services` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:16.584098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad93d3-ed39-4074-8d7c-b61bbc4aac5d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:16.584616 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad93d3-ed39-4074-8d7c-b61bbc4aac5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:16.586224 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad93d3-ed39-4074-8d7c-b61bbc4aac5d None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:16.591908 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 446/880] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Jun 22 10:00:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:16.597809 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66240c69-0061-4788-8322-7a6e8406d9be None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:16.676364 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:16.710649 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66240c69-0061-4788-8322-7a6e8406d9be None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:16.752561 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982c66e-6a22-4431-92a1-b8d51da89668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:16.754252 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982c66e-6a22-4431-92a1-b8d51da89668 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:16.754743 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982c66e-6a22-4431-92a1-b8d51da89668 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:16.755239 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982c66e-6a22-4431-92a1-b8d51da89668 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:16.756679 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982c66e-6a22-4431-92a1-b8d51da89668 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:16.757260 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982c66e-6a22-4431-92a1-b8d51da89668 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:16.758400 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92680375-7b68-490b-965d-47a15f20ed00 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:16.758844 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982c66e-6a22-4431-92a1-b8d51da89668 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:16.759131 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92680375-7b68-490b-965d-47a15f20ed00 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:16.759621 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92680375-7b68-490b-965d-47a15f20ed00 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:16.761463 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 447/881] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:16.764890 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 435/882] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Jun 22 10:00:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:16.770790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92680375-7b68-490b-965d-47a15f20ed00 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:16.772558 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ecc01-9c12-4602-a6a7-2f24ea10af84 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:16.773094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ecc01-9c12-4602-a6a7-2f24ea10af84 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:16.773572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ecc01-9c12-4602-a6a7-2f24ea10af84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:16.790615 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-a67ecc01-9c12-4602-a6a7-2f24ea10af84 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:16.792133 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-a67ecc01-9c12-4602-a6a7-2f24ea10af84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:16.879591 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 436/883] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:16 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:00:16.889888 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92680375-7b68-490b-965d-47a15f20ed00 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:16.899037 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ecc01-9c12-4602-a6a7-2f24ea10af84 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:16.937231 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65bcb23-0f19-4058-b88c-f05e0ee367e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:16.938881 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bcb23-0f19-4058-b88c-f05e0ee367e3 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:16.939633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bcb23-0f19-4058-b88c-f05e0ee367e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:16.940176 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bcb23-0f19-4058-b88c-f05e0ee367e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:16.941715 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65bcb23-0f19-4058-b88c-f05e0ee367e3 None admin] RBAC: Adding query filter params (interface=public, service_id=a18903786ae04773be417e11e4dcc85f, region_id=RegionOne) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:16.942464 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65bcb23-0f19-4058-b88c-f05e0ee367e3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:16.944936 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65bcb23-0f19-4058-b88c-f05e0ee367e3 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:16.961074 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 448/884] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Jun 22 10:00:16 2022] GET /identity/v3/endpoints?service_id=a18903786ae04773be417e11e4dcc85f&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:16.962380 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65bcb23-0f19-4058-b88c-f05e0ee367e3 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:16.983971 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:16.998764 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:17.025185 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ecc01-9c12-4602-a6a7-2f24ea10af84 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:17.063203 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb9d9c-0746-47d7-9ddb-058443b87822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:17.063914 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb9d9c-0746-47d7-9ddb-058443b87822 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:17.064193 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb9d9c-0746-47d7-9ddb-058443b87822 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:17.064468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb9d9c-0746-47d7-9ddb-058443b87822 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:17.065830 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb9d9c-0746-47d7-9ddb-058443b87822 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:17.067199 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb9d9c-0746-47d7-9ddb-058443b87822 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:17.079629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-eceb9d9c-0746-47d7-9ddb-058443b87822 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 10:00:17.079629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:17.079629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:00:17.079629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:00:17.079629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:00:17.079629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:00:17.079629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:00:17.079629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:17.079629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 10:00:17.079629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:17.079629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:00:17.079629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:17.079629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:17.079629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:17.079629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:17.079629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:17.079629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:17.080691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:17.080691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:17.080691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:17.080691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:17.080691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:17.080691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:17.080691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:00:17.080691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:00:17.080691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:00:17.080691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:00:17.080691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:17.080691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:17.080691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:17.080691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:17.080691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:17.080691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:17.081583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:17.081583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:17.081583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:17.081583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:17.081583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:17.081583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:17.081583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:17.081583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:17.081583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:17.081583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:17.081583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:00:17.081583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:17.081583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 10:00:17.081583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:17.086537 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 437/885] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 22 10:00:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:00:17.087292 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb9d9c-0746-47d7-9ddb-058443b87822 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:17.097197 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65bcb23-0f19-4058-b88c-f05e0ee367e3 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:17.140213 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaed798-a9c9-49a6-ab55-8a1f6685e494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:17.140912 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaed798-a9c9-49a6-ab55-8a1f6685e494 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:17.141197 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaed798-a9c9-49a6-ab55-8a1f6685e494 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:17.141543 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaed798-a9c9-49a6-ab55-8a1f6685e494 None admin] PATH_INFO: `/v3/services` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:17.142220 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaed798-a9c9-49a6-ab55-8a1f6685e494 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:17.143791 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaed798-a9c9-49a6-ab55-8a1f6685e494 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:17.157471 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 449/886] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Jun 22 10:00:16 2022] GET /identity/v3/services => generated 1268 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:00:17.214191 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb9d9c-0746-47d7-9ddb-058443b87822 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:17.246867 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:17.255655 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed975eca-039f-4d09-a780-269ecbba3497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:17.273892 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed975eca-039f-4d09-a780-269ecbba3497 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:17.273892 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed975eca-039f-4d09-a780-269ecbba3497 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:17.273892 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed975eca-039f-4d09-a780-269ecbba3497 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:17.273892 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed975eca-039f-4d09-a780-269ecbba3497 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:17.273892 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed975eca-039f-4d09-a780-269ecbba3497 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:17.273892 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed975eca-039f-4d09-a780-269ecbba3497 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:17.274475 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 438/887] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 22 10:00:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:17.274567 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaed798-a9c9-49a6-ab55-8a1f6685e494 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:17.371831 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:17.387666 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaed798-a9c9-49a6-ab55-8a1f6685e494 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:17.431975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb5f0e-1d98-4ad8-ac4c-2d272c4feb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:17.432650 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb5f0e-1d98-4ad8-ac4c-2d272c4feb08 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:17.432966 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb5f0e-1d98-4ad8-ac4c-2d272c4feb08 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:17.433248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb5f0e-1d98-4ad8-ac4c-2d272c4feb08 None admin] PATH_INFO: `/v3/services` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:17.433968 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb5f0e-1d98-4ad8-ac4c-2d272c4feb08 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:17.434279 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb5f0e-1d98-4ad8-ac4c-2d272c4feb08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:17.436100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb5f0e-1d98-4ad8-ac4c-2d272c4feb08 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:17.442424 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 450/888] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 22 10:00:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:17.448177 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed975eca-039f-4d09-a780-269ecbba3497 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:17.554369 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed975eca-039f-4d09-a780-269ecbba3497 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:17.590732 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf934a-3df2-486a-b25f-de1ae65c27b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:17.591396 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf934a-3df2-486a-b25f-de1ae65c27b0 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:17.591691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf934a-3df2-486a-b25f-de1ae65c27b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:17.591965 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf934a-3df2-486a-b25f-de1ae65c27b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:17.592769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf934a-3df2-486a-b25f-de1ae65c27b0 None admin] RBAC: Adding query filter params (interface=public, service_id=922d818e575149c8b1a0dff504c5467b, region_id=RegionOne) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:17.593113 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf934a-3df2-486a-b25f-de1ae65c27b0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:17.594487 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf934a-3df2-486a-b25f-de1ae65c27b0 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:17.600615 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 439/889] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Jun 22 10:00:17 2022] GET /identity/v3/endpoints?service_id=922d818e575149c8b1a0dff504c5467b&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:17.609972 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb5f0e-1d98-4ad8-ac4c-2d272c4feb08 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:17.748164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb5f0e-1d98-4ad8-ac4c-2d272c4feb08 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:17.785766 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78277cf0-1da8-48d4-9631-344dec4195d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:17.786829 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78277cf0-1da8-48d4-9631-344dec4195d2 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:17.787319 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78277cf0-1da8-48d4-9631-344dec4195d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:17.787799 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78277cf0-1da8-48d4-9631-344dec4195d2 None admin] PATH_INFO: `/v3/services` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:17.788701 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78277cf0-1da8-48d4-9631-344dec4195d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:17.790328 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78277cf0-1da8-48d4-9631-344dec4195d2 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:17.801151 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 451/890] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Jun 22 10:00:17 2022] GET /identity/v3/services => generated 1268 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:00:18.019365 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d10516-c59a-4375-bece-93ef5c1e296c None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:18.019554 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d10516-c59a-4375-bece-93ef5c1e296c None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:18.019866 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d10516-c59a-4375-bece-93ef5c1e296c None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:18.021551 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 440/891] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:18.026864 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46da597-17a1-4805-8315-a6f0410b28a3 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:18.027305 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46da597-17a1-4805-8315-a6f0410b28a3 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:18.027399 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46da597-17a1-4805-8315-a6f0410b28a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:18.044254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-f46da597-17a1-4805-8315-a6f0410b28a3 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:18.045491 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-f46da597-17a1-4805-8315-a6f0410b28a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:18.055358 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:18.120690 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 452/892] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:00:18.144101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d10516-c59a-4375-bece-93ef5c1e296c None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:18.164896 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08b3d9-b1c0-45a5-84e3-5faddaf81ade None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:18.165186 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08b3d9-b1c0-45a5-84e3-5faddaf81ade None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:18.165463 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08b3d9-b1c0-45a5-84e3-5faddaf81ade None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:18.167087 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 453/893] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:00:18.172048 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b63e2d-d58a-4206-8fd6-a70e5622889d None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:18.172334 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b63e2d-d58a-4206-8fd6-a70e5622889d None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:18.172615 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b63e2d-d58a-4206-8fd6-a70e5622889d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:18.190011 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-50b63e2d-d58a-4206-8fd6-a70e5622889d None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:18.191203 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-50b63e2d-d58a-4206-8fd6-a70e5622889d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:18.212859 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:18.261413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 454/894] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:00:18.270712 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d10516-c59a-4375-bece-93ef5c1e296c None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:18.285004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b63e2d-d58a-4206-8fd6-a70e5622889d None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:18.316526 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b498df-a669-4fca-9f48-2ccf92b179d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:18.317446 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b498df-a669-4fca-9f48-2ccf92b179d7 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:18.317731 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b498df-a669-4fca-9f48-2ccf92b179d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:18.318005 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b498df-a669-4fca-9f48-2ccf92b179d7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:18.336454 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b498df-a669-4fca-9f48-2ccf92b179d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:00:18.349302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-90b498df-a669-4fca-9f48-2ccf92b179d7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:00:18.349302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:18.349302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:18.349302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:18.349302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:18.349302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:18.349302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:18.349302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:18.349302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:18.349302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:18.349302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:18.349302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:18.349302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:00:18.349302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:00:18.349302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:00:18.349302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:00:18.350285 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:00:18.350285 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:00:18.350285 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:00:18.350285 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:00:18.350285 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:18.350285 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:18.350285 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:18.350285 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:18.350285 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:18.350285 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:18.350285 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:18.350285 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:18.350285 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:18.350285 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:18.350285 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:18.350285 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:18.351138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:18.351138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:18.351138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:18.351138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:18.351138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:00:18.351138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:00:18.351138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:00:18.351138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:00:18.351138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:00:18.351138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:00:18.351138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:00:18.351138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:18.358176 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 441/895] 10.222.0.46 () {56 vars in 1120 bytes} [Wed Jun 22 10:00:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:18.360332 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b498df-a669-4fca-9f48-2ccf92b179d7 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:18.380866 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:18.408553 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b63e2d-d58a-4206-8fd6-a70e5622889d None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:18.459154 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd44f2-d308-4a8a-abc3-0ce058de1766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:18.460313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd44f2-d308-4a8a-abc3-0ce058de1766 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:18.460812 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd44f2-d308-4a8a-abc3-0ce058de1766 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:18.461321 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd44f2-d308-4a8a-abc3-0ce058de1766 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:18.462193 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd44f2-d308-4a8a-abc3-0ce058de1766 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:18.463746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd44f2-d308-4a8a-abc3-0ce058de1766 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:18.476731 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-0bdd44f2-d308-4a8a-abc3-0ce058de1766 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:00:18.476731 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:18.476731 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:00:18.476731 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:00:18.476731 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:00:18.476731 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:00:18.476731 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:00:18.476731 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:18.476731 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:00:18.476731 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:18.476731 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:00:18.476731 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:18.476731 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:18.476731 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:18.476731 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:18.476731 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:18.476731 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:18.477889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:18.477889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:18.477889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:18.477889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:18.477889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:18.477889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:18.477889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:00:18.477889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:00:18.477889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:00:18.477889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:00:18.477889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:18.477889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:18.477889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:18.477889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:18.477889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:18.477889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:18.478712 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:18.478712 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:18.478712 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:18.478712 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:18.478712 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:18.478712 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:18.478712 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:18.478712 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:18.478712 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:18.478712 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:18.478712 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:00:18.478712 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:18.478712 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:00:18.478712 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:18.481503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 455/896] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Jun 22 10:00:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:18.483166 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b498df-a669-4fca-9f48-2ccf92b179d7 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:18.492931 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd44f2-d308-4a8a-abc3-0ce058de1766 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:18.521269 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:18.530303 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834c165-e347-451c-8d25-f6a621ee42e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:18.531449 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834c165-e347-451c-8d25-f6a621ee42e1 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:18.531742 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834c165-e347-451c-8d25-f6a621ee42e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:18.532024 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834c165-e347-451c-8d25-f6a621ee42e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:18.533256 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834c165-e347-451c-8d25-f6a621ee42e1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:18.534418 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834c165-e347-451c-8d25-f6a621ee42e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:18.536168 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834c165-e347-451c-8d25-f6a621ee42e1 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:18.547073 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 442/897] 10.222.0.46 () {56 vars in 1115 bytes} [Wed Jun 22 10:00:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:00:18.553691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834c165-e347-451c-8d25-f6a621ee42e1 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:18.609366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd44f2-d308-4a8a-abc3-0ce058de1766 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:18.656054 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e0e9e-161e-4c99-9d82-83c72e49979a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:18.657475 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e0e9e-161e-4c99-9d82-83c72e49979a None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:18.658191 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e0e9e-161e-4c99-9d82-83c72e49979a None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:18.658683 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e0e9e-161e-4c99-9d82-83c72e49979a None admin] PATH_INFO: `/v3/services` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:18.660251 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e0e9e-161e-4c99-9d82-83c72e49979a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:18.660756 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e0e9e-161e-4c99-9d82-83c72e49979a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:18.662840 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e0e9e-161e-4c99-9d82-83c72e49979a None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:18.666242 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834c165-e347-451c-8d25-f6a621ee42e1 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:18.674944 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 456/898] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Jun 22 10:00:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:18.675448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e0e9e-161e-4c99-9d82-83c72e49979a None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:18.678508 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:18.713026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0db83-3983-4213-9627-5e7a02785c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:18.714203 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0db83-3983-4213-9627-5e7a02785c82 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:18.714683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0db83-3983-4213-9627-5e7a02785c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:18.715171 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0db83-3983-4213-9627-5e7a02785c82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:18.729575 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0db83-3983-4213-9627-5e7a02785c82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:18.731747 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0db83-3983-4213-9627-5e7a02785c82 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:18.754123 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-6ff0db83-3983-4213-9627-5e7a02785c82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:18.754123 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:18.754123 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:18.754123 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:18.754123 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:18.754123 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:18.754123 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:18.754123 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:18.754123 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:18.754123 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:18.754123 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:18.754123 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:18.754123 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:00:18.754123 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:00:18.754123 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:00:18.755059 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:00:18.755059 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:18.755059 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:18.755059 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:18.755059 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:18.755059 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:18.755059 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:18.755059 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:18.755059 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:18.755059 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:18.755059 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:18.755059 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:18.755059 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:18.755059 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:18.755059 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:18.755059 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:18.755059 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:18.756024 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:00:18.756024 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:00:18.756024 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:18.756024 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:18.763206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 443/899] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:00:18.763533 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0db83-3983-4213-9627-5e7a02785c82 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:18.788302 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e0e9e-161e-4c99-9d82-83c72e49979a None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:18.804154 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:18.825689 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd81aa-ac66-442d-bb61-c24faa15059a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:18.826359 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd81aa-ac66-442d-bb61-c24faa15059a None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:18.826644 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd81aa-ac66-442d-bb61-c24faa15059a None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:18.827187 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd81aa-ac66-442d-bb61-c24faa15059a None admin] PATH_INFO: `/v3/services` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:18.827945 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd81aa-ac66-442d-bb61-c24faa15059a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:18.828199 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd81aa-ac66-442d-bb61-c24faa15059a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:18.829899 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd81aa-ac66-442d-bb61-c24faa15059a None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:18.840848 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 457/900] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Jun 22 10:00:18 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:18.894418 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0db83-3983-4213-9627-5e7a02785c82 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:18.934915 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd15015-f9ea-48c8-b157-8a8e5ddcbd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:18.935695 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd15015-f9ea-48c8-b157-8a8e5ddcbd1c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:18.935982 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd15015-f9ea-48c8-b157-8a8e5ddcbd1c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:18.936262 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd15015-f9ea-48c8-b157-8a8e5ddcbd1c None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:18.937039 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd15015-f9ea-48c8-b157-8a8e5ddcbd1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:18.937356 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd15015-f9ea-48c8-b157-8a8e5ddcbd1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:18.938770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd15015-f9ea-48c8-b157-8a8e5ddcbd1c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:18.952993 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 444/901] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:00:18.962537 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd81aa-ac66-442d-bb61-c24faa15059a None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:19.038154 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:19.075084 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd81aa-ac66-442d-bb61-c24faa15059a None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:19.111451 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3426e0-b9eb-4dac-b9d7-cca9d161ec33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:19.112668 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3426e0-b9eb-4dac-b9d7-cca9d161ec33 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:19.113193 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3426e0-b9eb-4dac-b9d7-cca9d161ec33 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:19.113676 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3426e0-b9eb-4dac-b9d7-cca9d161ec33 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:19.121766 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3426e0-b9eb-4dac-b9d7-cca9d161ec33 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:19.123461 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3426e0-b9eb-4dac-b9d7-cca9d161ec33 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:19.138836 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-cc3426e0-b9eb-4dac-b9d7-cca9d161ec33 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:00:19.138836 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:19.138836 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:19.138836 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:19.138836 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:19.138836 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:19.138836 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:19.138836 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:19.138836 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:19.138836 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:19.138836 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:19.138836 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:19.138836 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:00:19.138836 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:00:19.138836 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:00:19.138836 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:00:19.139889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:19.139889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:19.139889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:00:19.139889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:00:19.139889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:00:19.139889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:00:19.139889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:19.139889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:19.139889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:19.139889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:19.139889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:19.139889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:19.139889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:19.139889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:19.139889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:19.139889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:19.139889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:19.139889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:19.140851 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:19.140851 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:19.140851 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:00:19.140851 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:00:19.140851 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:00:19.140851 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:00:19.140851 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:00:19.140851 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:00:19.140851 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:00:19.140851 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:19.144018 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 458/902] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Jun 22 10:00:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:19.149831 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd15015-f9ea-48c8-b157-8a8e5ddcbd1c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:19.246423 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:19.255840 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd15015-f9ea-48c8-b157-8a8e5ddcbd1c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:19.291061 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7defdef-5ffb-42f3-b94c-aafe0362354c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:19.291713 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7defdef-5ffb-42f3-b94c-aafe0362354c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:19.291999 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7defdef-5ffb-42f3-b94c-aafe0362354c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:19.292281 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7defdef-5ffb-42f3-b94c-aafe0362354c None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:19.293149 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7defdef-5ffb-42f3-b94c-aafe0362354c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:19.293458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7defdef-5ffb-42f3-b94c-aafe0362354c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:19.294888 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7defdef-5ffb-42f3-b94c-aafe0362354c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:19.312985 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 445/903] 10.222.0.46 () {56 vars in 1149 bytes} [Wed Jun 22 10:00:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:19.318528 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3426e0-b9eb-4dac-b9d7-cca9d161ec33 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:19.351232 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da369742-0c69-46b2-a954-988e7d0f2a6d None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:19.351541 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da369742-0c69-46b2-a954-988e7d0f2a6d None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:19.351733 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da369742-0c69-46b2-a954-988e7d0f2a6d None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:19.353356 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 446/904] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:19.358354 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb2d3e-4c48-498c-b695-a2cbbd05c9e5 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:19.358642 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb2d3e-4c48-498c-b695-a2cbbd05c9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:19.358917 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb2d3e-4c48-498c-b695-a2cbbd05c9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:19.377228 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-01bb2d3e-4c48-498c-b695-a2cbbd05c9e5 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:19.379437 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-01bb2d3e-4c48-498c-b695-a2cbbd05c9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:19.439625 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3426e0-b9eb-4dac-b9d7-cca9d161ec33 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:19.461171 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 447/905] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:00:19.470964 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:19.479361 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb2d3e-4c48-498c-b695-a2cbbd05c9e5 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:19.486568 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61eac9-2052-4972-8a61-7de3b7d0dd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:19.486568 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61eac9-2052-4972-8a61-7de3b7d0dd9b None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:19.486568 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61eac9-2052-4972-8a61-7de3b7d0dd9b None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:19.486568 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61eac9-2052-4972-8a61-7de3b7d0dd9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:19.555464 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61eac9-2052-4972-8a61-7de3b7d0dd9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:19.557181 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61eac9-2052-4972-8a61-7de3b7d0dd9b None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:19.565846 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:19.595391 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb2d3e-4c48-498c-b695-a2cbbd05c9e5 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:19.641080 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3288d0d-985a-45bc-8fc1-a8f10e91b06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:19.641900 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3288d0d-985a-45bc-8fc1-a8f10e91b06d None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:19.642249 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3288d0d-985a-45bc-8fc1-a8f10e91b06d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:19.642587 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3288d0d-985a-45bc-8fc1-a8f10e91b06d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:19.643382 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3288d0d-985a-45bc-8fc1-a8f10e91b06d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:19.644848 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3288d0d-985a-45bc-8fc1-a8f10e91b06d None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:19.661142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-c3288d0d-985a-45bc-8fc1-a8f10e91b06d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 10:00:19.661142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:19.661142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:00:19.661142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:00:19.661142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:00:19.661142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:00:19.661142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:00:19.661142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:19.661142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 10:00:19.661142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:19.661142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:00:19.661142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:19.661142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:19.661142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:19.661142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:19.661142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:19.662299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:19.662299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:19.662299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:19.662299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:19.662299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:19.662299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:19.662299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:19.662299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:00:19.662299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:00:19.662299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:00:19.662299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:00:19.662299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:19.662299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:19.662299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:19.662299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:19.662299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:19.663328 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:19.663328 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:19.663328 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:19.663328 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:19.663328 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:19.663328 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:19.663328 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:19.663328 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:19.663328 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:19.663328 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:19.663328 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:19.663328 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:00:19.663328 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:19.663328 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 10:00:19.663328 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:19.665859 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 448/906] 10.222.0.46 () {56 vars in 1132 bytes} [Wed Jun 22 10:00:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:00:19.673069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3288d0d-985a-45bc-8fc1-a8f10e91b06d None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:19.690686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 459/907] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 10:00:19 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:00:19.696140 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61eac9-2052-4972-8a61-7de3b7d0dd9b None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:19.732056 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:19.809259 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3288d0d-985a-45bc-8fc1-a8f10e91b06d None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:19.831651 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61eac9-2052-4972-8a61-7de3b7d0dd9b None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:19.847271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45865a17-80da-450d-acb6-c07066ebcd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:19.848002 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45865a17-80da-450d-acb6-c07066ebcd5c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:19.848288 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45865a17-80da-450d-acb6-c07066ebcd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:19.848568 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45865a17-80da-450d-acb6-c07066ebcd5c None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:19.849330 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45865a17-80da-450d-acb6-c07066ebcd5c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:19.849639 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45865a17-80da-450d-acb6-c07066ebcd5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:19.851206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45865a17-80da-450d-acb6-c07066ebcd5c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:19.856856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 449/908] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Jun 22 10:00:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:19.862327 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45865a17-80da-450d-acb6-c07066ebcd5c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:19.872892 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:19.889921 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54629e35-90d2-4f23-b5b2-5f13c05cbb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:19.893425 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54629e35-90d2-4f23-b5b2-5f13c05cbb22 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:19.893425 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54629e35-90d2-4f23-b5b2-5f13c05cbb22 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:19.893425 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54629e35-90d2-4f23-b5b2-5f13c05cbb22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:19.906515 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54629e35-90d2-4f23-b5b2-5f13c05cbb22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:19.908138 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54629e35-90d2-4f23-b5b2-5f13c05cbb22 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:19.928419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-54629e35-90d2-4f23-b5b2-5f13c05cbb22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:19.928419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:19.928419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:19.928419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:19.928419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:19.928419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:19.928419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:19.928419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:19.928419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:19.928419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:19.928419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:19.928419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:19.928419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:00:19.928419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:00:19.928419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:00:19.929556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:00:19.929556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:19.929556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:19.929556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:19.929556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:19.929556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:19.929556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:19.929556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:19.929556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:19.929556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:19.929556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:19.929556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:19.929556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:19.929556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:19.929556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:19.929556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:19.929556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:19.930742 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:00:19.930742 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:00:19.930742 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:19.930742 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:19.932288 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 460/909] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:00:19.937524 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54629e35-90d2-4f23-b5b2-5f13c05cbb22 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:19.987943 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45865a17-80da-450d-acb6-c07066ebcd5c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:20.028830 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a44a4d-8f0b-45f1-80b0-a66c5e5dbb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:20.029620 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a44a4d-8f0b-45f1-80b0-a66c5e5dbb2b None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:20.029978 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a44a4d-8f0b-45f1-80b0-a66c5e5dbb2b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:20.030340 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a44a4d-8f0b-45f1-80b0-a66c5e5dbb2b None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:20.031133 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a44a4d-8f0b-45f1-80b0-a66c5e5dbb2b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:20.031450 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a44a4d-8f0b-45f1-80b0-a66c5e5dbb2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:20.032246 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:20.033300 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a44a4d-8f0b-45f1-80b0-a66c5e5dbb2b None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:20.041154 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 450/910] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Jun 22 10:00:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:00:20.041154 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7465552-c71d-4ca6-b9ae-d41e3011a338 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:20.041154 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7465552-c71d-4ca6-b9ae-d41e3011a338 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:20.041154 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7465552-c71d-4ca6-b9ae-d41e3011a338 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:20.046066 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 451/911] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:20.048055 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bae2b8-f332-469a-8d7f-430dc33c615a None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:20.048415 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bae2b8-f332-469a-8d7f-430dc33c615a None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:20.048776 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bae2b8-f332-469a-8d7f-430dc33c615a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:20.058187 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54629e35-90d2-4f23-b5b2-5f13c05cbb22 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:20.065412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-17bae2b8-f332-469a-8d7f-430dc33c615a None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:20.066663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-17bae2b8-f332-469a-8d7f-430dc33c615a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:20.097494 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6374327-aed5-4dbe-a13b-14b025f58cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:20.098211 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6374327-aed5-4dbe-a13b-14b025f58cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:20.098460 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6374327-aed5-4dbe-a13b-14b025f58cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:20.098737 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6374327-aed5-4dbe-a13b-14b025f58cc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:20.099545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6374327-aed5-4dbe-a13b-14b025f58cc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:20.099761 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6374327-aed5-4dbe-a13b-14b025f58cc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:20.101149 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6374327-aed5-4dbe-a13b-14b025f58cc1 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:20.114719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 461/912] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:20.115536 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6374327-aed5-4dbe-a13b-14b025f58cc1 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:20.140465 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:20.156926 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 452/913] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:00:20.156926 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bae2b8-f332-469a-8d7f-430dc33c615a None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:20.246292 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6374327-aed5-4dbe-a13b-14b025f58cc1 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:20.254663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bae2b8-f332-469a-8d7f-430dc33c615a None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:20.281842 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a2080-07e3-4b37-92ce-87a950044305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:20.282753 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a2080-07e3-4b37-92ce-87a950044305 None admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:20.283197 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a2080-07e3-4b37-92ce-87a950044305 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:20.283658 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a2080-07e3-4b37-92ce-87a950044305 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:20.284545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9a2080-07e3-4b37-92ce-87a950044305 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:20.286085 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9a2080-07e3-4b37-92ce-87a950044305 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:20.288900 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec5b35-becc-46c0-94db-9e426ce752e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:20.289674 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec5b35-becc-46c0-94db-9e426ce752e7 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:20.289957 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec5b35-becc-46c0-94db-9e426ce752e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:20.290233 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec5b35-becc-46c0-94db-9e426ce752e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:20.294374 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:20.296994 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec5b35-becc-46c0-94db-9e426ce752e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:20.298427 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec5b35-becc-46c0-94db-9e426ce752e7 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:20.312441 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-94ec5b35-becc-46c0-94db-9e426ce752e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:00:20.312441 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:20.312441 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:20.312441 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:20.312441 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:20.312441 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:20.312441 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:20.312441 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:20.312441 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:20.312441 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:20.312441 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:20.312441 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:20.312441 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:00:20.312441 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:00:20.312441 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:00:20.313411 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:00:20.313411 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:20.313411 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:20.313411 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:20.313411 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:20.313411 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:20.313411 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:20.313411 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:20.313411 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:20.313411 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:20.313411 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:20.313411 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:20.313411 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:20.313411 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:20.313411 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:20.313411 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:20.313411 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:20.314299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:00:20.314299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:00:20.314299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:00:20.314299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:00:20.314299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:00:20.314299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:00:20.314299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:00:20.314299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:20.314299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 453/914] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 10:00:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:20.315651 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec5b35-becc-46c0-94db-9e426ce752e7 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:20.372855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 462/915] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Jun 22 10:00:20 2022] POST /identity/v3/endpoints => generated 347 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:00:20.372855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a2080-07e3-4b37-92ce-87a950044305 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:20.392292 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:20.444940 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec5b35-becc-46c0-94db-9e426ce752e7 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:20.494810 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c8dbd-2e3e-4e7d-bd20-d483f6b98641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:20.495847 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c8dbd-2e3e-4e7d-bd20-d483f6b98641 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:20.496259 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c8dbd-2e3e-4e7d-bd20-d483f6b98641 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:20.496749 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c8dbd-2e3e-4e7d-bd20-d483f6b98641 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:20.497675 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c8dbd-2e3e-4e7d-bd20-d483f6b98641 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:20.499199 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c8dbd-2e3e-4e7d-bd20-d483f6b98641 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:20.500487 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a2080-07e3-4b37-92ce-87a950044305 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:20.521736 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-7f2c8dbd-2e3e-4e7d-bd20-d483f6b98641 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 10:00:20.521736 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:20.521736 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:00:20.521736 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:00:20.521736 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:00:20.521736 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:00:20.521736 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:00:20.521736 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:20.521736 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 10:00:20.521736 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:20.521736 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:00:20.521736 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:20.521736 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:20.521736 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:20.521736 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:20.521736 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:20.521736 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:20.522981 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:20.522981 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:20.522981 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:20.522981 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:20.522981 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:20.522981 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:20.522981 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:00:20.522981 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:00:20.522981 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:00:20.522981 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:00:20.522981 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:20.522981 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:20.522981 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:20.522981 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:20.522981 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:20.522981 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:20.524088 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:20.524088 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:20.524088 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:20.524088 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:20.524088 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:20.524088 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:20.524088 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:20.524088 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:20.524088 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:20.524088 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:20.524088 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:00:20.524088 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:20.524088 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 10:00:20.524088 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:20.524088 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 454/916] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 22 10:00:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:20.531542 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c8dbd-2e3e-4e7d-bd20-d483f6b98641 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:20.545544 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac9c53-618f-4a1b-aea5-992541186262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:20.547380 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac9c53-618f-4a1b-aea5-992541186262 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:20.547788 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac9c53-618f-4a1b-aea5-992541186262 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:20.548168 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac9c53-618f-4a1b-aea5-992541186262 None admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:20.549191 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac9c53-618f-4a1b-aea5-992541186262 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:20.549611 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac9c53-618f-4a1b-aea5-992541186262 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:20.551173 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac9c53-618f-4a1b-aea5-992541186262 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:20.568414 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 463/917] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 10:00:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:20.574504 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac9c53-618f-4a1b-aea5-992541186262 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:20.645755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:20.657783 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c8dbd-2e3e-4e7d-bd20-d483f6b98641 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:20.688045 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:20.700423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac9c53-618f-4a1b-aea5-992541186262 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:20.704599 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5f580-c2e9-491b-aefe-74780939825e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:20.705570 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5f580-c2e9-491b-aefe-74780939825e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:20.706045 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5f580-c2e9-491b-aefe-74780939825e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:20.706458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5f580-c2e9-491b-aefe-74780939825e None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:20.707313 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5f580-c2e9-491b-aefe-74780939825e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:20.707772 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5f580-c2e9-491b-aefe-74780939825e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:20.709372 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5f580-c2e9-491b-aefe-74780939825e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:20.719322 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 455/918] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 22 10:00:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:00:20.720929 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5f580-c2e9-491b-aefe-74780939825e None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:20.738072 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60c372-4576-459d-993d-73c5b086b409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:20.738729 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60c372-4576-459d-993d-73c5b086b409 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:20.739010 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60c372-4576-459d-993d-73c5b086b409 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:20.739286 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60c372-4576-459d-993d-73c5b086b409 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:20.740141 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c60c372-4576-459d-993d-73c5b086b409 None admin] RBAC: Adding query filter params (role.id=263cc0eba7e54b5ab2d884bfb15f6a93, scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9, user.id=7b4d3b1fe8064cc592d89e7bab91bace) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:20.740437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c60c372-4576-459d-993d-73c5b086b409 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:20.741898 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c60c372-4576-459d-993d-73c5b086b409 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:20.747999 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 464/919] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 10:00:20 2022] GET /identity/v3/role_assignments?user.id=7b4d3b1fe8064cc592d89e7bab91bace&scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9&role.id=263cc0eba7e54b5ab2d884bfb15f6a93 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:00:20.843565 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5f580-c2e9-491b-aefe-74780939825e None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:20.881427 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee09e11e-5e7e-42c9-8963-8550dbd03a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:20.882348 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09e11e-5e7e-42c9-8963-8550dbd03a4d None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:20.882773 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09e11e-5e7e-42c9-8963-8550dbd03a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:20.883188 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09e11e-5e7e-42c9-8963-8550dbd03a4d None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:20.884146 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee09e11e-5e7e-42c9-8963-8550dbd03a4d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:20.884596 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee09e11e-5e7e-42c9-8963-8550dbd03a4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:20.886202 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee09e11e-5e7e-42c9-8963-8550dbd03a4d None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:20.896735 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 456/920] 10.222.0.46 () {56 vars in 1114 bytes} [Wed Jun 22 10:00:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:00:20.899321 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60c372-4576-459d-993d-73c5b086b409 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:20.964235 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50975f6c-8d43-4604-916a-05976f9e1833 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:20.964419 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50975f6c-8d43-4604-916a-05976f9e1833 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:20.964707 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50975f6c-8d43-4604-916a-05976f9e1833 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:20.966437 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 457/921] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:00:20.971580 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c2318-0114-44f8-95e0-522c45b0baef None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:20.971866 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c2318-0114-44f8-95e0-522c45b0baef None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:20.972143 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c2318-0114-44f8-95e0-522c45b0baef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:20.989670 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-095c2318-0114-44f8-95e0-522c45b0baef None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:20.990872 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-095c2318-0114-44f8-95e0-522c45b0baef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:21.016670 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60c372-4576-459d-993d-73c5b086b409 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:21.044235 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:21.045631 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:21.068853 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad928b61-a6d0-4357-873c-c5022d410d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:21.068853 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad928b61-a6d0-4357-873c-c5022d410d2b None admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:21.068853 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad928b61-a6d0-4357-873c-c5022d410d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:21.068853 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad928b61-a6d0-4357-873c-c5022d410d2b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:21.069610 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad928b61-a6d0-4357-873c-c5022d410d2b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:21.070000 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 458/922] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:00:21.071323 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad928b61-a6d0-4357-873c-c5022d410d2b None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:21.091118 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c2318-0114-44f8-95e0-522c45b0baef None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:21.187904 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 465/923] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Jun 22 10:00:20 2022] POST /identity/v3/endpoints => generated 346 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:00:21.209710 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c2318-0114-44f8-95e0-522c45b0baef None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:21.262554 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ec819-adfe-4000-8a05-ea376c1659dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:21.263575 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ec819-adfe-4000-8a05-ea376c1659dc None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:21.264115 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ec819-adfe-4000-8a05-ea376c1659dc None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:21.264636 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ec819-adfe-4000-8a05-ea376c1659dc None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:21.265669 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ec819-adfe-4000-8a05-ea376c1659dc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:21.267332 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ec819-adfe-4000-8a05-ea376c1659dc None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:21.357680 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 459/924] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Jun 22 10:00:21 2022] POST /identity/v3/services => generated 241 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:00:22.556564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39981307-0382-4367-a754-75c18355fc98 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:22.557129 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39981307-0382-4367-a754-75c18355fc98 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:22.557129 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39981307-0382-4367-a754-75c18355fc98 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:22.558766 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 466/925] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:22.564022 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a5afb-5fcc-4ee5-ad03-ccaede270c08 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:22.564412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a5afb-5fcc-4ee5-ad03-ccaede270c08 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:22.565138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a5afb-5fcc-4ee5-ad03-ccaede270c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:22.582420 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-381a5afb-5fcc-4ee5-ad03-ccaede270c08 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:22.583623 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-381a5afb-5fcc-4ee5-ad03-ccaede270c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:22.613613 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:22.669178 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 460/926] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:00:22.685547 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39981307-0382-4367-a754-75c18355fc98 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:22.801187 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39981307-0382-4367-a754-75c18355fc98 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:22.838775 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792747d3-e295-4524-b863-3f5f75c1a34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:22.839496 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792747d3-e295-4524-b863-3f5f75c1a34b None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:22.839774 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792747d3-e295-4524-b863-3f5f75c1a34b None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:22.840172 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792747d3-e295-4524-b863-3f5f75c1a34b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:22.840851 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792747d3-e295-4524-b863-3f5f75c1a34b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:22.842214 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792747d3-e295-4524-b863-3f5f75c1a34b None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:22.855265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-792747d3-e295-4524-b863-3f5f75c1a34b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 10:00:22.855265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:22.855265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:00:22.855265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:00:22.855265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:00:22.855265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:00:22.855265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:00:22.855265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:22.855265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 10:00:22.855265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:22.855265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:00:22.855265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:22.855265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:22.855265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:22.855265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:22.855265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:22.855265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:22.856312 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:22.856312 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:22.856312 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:22.856312 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:22.856312 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:22.856312 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:22.856312 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:00:22.856312 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:00:22.856312 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:00:22.856312 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:00:22.856312 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:22.856312 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:22.856312 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:22.856312 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:22.856312 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:22.856312 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:22.857248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:22.857248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:22.857248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:22.857248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:22.857248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:22.857248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:22.857248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:22.857248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:22.857248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:22.857248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:22.857248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:00:22.857248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:22.857248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 10:00:22.857248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:22.857248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 467/927] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 10:00:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:22.866796 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a5afb-5fcc-4ee5-ad03-ccaede270c08 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:22.867208 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2587643-b4b6-4f98-9612-aeb5dc5c3c46 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:22.867499 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2587643-b4b6-4f98-9612-aeb5dc5c3c46 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:22.867781 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2587643-b4b6-4f98-9612-aeb5dc5c3c46 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:22.869443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 468/928] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:00:22.874702 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a700eeb-abb6-4182-98af-795aaee5405a None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:22.876441 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a700eeb-abb6-4182-98af-795aaee5405a None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:22.876441 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a700eeb-abb6-4182-98af-795aaee5405a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:22.893008 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-3a700eeb-abb6-4182-98af-795aaee5405a None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:22.894887 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-3a700eeb-abb6-4182-98af-795aaee5405a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:22.934868 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:22.988912 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 469/929] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:00:22.996665 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a5afb-5fcc-4ee5-ad03-ccaede270c08 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:23.012179 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a700eeb-abb6-4182-98af-795aaee5405a None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:23.043948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d61be9-3ef1-49b5-aaa8-502dc3d5f357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:23.045466 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d61be9-3ef1-49b5-aaa8-502dc3d5f357 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:23.045928 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d61be9-3ef1-49b5-aaa8-502dc3d5f357 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:23.046619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d61be9-3ef1-49b5-aaa8-502dc3d5f357 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:23.047708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d61be9-3ef1-49b5-aaa8-502dc3d5f357 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:23.048494 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d61be9-3ef1-49b5-aaa8-502dc3d5f357 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:23.050639 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d61be9-3ef1-49b5-aaa8-502dc3d5f357 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:23.065248 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 461/930] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Jun 22 10:00:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:23.067311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d61be9-3ef1-49b5-aaa8-502dc3d5f357 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:23.102090 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:23.153464 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a700eeb-abb6-4182-98af-795aaee5405a None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:23.198425 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474e322-6ca2-4871-975a-d833abd0c3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:23.199695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474e322-6ca2-4871-975a-d833abd0c3c8 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:23.199990 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474e322-6ca2-4871-975a-d833abd0c3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:23.200278 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f474e322-6ca2-4871-975a-d833abd0c3c8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:23.208084 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d61be9-3ef1-49b5-aaa8-502dc3d5f357 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:23.216364 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f474e322-6ca2-4871-975a-d833abd0c3c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:00:23.228866 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-f474e322-6ca2-4871-975a-d833abd0c3c8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:00:23.228866 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:23.228866 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:23.228866 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:23.228866 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:23.228866 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:23.228866 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:23.228866 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:23.228866 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:23.228866 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:23.228866 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:23.228866 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:23.228866 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:00:23.228866 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:00:23.228866 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:00:23.228866 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:00:23.229877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:00:23.229877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:00:23.229877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:00:23.229877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:00:23.229877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:23.229877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:23.229877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:23.229877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:23.229877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:23.229877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:23.229877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:23.229877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:23.229877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:23.229877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:23.229877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:23.229877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:23.230738 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:23.230738 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:23.230738 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:23.230738 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:23.230738 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:00:23.230738 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:00:23.230738 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:00:23.230738 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:00:23.230738 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:00:23.230738 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:00:23.230738 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:00:23.230738 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:23.235545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 470/931] 10.222.0.46 () {56 vars in 1120 bytes} [Wed Jun 22 10:00:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:00:23.236613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474e322-6ca2-4871-975a-d833abd0c3c8 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:23.262377 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bb735-97e4-4e9d-872d-a7b0ae8b0f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:23.263537 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bb735-97e4-4e9d-872d-a7b0ae8b0f6e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:23.264020 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bb735-97e4-4e9d-872d-a7b0ae8b0f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:23.264546 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bb735-97e4-4e9d-872d-a7b0ae8b0f6e None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:23.265529 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6bb735-97e4-4e9d-872d-a7b0ae8b0f6e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:23.266037 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6bb735-97e4-4e9d-872d-a7b0ae8b0f6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:23.267763 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6bb735-97e4-4e9d-872d-a7b0ae8b0f6e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:23.278789 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 462/932] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Jun 22 10:00:23 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:00:23.306137 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:23.306513 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1f036-0620-4fe2-8b13-e3633cf431c8 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:23.306773 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1f036-0620-4fe2-8b13-e3633cf431c8 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:23.307046 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1f036-0620-4fe2-8b13-e3633cf431c8 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:23.308412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 463/933] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:00:23.314219 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cb8bd-4f2c-4623-80f3-1e7ad01c9c64 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:23.315065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cb8bd-4f2c-4623-80f3-1e7ad01c9c64 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:23.315345 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cb8bd-4f2c-4623-80f3-1e7ad01c9c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:23.336663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-f92cb8bd-4f2c-4623-80f3-1e7ad01c9c64 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:23.337986 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-f92cb8bd-4f2c-4623-80f3-1e7ad01c9c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:23.401973 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f474e322-6ca2-4871-975a-d833abd0c3c8 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:23.433650 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 464/934] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:00:23.442855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a59d5-7fcb-44df-8bbb-9f3fd3f865ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:23.444912 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a59d5-7fcb-44df-8bbb-9f3fd3f865ce None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:23.445395 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a59d5-7fcb-44df-8bbb-9f3fd3f865ce None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:23.445883 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a59d5-7fcb-44df-8bbb-9f3fd3f865ce None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:23.446837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a59d5-7fcb-44df-8bbb-9f3fd3f865ce None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:23.447293 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a59d5-7fcb-44df-8bbb-9f3fd3f865ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:23.448950 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a59d5-7fcb-44df-8bbb-9f3fd3f865ce None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:23.457909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cb8bd-4f2c-4623-80f3-1e7ad01c9c64 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:23.461798 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 471/935] 10.222.0.46 () {56 vars in 1115 bytes} [Wed Jun 22 10:00:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:23.470177 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a59d5-7fcb-44df-8bbb-9f3fd3f865ce None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:23.484300 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:23.574907 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:23.579369 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cb8bd-4f2c-4623-80f3-1e7ad01c9c64 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:23.587148 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a59d5-7fcb-44df-8bbb-9f3fd3f865ce None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:23.617466 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b617c4-ef8a-4e14-b6cb-a2b657dae0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:23.618133 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b617c4-ef8a-4e14-b6cb-a2b657dae0e1 None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:23.618414 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b617c4-ef8a-4e14-b6cb-a2b657dae0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:23.618685 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b617c4-ef8a-4e14-b6cb-a2b657dae0e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:23.619410 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b617c4-ef8a-4e14-b6cb-a2b657dae0e1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:23.620846 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b617c4-ef8a-4e14-b6cb-a2b657dae0e1 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:23.622212 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: WARNING keystone.server.flask.common [None req-44b617c4-ef8a-4e14-b6cb-a2b657dae0e1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 22 10:00:23.629330 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98722c9-2eef-4857-9e5f-5c0aead08e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:23.630494 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98722c9-2eef-4857-9e5f-5c0aead08e48 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:23.630960 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98722c9-2eef-4857-9e5f-5c0aead08e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:23.631435 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98722c9-2eef-4857-9e5f-5c0aead08e48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:23.643173 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98722c9-2eef-4857-9e5f-5c0aead08e48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:23.644893 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98722c9-2eef-4857-9e5f-5c0aead08e48 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:23.663423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-d98722c9-2eef-4857-9e5f-5c0aead08e48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:23.663423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:23.663423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:23.663423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:23.663423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:23.663423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:23.663423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:23.663423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:23.663423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:23.663423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:23.663423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:23.663423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:23.663423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:00:23.663423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:00:23.663423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:00:23.664333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:00:23.664333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:23.664333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:23.664333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:23.664333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:23.664333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:23.664333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:23.664333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:23.664333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:23.664333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:23.664333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:23.664333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:23.664333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:23.664333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:23.664333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:23.664333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:23.664333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:23.665269 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:00:23.665269 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:00:23.665269 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:23.665269 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:23.665269 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 472/936] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:00:23.672862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf1742-7e2f-4a2f-8a67-adb17eadf4ac None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:23.672862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf1742-7e2f-4a2f-8a67-adb17eadf4ac None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:23.672862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf1742-7e2f-4a2f-8a67-adb17eadf4ac None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:23.672862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 473/937] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:23.675978 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf1742-7e2f-4a2f-8a67-adb17eadf4ac None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:23.681207 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.sql.core [None req-44b617c4-ef8a-4e14-b6cb-a2b657dae0e1 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 22 10:00:23.681207 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 22 10:00:23.681207 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [parameters: {'id': 'c844acd1f04340a08d45683c3e2d04bb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 22 10:00:23.681207 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80499) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 22 10:00:23.699251 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-44b617c4-ef8a-4e14-b6cb-a2b657dae0e1 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c844acd1f04340a08d45683c3e2d04bb.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c844acd1f04340a08d45683c3e2d04bb. Jun 22 10:00:23.699251 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:23.699251 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 10:00:23.699251 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 10:00:23.699251 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 10:00:23.699251 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 10:00:23.699251 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 10:00:23.699251 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 10:00:23.699251 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 10:00:23.699251 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application conn.query(q) Jun 22 10:00:23.699251 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 10:00:23.699251 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 10:00:23.699251 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 10:00:23.700103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application result.read() Jun 22 10:00:23.700103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 10:00:23.700103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 10:00:23.700103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 10:00:23.700103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 10:00:23.700103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 10:00:23.700103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 10:00:23.700103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 10:00:23.700103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 10:00:23.700103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 22 10:00:23.700103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:23.700103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 22 10:00:23.700103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:23.700103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:23.700103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 22 10:00:23.700103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 22 10:00:23.700103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 22 10:00:23.700103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 22 10:00:23.701129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 10:00:23.701129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application next(self.gen) Jun 22 10:00:23.701129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 22 10:00:23.701129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application yield resource Jun 22 10:00:23.701129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 10:00:23.701129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application next(self.gen) Jun 22 10:00:23.701129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 22 10:00:23.701129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self.session.rollback() Jun 22 10:00:23.701129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 22 10:00:23.701129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self.force_reraise() Jun 22 10:00:23.701129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 22 10:00:23.701129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise self.value Jun 22 10:00:23.701129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 22 10:00:23.701129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 22 10:00:23.701129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 22 10:00:23.701129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application session.commit() Jun 22 10:00:23.701129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 22 10:00:23.702367 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 22 10:00:23.702367 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 22 10:00:23.702367 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._prepare_impl() Jun 22 10:00:23.702367 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 22 10:00:23.702367 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self.session.flush() Jun 22 10:00:23.702367 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 22 10:00:23.702367 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._flush(objects) Jun 22 10:00:23.702367 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 22 10:00:23.702367 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 22 10:00:23.702367 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 22 10:00:23.702367 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application compat.raise_( Jun 22 10:00:23.702367 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 10:00:23.702367 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception Jun 22 10:00:23.702367 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 22 10:00:23.702367 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application flush_context.execute() Jun 22 10:00:23.702367 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 22 10:00:23.702367 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rec.execute(self) Jun 22 10:00:23.703387 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 22 10:00:23.703387 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 22 10:00:23.703387 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 22 10:00:23.703387 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 22 10:00:23.703387 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 22 10:00:23.703387 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 22 10:00:23.703387 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 22 10:00:23.703387 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 22 10:00:23.703387 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 22 10:00:23.703387 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 22 10:00:23.703387 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 22 10:00:23.703387 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 22 10:00:23.703387 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 22 10:00:23.703387 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 22 10:00:23.703387 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 22 10:00:23.704174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 22 10:00:23.704174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 10:00:23.704174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception Jun 22 10:00:23.704174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 10:00:23.704174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 10:00:23.704174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 10:00:23.704174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 10:00:23.704174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 10:00:23.704174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 10:00:23.704174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 10:00:23.704174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application conn.query(q) Jun 22 10:00:23.704174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 10:00:23.704174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 10:00:23.704174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 10:00:23.704174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application result.read() Jun 22 10:00:23.704174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 10:00:23.704174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 10:00:23.705975 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 10:00:23.705975 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 10:00:23.705975 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 10:00:23.705975 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 10:00:23.705975 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 10:00:23.705975 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 10:00:23.705975 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 22 10:00:23.705975 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 22 10:00:23.705975 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [parameters: {'id': 'c844acd1f04340a08d45683c3e2d04bb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 22 10:00:23.705975 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 22 10:00:23.705975 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:23.705975 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:00:23.705975 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:23.705975 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:23.705975 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 22 10:00:23.707824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 22 10:00:23.707824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 22 10:00:23.707824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 22 10:00:23.707824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 22 10:00:23.707824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:23.707824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:00:23.707824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:23.707824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:23.707824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:23.707824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:23.707824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:23.707824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:23.707824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:23.707824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:23.707824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:23.707824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:23.707824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:23.714231 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:23.714231 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 22 10:00:23.714231 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 22 10:00:23.714231 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:23.714231 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:23.714231 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 22 10:00:23.714231 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 22 10:00:23.714231 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c844acd1f04340a08d45683c3e2d04bb. Jun 22 10:00:23.714231 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:23.714231 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 465/938] 10.222.0.46 () {60 vars in 1140 bytes} [Wed Jun 22 10:00:23 2022] POST /identity/v3/projects => generated 262 bytes in 243 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:23.714231 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2912f-7684-4c36-9de1-a794ce952fde None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:23.714231 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2912f-7684-4c36-9de1-a794ce952fde None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:23.715952 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2912f-7684-4c36-9de1-a794ce952fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:23.724433 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-8eb2912f-7684-4c36-9de1-a794ce952fde None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:23.726141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-8eb2912f-7684-4c36-9de1-a794ce952fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:23.798551 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 466/939] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:00:23.799548 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2912f-7684-4c36-9de1-a794ce952fde None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:23.806036 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:23.820274 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf1742-7e2f-4a2f-8a67-adb17eadf4ac None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:23.857778 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6e622-1cb1-4df4-bfdc-737c8cd598b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:23.858448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6e622-1cb1-4df4-bfdc-737c8cd598b8 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:23.858736 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6e622-1cb1-4df4-bfdc-737c8cd598b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:23.859026 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6e622-1cb1-4df4-bfdc-737c8cd598b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:23.859755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a6e622-1cb1-4df4-bfdc-737c8cd598b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:23.860063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a6e622-1cb1-4df4-bfdc-737c8cd598b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:23.861534 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a6e622-1cb1-4df4-bfdc-737c8cd598b8 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:23.874782 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 474/940] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:23.875621 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6e622-1cb1-4df4-bfdc-737c8cd598b8 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:23.878554 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:23.940310 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2912f-7684-4c36-9de1-a794ce952fde None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:23.985614 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346fa8c-19a6-4c1b-b6d8-3f0ffc02417a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:23.986557 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346fa8c-19a6-4c1b-b6d8-3f0ffc02417a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:23.986844 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346fa8c-19a6-4c1b-b6d8-3f0ffc02417a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:23.987131 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346fa8c-19a6-4c1b-b6d8-3f0ffc02417a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:23.990343 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6e622-1cb1-4df4-bfdc-737c8cd598b8 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:23.994116 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346fa8c-19a6-4c1b-b6d8-3f0ffc02417a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:23.995791 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346fa8c-19a6-4c1b-b6d8-3f0ffc02417a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:24.010438 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-3346fa8c-19a6-4c1b-b6d8-3f0ffc02417a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:00:24.010438 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:24.010438 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:24.010438 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:24.010438 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:24.010438 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:24.010438 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:24.010438 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:24.010438 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:24.010438 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:24.010438 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:24.010438 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:24.010438 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:00:24.010438 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:00:24.010438 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:00:24.011321 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:00:24.011321 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:24.011321 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:24.011321 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:24.011321 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:24.011321 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:24.011321 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:24.011321 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:24.011321 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:24.011321 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:24.011321 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:24.011321 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:24.011321 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:24.011321 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:24.011321 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:24.011321 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:24.011321 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:24.012192 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:00:24.012192 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:00:24.012192 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:00:24.012192 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:00:24.012192 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:00:24.012192 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:00:24.012192 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:00:24.012192 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:24.012192 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 467/941] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 10:00:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:24.012665 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346fa8c-19a6-4c1b-b6d8-3f0ffc02417a None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:24.033078 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc33fc9-aeff-4748-86a6-5b54b4ea0424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:24.033883 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc33fc9-aeff-4748-86a6-5b54b4ea0424 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:24.034166 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc33fc9-aeff-4748-86a6-5b54b4ea0424 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:24.034444 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc33fc9-aeff-4748-86a6-5b54b4ea0424 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:24.035110 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc33fc9-aeff-4748-86a6-5b54b4ea0424 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:24.036475 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc33fc9-aeff-4748-86a6-5b54b4ea0424 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:24.048691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-9dc33fc9-aeff-4748-86a6-5b54b4ea0424 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:00:24.048691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:24.048691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:00:24.048691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:00:24.048691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:00:24.048691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:00:24.048691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:00:24.048691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:24.048691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:00:24.048691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:24.048691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:00:24.048691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:24.048691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:24.048691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:24.048691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:24.048691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:24.048691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:24.049865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:24.049865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:24.049865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:24.049865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:24.049865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:24.049865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:24.049865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:00:24.049865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:00:24.049865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:00:24.049865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:00:24.049865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:24.049865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:24.049865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:24.049865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:24.049865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:24.049865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:24.050771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:24.050771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:24.050771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:24.050771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:24.050771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:24.050771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:24.050771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:24.050771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:24.050771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:24.050771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:24.050771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:00:24.050771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:24.050771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:00:24.050771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:24.050771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 475/942] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Jun 22 10:00:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:24.051550 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc33fc9-aeff-4748-86a6-5b54b4ea0424 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:24.088051 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:24.120389 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:24.130812 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346fa8c-19a6-4c1b-b6d8-3f0ffc02417a None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:24.158139 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc33fc9-aeff-4748-86a6-5b54b4ea0424 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:24.167165 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a573c31-925c-4a6b-9192-c33742d45734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:24.168016 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a573c31-925c-4a6b-9192-c33742d45734 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:24.168291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a573c31-925c-4a6b-9192-c33742d45734 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:24.168558 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a573c31-925c-4a6b-9192-c33742d45734 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:24.176974 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a573c31-925c-4a6b-9192-c33742d45734 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:24.178441 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a573c31-925c-4a6b-9192-c33742d45734 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:24.193264 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383dc9e-0c2e-431f-a23a-7b572820003c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:24.193458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-7a573c31-925c-4a6b-9192-c33742d45734 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:00:24.193458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:24.193458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:24.193458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:24.193458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:24.193458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:24.193458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:24.193458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:24.193458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:24.193458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:24.193458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:24.193458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:24.193458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:00:24.193458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:00:24.193458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:00:24.193458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:00:24.194528 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:24.194528 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:24.194528 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:00:24.194528 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:00:24.194528 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:00:24.194528 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:00:24.194528 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:24.194528 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:24.194528 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:24.194528 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:24.194528 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:24.194528 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:24.194528 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:24.194528 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:24.194528 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:24.194528 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:24.194528 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:24.194528 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:24.195963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:24.195963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:24.195963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:00:24.195963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:00:24.195963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:00:24.195963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:00:24.195963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:00:24.195963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:00:24.195963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:00:24.195963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:24.196661 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383dc9e-0c2e-431f-a23a-7b572820003c None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:24.196661 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383dc9e-0c2e-431f-a23a-7b572820003c None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:24.196661 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383dc9e-0c2e-431f-a23a-7b572820003c None admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:24.197144 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383dc9e-0c2e-431f-a23a-7b572820003c None admin] RBAC: Adding query filter params (name=service) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:24.197521 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383dc9e-0c2e-431f-a23a-7b572820003c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:24.199142 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383dc9e-0c2e-431f-a23a-7b572820003c None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:24.199335 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 468/943] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Jun 22 10:00:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:24.200084 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a573c31-925c-4a6b-9192-c33742d45734 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:24.228852 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 476/944] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Jun 22 10:00:24 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:24.228852 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383dc9e-0c2e-431f-a23a-7b572820003c None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:24.333225 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a573c31-925c-4a6b-9192-c33742d45734 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:24.359994 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383dc9e-0c2e-431f-a23a-7b572820003c None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:24.361878 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:24.373862 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc38e39-fa1c-40da-823f-f1b3de5660f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:24.374644 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc38e39-fa1c-40da-823f-f1b3de5660f8 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:24.374994 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc38e39-fa1c-40da-823f-f1b3de5660f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:24.375334 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc38e39-fa1c-40da-823f-f1b3de5660f8 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:24.376273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc38e39-fa1c-40da-823f-f1b3de5660f8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:24.376644 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc38e39-fa1c-40da-823f-f1b3de5660f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:24.378187 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc38e39-fa1c-40da-823f-f1b3de5660f8 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:24.386476 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 469/945] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Jun 22 10:00:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:24.394676 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc38e39-fa1c-40da-823f-f1b3de5660f8 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:24.400777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:24.413250 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31814af3-e733-48de-9f9e-8208f76a6ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:24.421596 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31814af3-e733-48de-9f9e-8208f76a6ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:24.421596 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31814af3-e733-48de-9f9e-8208f76a6ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:24.421596 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31814af3-e733-48de-9f9e-8208f76a6ca4 None admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:24.421596 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31814af3-e733-48de-9f9e-8208f76a6ca4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:24.421596 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31814af3-e733-48de-9f9e-8208f76a6ca4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:24.421596 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31814af3-e733-48de-9f9e-8208f76a6ca4 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:24.441266 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 477/946] 10.222.0.46 () {56 vars in 1149 bytes} [Wed Jun 22 10:00:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:24.448277 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31814af3-e733-48de-9f9e-8208f76a6ca4 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:24.527726 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc38e39-fa1c-40da-823f-f1b3de5660f8 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:24.569842 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31814af3-e733-48de-9f9e-8208f76a6ca4 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:24.580889 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ac30f-149c-433e-a02e-b6d0d73ab4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:24.582540 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ac30f-149c-433e-a02e-b6d0d73ab4ab None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:24.583035 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ac30f-149c-433e-a02e-b6d0d73ab4ab None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:24.583716 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ac30f-149c-433e-a02e-b6d0d73ab4ab None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:24.584580 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ac30f-149c-433e-a02e-b6d0d73ab4ab None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:24.585363 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ac30f-149c-433e-a02e-b6d0d73ab4ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:24.587666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ac30f-149c-433e-a02e-b6d0d73ab4ab None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:24.600101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 470/947] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Jun 22 10:00:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:24.602473 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ac30f-149c-433e-a02e-b6d0d73ab4ab None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:24.612512 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7c812-024e-42e8-9022-5eb558b4cd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:24.613348 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7c812-024e-42e8-9022-5eb558b4cd53 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:24.613627 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7c812-024e-42e8-9022-5eb558b4cd53 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:24.613899 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7c812-024e-42e8-9022-5eb558b4cd53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:24.625075 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7c812-024e-42e8-9022-5eb558b4cd53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:24.626580 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7c812-024e-42e8-9022-5eb558b4cd53 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:24.645206 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-91b7c812-024e-42e8-9022-5eb558b4cd53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:24.645206 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:24.645206 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:24.645206 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:24.645206 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:24.645206 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:24.645206 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:24.645206 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:24.645206 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:24.645206 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:24.645206 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:24.645206 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:24.645206 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:00:24.645206 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:00:24.645206 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:00:24.646123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:00:24.646123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:24.646123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:24.646123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:24.646123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:24.646123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:24.646123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:24.646123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:24.646123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:24.646123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:24.646123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:24.646123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:24.646123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:24.646123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:24.646123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:24.646123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:24.646123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:24.647467 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:00:24.647467 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:00:24.647467 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:24.647467 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:24.647467 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 478/948] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:00:24.652711 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7c812-024e-42e8-9022-5eb558b4cd53 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:24.680486 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:24.707758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:24.734394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ac30f-149c-433e-a02e-b6d0d73ab4ab None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:24.783710 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9f2a6-ac29-4201-8b4e-f1109a5529ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:24.784406 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9f2a6-ac29-4201-8b4e-f1109a5529ca None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:24.784689 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9f2a6-ac29-4201-8b4e-f1109a5529ca None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:24.785010 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9f2a6-ac29-4201-8b4e-f1109a5529ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:24.785807 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9f2a6-ac29-4201-8b4e-f1109a5529ca None admin] RBAC: Adding query filter params (interface=public, service_id=8cd0a0e9b7344f679e1fc6941bfcd48b, region_id=RegionOne) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:24.786120 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9f2a6-ac29-4201-8b4e-f1109a5529ca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:24.787737 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f9f2a6-ac29-4201-8b4e-f1109a5529ca None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:24.798286 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 471/949] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Jun 22 10:00:24 2022] GET /identity/v3/endpoints?service_id=8cd0a0e9b7344f679e1fc6941bfcd48b&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:00:24.800410 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9f2a6-ac29-4201-8b4e-f1109a5529ca None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:24.818705 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7c812-024e-42e8-9022-5eb558b4cd53 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:24.856377 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0652c-46ab-407e-b0c1-ef367273d22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:24.857434 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0652c-46ab-407e-b0c1-ef367273d22c None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:24.857956 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0652c-46ab-407e-b0c1-ef367273d22c None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:24.858446 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0652c-46ab-407e-b0c1-ef367273d22c None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:24.859399 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e0652c-46ab-407e-b0c1-ef367273d22c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:24.859912 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e0652c-46ab-407e-b0c1-ef367273d22c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:24.862083 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e0652c-46ab-407e-b0c1-ef367273d22c None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:24.874631 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 479/950] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:24.879917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0652c-46ab-407e-b0c1-ef367273d22c None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:24.921095 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9f2a6-ac29-4201-8b4e-f1109a5529ca None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:24.942388 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:24.965281 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ffcbb-c228-4a67-bb42-dd2964522866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:24.965881 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ffcbb-c228-4a67-bb42-dd2964522866 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:24.966198 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ffcbb-c228-4a67-bb42-dd2964522866 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:24.966443 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ffcbb-c228-4a67-bb42-dd2964522866 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:24.967457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ffcbb-c228-4a67-bb42-dd2964522866 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:24.969167 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ffcbb-c228-4a67-bb42-dd2964522866 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:24.983129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 472/951] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Jun 22 10:00:24 2022] GET /identity/v3/services => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:00:25.006368 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:25.014088 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0652c-46ab-407e-b0c1-ef367273d22c None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:25.051965 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f23ac-5742-432f-a0dd-ff4fbaa4ba67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:25.053135 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f23ac-5742-432f-a0dd-ff4fbaa4ba67 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:25.053727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f23ac-5742-432f-a0dd-ff4fbaa4ba67 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:25.054214 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f23ac-5742-432f-a0dd-ff4fbaa4ba67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:25.062908 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f23ac-5742-432f-a0dd-ff4fbaa4ba67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:25.064904 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f23ac-5742-432f-a0dd-ff4fbaa4ba67 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:25.081670 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-e33f23ac-5742-432f-a0dd-ff4fbaa4ba67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:00:25.081670 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:25.081670 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:25.081670 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:25.081670 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:25.081670 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:25.081670 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:25.081670 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:25.081670 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:25.081670 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:25.081670 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:25.081670 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:25.081670 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:00:25.081670 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:00:25.081670 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:00:25.082691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:00:25.082691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:25.082691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:25.082691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:25.082691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:25.082691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:25.082691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:25.082691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:25.082691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:25.082691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:25.082691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:25.082691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:25.082691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:25.082691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:25.082691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:25.082691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:25.082691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:25.083634 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:00:25.083634 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:00:25.083634 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:00:25.083634 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:00:25.083634 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:00:25.083634 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:00:25.083634 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:00:25.083634 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:25.085957 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 480/952] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 10:00:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:00:25.092123 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ffcbb-c228-4a67-bb42-dd2964522866 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:25.218028 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ffcbb-c228-4a67-bb42-dd2964522866 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:25.255206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c6706-319e-4242-8f9a-23608c260806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:25.255877 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c6706-319e-4242-8f9a-23608c260806 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:25.256166 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c6706-319e-4242-8f9a-23608c260806 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:25.256451 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c6706-319e-4242-8f9a-23608c260806 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:25.257281 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c6706-319e-4242-8f9a-23608c260806 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:25.257612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c6706-319e-4242-8f9a-23608c260806 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:25.259041 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c6706-319e-4242-8f9a-23608c260806 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:25.275594 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 473/953] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 10:00:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:25.281916 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f23ac-5742-432f-a0dd-ff4fbaa4ba67 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:25.384067 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f23ac-5742-432f-a0dd-ff4fbaa4ba67 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:25.421279 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24551f-c340-4394-87a6-5e999dae6024 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:25.421594 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24551f-c340-4394-87a6-5e999dae6024 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:25.421829 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24551f-c340-4394-87a6-5e999dae6024 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:25.423468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 474/954] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:25.428202 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fbf987-32fd-4de1-9873-85e4f76939ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:25.428864 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9461fa-0fae-473b-a57b-d0d52c7ebf3a None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:25.429139 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbf987-32fd-4de1-9873-85e4f76939ba None admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:25.429260 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9461fa-0fae-473b-a57b-d0d52c7ebf3a None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:25.429420 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbf987-32fd-4de1-9873-85e4f76939ba None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:25.429524 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9461fa-0fae-473b-a57b-d0d52c7ebf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:25.429673 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbf987-32fd-4de1-9873-85e4f76939ba None admin] PATH_INFO: `/v3/projects/a2bb614e4d7747c1a3fff154c8bc18d9/users/7b4d3b1fe8064cc592d89e7bab91bace/roles/263cc0eba7e54b5ab2d884bfb15f6a93` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:25.431952 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fbf987-32fd-4de1-9873-85e4f76939ba None admin] RBAC: Authorizing `identity:create_grant(project_id=a2bb614e4d7747c1a3fff154c8bc18d9, user_id=7b4d3b1fe8064cc592d89e7bab91bace, role_id=263cc0eba7e54b5ab2d884bfb15f6a93)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:25.433404 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fbf987-32fd-4de1-9873-85e4f76939ba None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:25.447390 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-ff9461fa-0fae-473b-a57b-d0d52c7ebf3a None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:25.451119 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-ff9461fa-0fae-473b-a57b-d0d52c7ebf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:25.489165 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:25.524325 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 475/955] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:00:25.547124 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9461fa-0fae-473b-a57b-d0d52c7ebf3a None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:25.609899 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 481/956] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 22 10:00:25 2022] PUT /identity/v3/projects/a2bb614e4d7747c1a3fff154c8bc18d9/users/7b4d3b1fe8064cc592d89e7bab91bace/roles/263cc0eba7e54b5ab2d884bfb15f6a93 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:00:25.667195 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9461fa-0fae-473b-a57b-d0d52c7ebf3a None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:25.707507 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111322ab-0baf-4b9b-b0cc-b3ced1b56e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:25.708277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111322ab-0baf-4b9b-b0cc-b3ced1b56e05 None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:25.708570 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111322ab-0baf-4b9b-b0cc-b3ced1b56e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:25.708869 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111322ab-0baf-4b9b-b0cc-b3ced1b56e05 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:25.709658 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111322ab-0baf-4b9b-b0cc-b3ced1b56e05 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:25.711136 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111322ab-0baf-4b9b-b0cc-b3ced1b56e05 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:25.838401 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 476/957] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Jun 22 10:00:25 2022] POST /identity/v3/services => generated 242 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:00:26.471656 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411f937-af9b-4310-953e-20e95619fdbb None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:26.472321 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411f937-af9b-4310-953e-20e95619fdbb None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:26.472519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411f937-af9b-4310-953e-20e95619fdbb None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:26.474163 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 482/958] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:26.479217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fc565-a30d-4718-8bbc-31ef2e7ab635 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:26.479504 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fc565-a30d-4718-8bbc-31ef2e7ab635 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:26.479783 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fc565-a30d-4718-8bbc-31ef2e7ab635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:26.497299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-cb5fc565-a30d-4718-8bbc-31ef2e7ab635 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:26.498499 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-cb5fc565-a30d-4718-8bbc-31ef2e7ab635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:26.529204 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:26.588451 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 477/959] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:26 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:00:26.615022 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411f937-af9b-4310-953e-20e95619fdbb None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:26.633583 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:26.723415 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411f937-af9b-4310-953e-20e95619fdbb None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:26.758416 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546fc41-04ab-4bb8-a142-6db0abd82bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:26.759094 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546fc41-04ab-4bb8-a142-6db0abd82bb7 None admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:26.759378 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546fc41-04ab-4bb8-a142-6db0abd82bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:26.759659 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546fc41-04ab-4bb8-a142-6db0abd82bb7 None admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:26.760439 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546fc41-04ab-4bb8-a142-6db0abd82bb7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:26.761978 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546fc41-04ab-4bb8-a142-6db0abd82bb7 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:26.763382 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: WARNING keystone.server.flask.common [None req-6546fc41-04ab-4bb8-a142-6db0abd82bb7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 22 10:00:26.822137 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.sql.core [None req-6546fc41-04ab-4bb8-a142-6db0abd82bb7 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 22 10:00:26.822137 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 22 10:00:26.822137 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [parameters: {'user_id': '16ac05a5a3f54bbf81984abc546c135e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 22 10:00:26.822137 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80500) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 22 10:00:26.831825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-6546fc41-04ab-4bb8-a142-6db0abd82bb7 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 22 10:00:26.831825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:26.831825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 10:00:26.831825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 10:00:26.831825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 10:00:26.831825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 10:00:26.831825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 10:00:26.831825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 10:00:26.831825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 10:00:26.831825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application conn.query(q) Jun 22 10:00:26.831825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 10:00:26.831825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 10:00:26.831825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 10:00:26.831825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application result.read() Jun 22 10:00:26.831825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 10:00:26.834443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 10:00:26.834443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 10:00:26.834443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 10:00:26.834443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 10:00:26.834443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 10:00:26.834443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 10:00:26.834443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 10:00:26.834443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 22 10:00:26.834443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:26.834443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 22 10:00:26.834443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:26.834443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:26.834443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 22 10:00:26.834443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 22 10:00:26.834443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 22 10:00:26.834443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 22 10:00:26.834443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 10:00:26.834443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application next(self.gen) Jun 22 10:00:26.835416 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 22 10:00:26.835416 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application yield resource Jun 22 10:00:26.835416 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 10:00:26.835416 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application next(self.gen) Jun 22 10:00:26.835416 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 22 10:00:26.835416 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self.session.rollback() Jun 22 10:00:26.835416 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 22 10:00:26.835416 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self.force_reraise() Jun 22 10:00:26.835416 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 22 10:00:26.835416 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise self.value Jun 22 10:00:26.835416 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 22 10:00:26.835416 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 22 10:00:26.835416 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 22 10:00:26.835416 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application session.commit() Jun 22 10:00:26.835416 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 22 10:00:26.835416 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 22 10:00:26.835416 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 22 10:00:26.836294 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._prepare_impl() Jun 22 10:00:26.836294 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 22 10:00:26.836294 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self.session.flush() Jun 22 10:00:26.836294 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 22 10:00:26.836294 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._flush(objects) Jun 22 10:00:26.836294 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 22 10:00:26.836294 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 22 10:00:26.836294 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 22 10:00:26.836294 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application compat.raise_( Jun 22 10:00:26.836294 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 10:00:26.836294 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception Jun 22 10:00:26.836294 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 22 10:00:26.836294 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application flush_context.execute() Jun 22 10:00:26.836294 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 22 10:00:26.836294 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rec.execute(self) Jun 22 10:00:26.836294 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 22 10:00:26.836294 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 22 10:00:26.837217 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 22 10:00:26.837217 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 22 10:00:26.837217 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 22 10:00:26.837217 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 22 10:00:26.837217 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 22 10:00:26.837217 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 22 10:00:26.837217 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 22 10:00:26.837217 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 22 10:00:26.837217 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 22 10:00:26.837217 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 22 10:00:26.837217 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 22 10:00:26.837217 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 22 10:00:26.837217 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 22 10:00:26.837217 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 22 10:00:26.837217 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 10:00:26.837217 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception Jun 22 10:00:26.838082 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 10:00:26.838082 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 10:00:26.838082 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 10:00:26.838082 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 10:00:26.838082 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 10:00:26.838082 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 10:00:26.838082 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 10:00:26.838082 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application conn.query(q) Jun 22 10:00:26.838082 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 10:00:26.838082 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 10:00:26.838082 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 10:00:26.838082 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application result.read() Jun 22 10:00:26.838082 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 10:00:26.838082 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 10:00:26.838082 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 10:00:26.838082 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 10:00:26.838907 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 10:00:26.838907 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 10:00:26.838907 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 10:00:26.838907 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 10:00:26.838907 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 22 10:00:26.838907 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 22 10:00:26.838907 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [parameters: {'user_id': '16ac05a5a3f54bbf81984abc546c135e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 22 10:00:26.838907 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 22 10:00:26.838907 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:26.838907 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:00:26.838907 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:26.838907 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:26.838907 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:26.838907 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:26.838907 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:26.840019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:26.840019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:26.840019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:26.840019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:26.840019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:26.840019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:26.840019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:26.840019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 22 10:00:26.840019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 22 10:00:26.840019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:26.840019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:26.840019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:00:26.840019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:00:26.840019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:00:26.840019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:00:26.840019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 22 10:00:26.840019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 22 10:00:26.842107 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 22 10:00:26.842107 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 22 10:00:26.842107 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 22 10:00:26.842107 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 22 10:00:26.842107 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 22 10:00:26.842107 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:26.842107 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 483/960] 10.222.0.46 () {60 vars in 1131 bytes} [Wed Jun 22 10:00:26 2022] POST /identity/v3/users => generated 160 bytes in 219 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:26.842995 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fc565-a30d-4718-8bbc-31ef2e7ab635 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:26.950224 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fc565-a30d-4718-8bbc-31ef2e7ab635 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:26.986595 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c3e16-6a75-4907-8a31-827d59849076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:26.987308 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c3e16-6a75-4907-8a31-827d59849076 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:26.987585 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c3e16-6a75-4907-8a31-827d59849076 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:26.987856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c3e16-6a75-4907-8a31-827d59849076 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:26.995400 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c3e16-6a75-4907-8a31-827d59849076 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:26.996922 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c3e16-6a75-4907-8a31-827d59849076 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:27.013610 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-317c3e16-6a75-4907-8a31-827d59849076 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 10:00:27.013610 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:27.013610 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:27.013610 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:27.013610 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:27.013610 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:27.013610 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:27.013610 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:27.013610 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:27.013610 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:27.013610 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:27.013610 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:27.013610 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:00:27.013610 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:00:27.013610 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:00:27.013610 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:00:27.016040 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:27.016040 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:27.016040 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:00:27.016040 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:00:27.016040 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:00:27.016040 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:00:27.016040 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:27.016040 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:27.016040 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:27.016040 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:27.016040 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:27.016040 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:27.016040 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:27.016040 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:27.016040 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:27.016040 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:27.016040 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:27.016040 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:27.018877 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:27.018877 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:27.018877 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:00:27.018877 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:00:27.018877 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:00:27.018877 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:00:27.018877 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:00:27.018877 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:00:27.018877 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 10:00:27.018877 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:27.018877 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 478/961] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 10:00:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:27.024841 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546fc41-04ab-4bb8-a142-6db0abd82bb7 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:27.105882 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:27.128667 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546fc41-04ab-4bb8-a142-6db0abd82bb7 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:27.164458 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc586d82-8798-4810-916e-8e333ff847aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:27.165269 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc586d82-8798-4810-916e-8e333ff847aa None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:27.165556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc586d82-8798-4810-916e-8e333ff847aa None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:27.165835 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc586d82-8798-4810-916e-8e333ff847aa None admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:27.166646 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc586d82-8798-4810-916e-8e333ff847aa None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:27.166956 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc586d82-8798-4810-916e-8e333ff847aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:27.168605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc586d82-8798-4810-916e-8e333ff847aa None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:27.212273 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 484/962] 10.222.0.46 () {56 vars in 1101 bytes} [Wed Jun 22 10:00:27 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:27.218906 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94dfed-0a05-499f-8b8e-11ac0492c12a None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:27.219213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94dfed-0a05-499f-8b8e-11ac0492c12a None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:27.219466 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94dfed-0a05-499f-8b8e-11ac0492c12a None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:27.221325 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 479/963] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:27.232952 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbebe52-1b98-41a3-b465-a6f0f9935b21 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:27.233397 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbebe52-1b98-41a3-b465-a6f0f9935b21 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:27.233786 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbebe52-1b98-41a3-b465-a6f0f9935b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:27.257539 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-1cbebe52-1b98-41a3-b465-a6f0f9935b21 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:27.259057 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-1cbebe52-1b98-41a3-b465-a6f0f9935b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:27.338940 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 485/964] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:00:27.362457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94dfed-0a05-499f-8b8e-11ac0492c12a None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:27.384781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:27.477643 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94dfed-0a05-499f-8b8e-11ac0492c12a None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:27.520199 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ab718-aaab-4479-90f9-ce8012b77833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:27.521380 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ab718-aaab-4479-90f9-ce8012b77833 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:27.521866 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ab718-aaab-4479-90f9-ce8012b77833 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:27.522341 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ab718-aaab-4479-90f9-ce8012b77833 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:27.523277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ab718-aaab-4479-90f9-ce8012b77833 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:27.524874 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ab718-aaab-4479-90f9-ce8012b77833 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:27.537769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-119ab718-aaab-4479-90f9-ce8012b77833 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:00:27.537769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:27.537769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:00:27.537769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:00:27.537769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:00:27.537769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:00:27.537769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:00:27.537769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:27.537769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:00:27.537769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:27.537769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:00:27.537769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:27.537769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:27.537769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:27.537769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:27.537769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:27.537769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:27.538970 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:27.538970 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:27.538970 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:27.538970 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:27.538970 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:27.538970 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:27.538970 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:00:27.538970 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:00:27.538970 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:00:27.538970 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:00:27.538970 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:27.538970 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:27.538970 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:27.538970 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:27.538970 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:27.538970 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:27.539817 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:27.539817 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:27.539817 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:27.539817 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:27.539817 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:27.539817 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:27.539817 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:27.539817 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:27.539817 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:27.539817 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:27.539817 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:00:27.539817 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:27.539817 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:00:27.539817 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:27.542458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 480/965] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Jun 22 10:00:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:27.549203 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbebe52-1b98-41a3-b465-a6f0f9935b21 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:27.616291 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:27.651782 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbebe52-1b98-41a3-b465-a6f0f9935b21 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:27.695104 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859c92e-988b-4f2f-b100-dd866bc45536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:27.695772 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859c92e-988b-4f2f-b100-dd866bc45536 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:27.696052 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859c92e-988b-4f2f-b100-dd866bc45536 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:27.696323 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859c92e-988b-4f2f-b100-dd866bc45536 None admin] PATH_INFO: `/v3/services` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:27.697060 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859c92e-988b-4f2f-b100-dd866bc45536 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:27.697364 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859c92e-988b-4f2f-b100-dd866bc45536 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:27.698716 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859c92e-988b-4f2f-b100-dd866bc45536 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:27.704179 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 486/966] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Jun 22 10:00:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:27.709721 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ab718-aaab-4479-90f9-ce8012b77833 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:27.798128 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:27.818661 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ab718-aaab-4479-90f9-ce8012b77833 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:27.829384 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5aed3-83d4-4082-a75e-e7442597a4ca None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:27.830253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5aed3-83d4-4082-a75e-e7442597a4ca None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:27.830543 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5aed3-83d4-4082-a75e-e7442597a4ca None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:27.831920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 487/967] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:00:27.836905 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b0042-67de-43aa-8a9e-4caec14b610b None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:27.837200 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b0042-67de-43aa-8a9e-4caec14b610b None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:27.837489 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b0042-67de-43aa-8a9e-4caec14b610b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:27.854519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-890b0042-67de-43aa-8a9e-4caec14b610b None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:27.855707 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-890b0042-67de-43aa-8a9e-4caec14b610b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:27.856009 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c7d51-f25a-4144-9680-d532d5aa9bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:27.856675 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c7d51-f25a-4144-9680-d532d5aa9bdc None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:27.856983 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c7d51-f25a-4144-9680-d532d5aa9bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:27.857255 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c7d51-f25a-4144-9680-d532d5aa9bdc None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:27.857977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c7d51-f25a-4144-9680-d532d5aa9bdc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:27.858266 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c7d51-f25a-4144-9680-d532d5aa9bdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:27.859627 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c7d51-f25a-4144-9680-d532d5aa9bdc None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:27.865816 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 481/968] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Jun 22 10:00:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:27.871281 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c7d51-f25a-4144-9680-d532d5aa9bdc None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:27.933207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 488/969] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:00:27.957607 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fd6cd-69cd-43b6-82bc-302a84df6419 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:27.957941 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fd6cd-69cd-43b6-82bc-302a84df6419 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:27.958196 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fd6cd-69cd-43b6-82bc-302a84df6419 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:27.959645 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 489/970] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:00:27.965142 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b33a55-fca6-4f67-b3e2-ba5b5a5c6959 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:27.965697 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b33a55-fca6-4f67-b3e2-ba5b5a5c6959 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:27.966213 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b33a55-fca6-4f67-b3e2-ba5b5a5c6959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:27.979872 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c7d51-f25a-4144-9680-d532d5aa9bdc None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:27.985886 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-00b33a55-fca6-4f67-b3e2-ba5b5a5c6959 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:27.987392 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-00b33a55-fca6-4f67-b3e2-ba5b5a5c6959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:28.016419 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705df4dd-bd3d-47a7-a181-6719bdb68814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:28.017142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705df4dd-bd3d-47a7-a181-6719bdb68814 None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:28.017944 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705df4dd-bd3d-47a7-a181-6719bdb68814 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:28.018231 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705df4dd-bd3d-47a7-a181-6719bdb68814 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:28.018979 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705df4dd-bd3d-47a7-a181-6719bdb68814 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:28.020346 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705df4dd-bd3d-47a7-a181-6719bdb68814 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:28.044225 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:28.055502 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 490/971] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:00:28.056260 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b33a55-fca6-4f67-b3e2-ba5b5a5c6959 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:28.097280 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:28.102861 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 482/972] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Jun 22 10:00:27 2022] POST /identity/v3/endpoints => generated 349 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:00:28.103668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705df4dd-bd3d-47a7-a181-6719bdb68814 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:28.169441 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b33a55-fca6-4f67-b3e2-ba5b5a5c6959 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:28.216244 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6028e7-e2b5-4dae-a25d-4501c52cd084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:28.217123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6028e7-e2b5-4dae-a25d-4501c52cd084 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:28.219083 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6028e7-e2b5-4dae-a25d-4501c52cd084 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:28.220028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6028e7-e2b5-4dae-a25d-4501c52cd084 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:28.234099 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6028e7-e2b5-4dae-a25d-4501c52cd084 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:00:28.241499 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705df4dd-bd3d-47a7-a181-6719bdb68814 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:28.243646 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-aa6028e7-e2b5-4dae-a25d-4501c52cd084 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:00:28.243646 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:28.243646 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:28.243646 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:28.243646 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:28.243646 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:28.243646 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:28.243646 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:28.243646 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:28.243646 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:28.243646 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:28.243646 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:28.243646 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:00:28.243646 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:00:28.243646 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:00:28.243646 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:00:28.244619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:00:28.244619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:00:28.244619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:00:28.244619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:00:28.244619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:28.244619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:28.244619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:28.244619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:28.244619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:28.244619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:28.244619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:28.244619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:28.244619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:28.244619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:28.244619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:28.244619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:28.245513 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:28.245513 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:28.245513 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:28.245513 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:28.245513 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:00:28.245513 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:00:28.245513 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:00:28.245513 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:00:28.245513 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:00:28.245513 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:00:28.245513 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:00:28.245513 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:28.254334 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 491/973] 10.222.0.46 () {56 vars in 1120 bytes} [Wed Jun 22 10:00:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:28.255707 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6028e7-e2b5-4dae-a25d-4501c52cd084 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:28.286249 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7bc728-304f-48c2-b4fa-aed5d946a575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:28.287111 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bc728-304f-48c2-b4fa-aed5d946a575 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:28.287395 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bc728-304f-48c2-b4fa-aed5d946a575 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:28.287698 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bc728-304f-48c2-b4fa-aed5d946a575 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:28.288366 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7bc728-304f-48c2-b4fa-aed5d946a575 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:28.289780 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7bc728-304f-48c2-b4fa-aed5d946a575 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:28.302141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-7a7bc728-304f-48c2-b4fa-aed5d946a575 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 10:00:28.302141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:28.302141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:00:28.302141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:00:28.302141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:00:28.302141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:00:28.302141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:00:28.302141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:28.302141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 10:00:28.302141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:28.302141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:00:28.302141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:28.302141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:28.302141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:28.302141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:28.302141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:28.302141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:28.303187 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:28.303187 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:28.303187 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:28.303187 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:28.303187 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:28.303187 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:28.303187 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:00:28.303187 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:00:28.303187 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:00:28.303187 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:00:28.303187 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:28.303187 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:28.303187 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:28.303187 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:28.303187 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:28.303187 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:28.304032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:28.304032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:28.304032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:28.304032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:28.304032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:28.304032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:28.304032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:28.304032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:28.304032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:28.304032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:28.304032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:00:28.304032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:28.304032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 10:00:28.304032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:28.308954 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 483/974] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 10:00:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:28.313097 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7bc728-304f-48c2-b4fa-aed5d946a575 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:28.319636 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:28.381711 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6028e7-e2b5-4dae-a25d-4501c52cd084 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:28.387156 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:28.427359 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb817100-855c-4d3a-b56b-5f4a66e5c0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:28.428059 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb817100-855c-4d3a-b56b-5f4a66e5c0f5 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:28.428338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb817100-855c-4d3a-b56b-5f4a66e5c0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:28.428610 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb817100-855c-4d3a-b56b-5f4a66e5c0f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:28.429419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb817100-855c-4d3a-b56b-5f4a66e5c0f5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:28.429727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb817100-855c-4d3a-b56b-5f4a66e5c0f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:28.431790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb817100-855c-4d3a-b56b-5f4a66e5c0f5 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:28.434316 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7bc728-304f-48c2-b4fa-aed5d946a575 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:28.441948 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 492/975] 10.222.0.46 () {56 vars in 1115 bytes} [Wed Jun 22 10:00:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:00:28.447970 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb817100-855c-4d3a-b56b-5f4a66e5c0f5 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:28.474257 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61537422-e94d-4456-a6a6-bbb85d61d46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:28.475226 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61537422-e94d-4456-a6a6-bbb85d61d46d None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:28.475516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61537422-e94d-4456-a6a6-bbb85d61d46d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:28.475793 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61537422-e94d-4456-a6a6-bbb85d61d46d None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:28.476512 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61537422-e94d-4456-a6a6-bbb85d61d46d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:28.476845 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61537422-e94d-4456-a6a6-bbb85d61d46d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:28.478243 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61537422-e94d-4456-a6a6-bbb85d61d46d None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:28.484955 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 484/976] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Jun 22 10:00:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:00:28.491298 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61537422-e94d-4456-a6a6-bbb85d61d46d None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:28.567984 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb817100-855c-4d3a-b56b-5f4a66e5c0f5 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:28.579489 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:28.609101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61537422-e94d-4456-a6a6-bbb85d61d46d None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:28.611934 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0313a-df43-4a82-a546-8d7a2511b1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:28.613879 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0313a-df43-4a82-a546-8d7a2511b1ae None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:28.614176 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0313a-df43-4a82-a546-8d7a2511b1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:28.614459 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0313a-df43-4a82-a546-8d7a2511b1ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:28.626123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0313a-df43-4a82-a546-8d7a2511b1ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:28.628201 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0313a-df43-4a82-a546-8d7a2511b1ae None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:28.641911 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:28.650056 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-ffd0313a-df43-4a82-a546-8d7a2511b1ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:28.650056 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:28.650056 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:28.650056 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:28.650056 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:28.650056 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:28.650056 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:28.650056 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:28.650056 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:28.650056 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:28.650056 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:28.650056 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:28.650056 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:00:28.650056 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:00:28.650056 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:00:28.657063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:00:28.657063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:28.657063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:28.657063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:28.657063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:28.657063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:28.657063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:28.657063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:28.657063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:28.657063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:28.657063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:28.657063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:28.657063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:28.657063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:28.657063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:28.657063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:28.657063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:28.658666 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:00:28.658666 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:00:28.658666 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:28.658666 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:28.658942 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883177d2-79ea-4a3e-b296-5296299c7d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:28.659044 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 493/977] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:00:28.659125 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883177d2-79ea-4a3e-b296-5296299c7d82 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:28.659125 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883177d2-79ea-4a3e-b296-5296299c7d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:28.659125 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883177d2-79ea-4a3e-b296-5296299c7d82 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:28.659125 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883177d2-79ea-4a3e-b296-5296299c7d82 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:28.659125 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883177d2-79ea-4a3e-b296-5296299c7d82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:28.659125 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883177d2-79ea-4a3e-b296-5296299c7d82 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:28.660417 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0313a-df43-4a82-a546-8d7a2511b1ae None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:28.668039 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 485/978] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Jun 22 10:00:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:00:28.673169 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883177d2-79ea-4a3e-b296-5296299c7d82 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:28.789204 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0313a-df43-4a82-a546-8d7a2511b1ae None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:28.790433 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883177d2-79ea-4a3e-b296-5296299c7d82 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:28.827472 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d0aeb-3ea3-4712-ad0e-426fdbc5a6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:28.828056 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d0aeb-3ea3-4712-ad0e-426fdbc5a6b1 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:28.828339 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d0aeb-3ea3-4712-ad0e-426fdbc5a6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:28.828615 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d0aeb-3ea3-4712-ad0e-426fdbc5a6b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:28.829209 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560703da-fc6f-453a-a84a-77e55a401ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:28.830075 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d0aeb-3ea3-4712-ad0e-426fdbc5a6b1 None admin] RBAC: Adding query filter params (interface=public, service_id=dabf3048dae34f1fa378eac6df0b97c6, region_id=RegionOne) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:28.830350 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d0aeb-3ea3-4712-ad0e-426fdbc5a6b1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:28.830456 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560703da-fc6f-453a-a84a-77e55a401ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:28.830710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560703da-fc6f-453a-a84a-77e55a401ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:28.830961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560703da-fc6f-453a-a84a-77e55a401ed9 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:28.831687 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560703da-fc6f-453a-a84a-77e55a401ed9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:28.831797 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d0aeb-3ea3-4712-ad0e-426fdbc5a6b1 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:28.832002 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560703da-fc6f-453a-a84a-77e55a401ed9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:28.833504 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560703da-fc6f-453a-a84a-77e55a401ed9 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:28.837186 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 486/979] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Jun 22 10:00:28 2022] GET /identity/v3/endpoints?service_id=dabf3048dae34f1fa378eac6df0b97c6&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:00:28.842359 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d0aeb-3ea3-4712-ad0e-426fdbc5a6b1 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:28.846943 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 494/980] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:28.852279 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560703da-fc6f-453a-a84a-77e55a401ed9 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:28.874676 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:28.906639 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:28.955578 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d0aeb-3ea3-4712-ad0e-426fdbc5a6b1 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:28.989468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd36f8a-9487-4724-90e8-e89a5b524058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:28.990132 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd36f8a-9487-4724-90e8-e89a5b524058 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:28.990417 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd36f8a-9487-4724-90e8-e89a5b524058 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:28.990692 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd36f8a-9487-4724-90e8-e89a5b524058 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:28.991364 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd36f8a-9487-4724-90e8-e89a5b524058 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:28.992724 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd36f8a-9487-4724-90e8-e89a5b524058 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:28.995576 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560703da-fc6f-453a-a84a-77e55a401ed9 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:28.999096 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 487/981] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Jun 22 10:00:28 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:00:29.062088 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daebdea-6696-41ab-8b06-40bc12ffc5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:29.063500 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daebdea-6696-41ab-8b06-40bc12ffc5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:29.064565 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daebdea-6696-41ab-8b06-40bc12ffc5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:29.065100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daebdea-6696-41ab-8b06-40bc12ffc5f2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:29.079836 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daebdea-6696-41ab-8b06-40bc12ffc5f2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:29.082659 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daebdea-6696-41ab-8b06-40bc12ffc5f2 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:29.113962 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-5daebdea-6696-41ab-8b06-40bc12ffc5f2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:00:29.113962 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:29.113962 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:29.113962 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:29.113962 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:29.113962 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:29.113962 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:29.113962 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:29.113962 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:29.113962 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:29.113962 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:29.113962 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:29.113962 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:00:29.113962 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:00:29.113962 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:00:29.113962 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:00:29.115004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:29.115004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:29.115004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:00:29.115004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:00:29.115004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:00:29.115004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:00:29.115004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:29.115004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:29.115004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:29.115004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:29.115004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:29.115004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:29.115004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:29.115004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:29.115004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:29.115004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:29.115004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:29.115004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:29.115944 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:29.115944 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:29.115944 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:00:29.115944 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:00:29.115944 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:00:29.115944 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:00:29.115944 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:00:29.115944 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:00:29.115944 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:00:29.115944 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:29.121170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 495/982] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Jun 22 10:00:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:00:29.125072 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd36f8a-9487-4724-90e8-e89a5b524058 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:29.239698 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd36f8a-9487-4724-90e8-e89a5b524058 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:29.261025 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:29.275679 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b19b0-13d9-4cb2-880e-0036dced2657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:29.276508 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b19b0-13d9-4cb2-880e-0036dced2657 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:29.276804 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b19b0-13d9-4cb2-880e-0036dced2657 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:29.277114 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b19b0-13d9-4cb2-880e-0036dced2657 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:29.277957 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b19b0-13d9-4cb2-880e-0036dced2657 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:29.278271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b19b0-13d9-4cb2-880e-0036dced2657 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:29.279765 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b19b0-13d9-4cb2-880e-0036dced2657 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:29.302491 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 488/983] 10.222.0.46 () {56 vars in 1149 bytes} [Wed Jun 22 10:00:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:29.304076 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daebdea-6696-41ab-8b06-40bc12ffc5f2 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:29.396079 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:29.416336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daebdea-6696-41ab-8b06-40bc12ffc5f2 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:29.452830 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95923730-f589-44e7-9901-7b608e890a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:29.453493 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95923730-f589-44e7-9901-7b608e890a24 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:29.453773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95923730-f589-44e7-9901-7b608e890a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:29.454048 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95923730-f589-44e7-9901-7b608e890a24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:29.524612 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95923730-f589-44e7-9901-7b608e890a24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:29.526090 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95923730-f589-44e7-9901-7b608e890a24 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:29.603801 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:29.624758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 496/984] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 10:00:29 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 10:00:29.630925 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b19b0-13d9-4cb2-880e-0036dced2657 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:29.740836 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b19b0-13d9-4cb2-880e-0036dced2657 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:29.775404 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ff6c1-a307-4433-a25f-bf8acf464d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:29.776166 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ff6c1-a307-4433-a25f-bf8acf464d47 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:29.776443 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ff6c1-a307-4433-a25f-bf8acf464d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:29.776714 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ff6c1-a307-4433-a25f-bf8acf464d47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:29.787560 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ff6c1-a307-4433-a25f-bf8acf464d47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:29.789024 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ff6c1-a307-4433-a25f-bf8acf464d47 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:29.806412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-501ff6c1-a307-4433-a25f-bf8acf464d47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:29.806412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:29.806412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:29.806412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:29.806412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:29.806412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:29.806412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:29.806412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:29.806412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:29.806412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:29.806412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:29.806412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:29.806412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:00:29.806412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:00:29.806412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:00:29.807346 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:00:29.807346 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:29.807346 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:29.807346 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:29.807346 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:29.807346 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:29.807346 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:29.807346 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:29.807346 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:29.807346 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:29.807346 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:29.807346 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:29.807346 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:29.807346 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:29.807346 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:29.807346 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:29.807346 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:29.808252 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:00:29.808252 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:00:29.808252 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:29.808252 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:29.809123 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 489/985] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:29.813540 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95923730-f589-44e7-9901-7b608e890a24 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:29.914528 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95923730-f589-44e7-9901-7b608e890a24 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:29.948209 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c5f23-75aa-4905-a845-a1f419824493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:29.948842 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c5f23-75aa-4905-a845-a1f419824493 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:29.949117 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c5f23-75aa-4905-a845-a1f419824493 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:29.949392 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c5f23-75aa-4905-a845-a1f419824493 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:29.950112 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c5f23-75aa-4905-a845-a1f419824493 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:29.950421 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c5f23-75aa-4905-a845-a1f419824493 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:29.952063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c5f23-75aa-4905-a845-a1f419824493 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:29.964314 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 497/986] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:00:29.969699 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ff6c1-a307-4433-a25f-bf8acf464d47 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:30.000433 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:30.072239 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ff6c1-a307-4433-a25f-bf8acf464d47 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:30.110297 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20288f-1bd9-4ed8-9e77-fec7ddfefb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:30.111279 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20288f-1bd9-4ed8-9e77-fec7ddfefb20 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:30.111562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20288f-1bd9-4ed8-9e77-fec7ddfefb20 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:30.111835 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20288f-1bd9-4ed8-9e77-fec7ddfefb20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:30.120162 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20288f-1bd9-4ed8-9e77-fec7ddfefb20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:30.121678 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20288f-1bd9-4ed8-9e77-fec7ddfefb20 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:30.136939 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-5e20288f-1bd9-4ed8-9e77-fec7ddfefb20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:00:30.136939 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:30.136939 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:30.136939 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:30.136939 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:30.136939 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:30.136939 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:30.136939 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:30.136939 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:30.136939 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:30.136939 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:30.136939 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:30.136939 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:00:30.136939 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:00:30.136939 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:00:30.138065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:00:30.138065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:30.138065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:30.138065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:30.138065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:30.138065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:30.138065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:30.138065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:30.138065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:30.138065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:30.138065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:30.138065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:30.138065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:30.138065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:30.138065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:30.138065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:30.138065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:30.138964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:00:30.138964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:00:30.138964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:00:30.138964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:00:30.138964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:00:30.138964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:00:30.138964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:00:30.138964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:30.141148 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 490/987] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 10:00:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:30.144522 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c5f23-75aa-4905-a845-a1f419824493 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:30.188121 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:30.246395 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c5f23-75aa-4905-a845-a1f419824493 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:30.280643 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1abbf6-fae4-4681-83e3-18ac9d48252c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:30.281386 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1abbf6-fae4-4681-83e3-18ac9d48252c None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:30.281704 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1abbf6-fae4-4681-83e3-18ac9d48252c None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:30.281980 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1abbf6-fae4-4681-83e3-18ac9d48252c None admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:30.283404 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1abbf6-fae4-4681-83e3-18ac9d48252c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:30.283774 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1abbf6-fae4-4681-83e3-18ac9d48252c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:30.285222 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1abbf6-fae4-4681-83e3-18ac9d48252c None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:30.297819 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 498/988] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 10:00:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:00:30.304171 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20288f-1bd9-4ed8-9e77-fec7ddfefb20 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:30.366748 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe454b-20f6-4bb1-a66a-05567597b12f None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:30.367170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe454b-20f6-4bb1-a66a-05567597b12f None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:30.367456 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe454b-20f6-4bb1-a66a-05567597b12f None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:30.368995 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 499/989] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:30.376355 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7152cd-594d-40a4-a40d-c175dc98457b None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:30.376355 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7152cd-594d-40a4-a40d-c175dc98457b None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:30.376355 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7152cd-594d-40a4-a40d-c175dc98457b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:30.396355 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-cd7152cd-594d-40a4-a40d-c175dc98457b None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:30.397664 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-cd7152cd-594d-40a4-a40d-c175dc98457b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:30.404771 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:30.415657 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20288f-1bd9-4ed8-9e77-fec7ddfefb20 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:30.453027 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df02645-985b-4832-ad09-0ad810d93e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:30.453682 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df02645-985b-4832-ad09-0ad810d93e07 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:30.453967 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df02645-985b-4832-ad09-0ad810d93e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:30.454238 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df02645-985b-4832-ad09-0ad810d93e07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:30.455586 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df02645-985b-4832-ad09-0ad810d93e07 None admin] RBAC: Adding query filter params (role.id=263cc0eba7e54b5ab2d884bfb15f6a93, scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9, user.id=7b4d3b1fe8064cc592d89e7bab91bace) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:30.455894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df02645-985b-4832-ad09-0ad810d93e07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:30.457374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df02645-985b-4832-ad09-0ad810d93e07 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:30.463823 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 491/990] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 10:00:30 2022] GET /identity/v3/role_assignments?user.id=7b4d3b1fe8064cc592d89e7bab91bace&scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9&role.id=263cc0eba7e54b5ab2d884bfb15f6a93 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:00:30.470800 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 500/991] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:00:30.493695 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df02645-985b-4832-ad09-0ad810d93e07 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:30.606668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df02645-985b-4832-ad09-0ad810d93e07 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:30.642588 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6118627-06d7-44e0-93ff-71bcea049a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:30.643395 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6118627-06d7-44e0-93ff-71bcea049a88 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:30.643681 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6118627-06d7-44e0-93ff-71bcea049a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:30.643947 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6118627-06d7-44e0-93ff-71bcea049a88 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:30.644596 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6118627-06d7-44e0-93ff-71bcea049a88 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:30.645995 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6118627-06d7-44e0-93ff-71bcea049a88 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:30.659400 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-e6118627-06d7-44e0-93ff-71bcea049a88 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:00:30.659400 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:30.659400 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:00:30.659400 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:00:30.659400 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:00:30.659400 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:00:30.659400 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:00:30.659400 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:30.659400 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:00:30.659400 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:30.659400 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:00:30.659400 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:30.659400 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:30.659400 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:30.659400 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:30.659400 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:30.659400 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:30.660526 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:30.660526 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:30.660526 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:30.660526 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:30.660526 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:30.660526 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:30.660526 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:00:30.660526 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:00:30.660526 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:00:30.660526 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:00:30.660526 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:30.660526 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:30.660526 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:30.660526 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:30.660526 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:30.660526 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:30.661412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:30.661412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:30.661412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:30.661412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:30.661412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:30.661412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:30.661412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:30.661412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:30.661412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:30.661412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:30.661412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:00:30.661412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:30.661412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:00:30.661412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:30.661412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 492/992] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Jun 22 10:00:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:30.666629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7152cd-594d-40a4-a40d-c175dc98457b None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:30.706305 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:30.778657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7152cd-594d-40a4-a40d-c175dc98457b None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:30.812629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cf414-0527-4815-9d36-9e9affa8149b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:30.813334 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cf414-0527-4815-9d36-9e9affa8149b None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:30.813622 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cf414-0527-4815-9d36-9e9affa8149b None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:30.814401 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cf414-0527-4815-9d36-9e9affa8149b None admin] PATH_INFO: `/v3/services` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:30.815111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17cf414-0527-4815-9d36-9e9affa8149b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:30.815425 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17cf414-0527-4815-9d36-9e9affa8149b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:30.816789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17cf414-0527-4815-9d36-9e9affa8149b None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:30.826718 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 501/993] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Jun 22 10:00:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:30.827997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6118627-06d7-44e0-93ff-71bcea049a88 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:30.849658 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:30.933092 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6118627-06d7-44e0-93ff-71bcea049a88 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:30.972519 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3a530-a4b1-4658-853e-56766e09abfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:30.973227 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3a530-a4b1-4658-853e-56766e09abfe None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:30.984886 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3a530-a4b1-4658-853e-56766e09abfe None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:30.984886 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3a530-a4b1-4658-853e-56766e09abfe None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:30.984886 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3a530-a4b1-4658-853e-56766e09abfe None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:30.984886 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3a530-a4b1-4658-853e-56766e09abfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:30.984886 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3a530-a4b1-4658-853e-56766e09abfe None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:30.984886 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 493/994] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Jun 22 10:00:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:30.987598 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cf414-0527-4815-9d36-9e9affa8149b None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:31.056605 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e1fac-d6e3-4a2d-99d6-a6f2f2069110 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:31.056959 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e1fac-d6e3-4a2d-99d6-a6f2f2069110 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:31.057192 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e1fac-d6e3-4a2d-99d6-a6f2f2069110 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:31.058742 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 494/995] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:00:31.065255 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e5849-c720-41c9-9fc4-9c75502c5dfe None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:31.065542 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e5849-c720-41c9-9fc4-9c75502c5dfe None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:31.065819 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e5849-c720-41c9-9fc4-9c75502c5dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:31.083467 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-1a1e5849-c720-41c9-9fc4-9c75502c5dfe None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:31.084667 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-1a1e5849-c720-41c9-9fc4-9c75502c5dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:31.090400 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:31.098705 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cf414-0527-4815-9d36-9e9affa8149b None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:31.135740 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190d4b9-d997-4a23-b791-4c2e221943fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:31.136405 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190d4b9-d997-4a23-b791-4c2e221943fe None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:31.136692 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190d4b9-d997-4a23-b791-4c2e221943fe None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:31.137011 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190d4b9-d997-4a23-b791-4c2e221943fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:31.137819 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190d4b9-d997-4a23-b791-4c2e221943fe None admin] RBAC: Adding query filter params (interface=admin, service_id=8cd0a0e9b7344f679e1fc6941bfcd48b, region_id=RegionOne) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:31.138140 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190d4b9-d997-4a23-b791-4c2e221943fe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:31.139698 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190d4b9-d997-4a23-b791-4c2e221943fe None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:31.145100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 502/996] 10.222.0.46 () {56 vars in 1249 bytes} [Wed Jun 22 10:00:30 2022] GET /identity/v3/endpoints?service_id=8cd0a0e9b7344f679e1fc6941bfcd48b&interface=admin®ion_id=RegionOne => generated 193 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:31.150540 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190d4b9-d997-4a23-b791-4c2e221943fe None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:31.163416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 495/997] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:00:31.187717 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e5849-c720-41c9-9fc4-9c75502c5dfe None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:31.204555 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:31.263709 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190d4b9-d997-4a23-b791-4c2e221943fe None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:31.292661 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e5849-c720-41c9-9fc4-9c75502c5dfe None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:31.301149 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55624619-8222-41d2-a0a4-d18b9ab90a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:31.302008 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55624619-8222-41d2-a0a4-d18b9ab90a84 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:31.302772 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55624619-8222-41d2-a0a4-d18b9ab90a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:31.303203 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55624619-8222-41d2-a0a4-d18b9ab90a84 None admin] PATH_INFO: `/v3/services` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:31.304520 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55624619-8222-41d2-a0a4-d18b9ab90a84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:31.306325 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55624619-8222-41d2-a0a4-d18b9ab90a84 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:31.320859 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 503/998] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Jun 22 10:00:31 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:00:31.338369 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56761b6-0156-423c-ba22-cfd7b7027916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:31.339351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56761b6-0156-423c-ba22-cfd7b7027916 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:31.339761 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56761b6-0156-423c-ba22-cfd7b7027916 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:31.340134 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56761b6-0156-423c-ba22-cfd7b7027916 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:31.340956 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56761b6-0156-423c-ba22-cfd7b7027916 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:31.342481 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56761b6-0156-423c-ba22-cfd7b7027916 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:31.356428 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-f56761b6-0156-423c-ba22-cfd7b7027916 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 10:00:31.356428 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:31.356428 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:00:31.356428 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:00:31.356428 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:00:31.356428 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:00:31.356428 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:00:31.356428 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:31.356428 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 10:00:31.356428 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:31.356428 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:00:31.356428 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:31.356428 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:31.356428 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:31.356428 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:31.356428 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:31.356428 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:31.357806 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:31.357806 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:31.357806 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:31.357806 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:31.357806 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:31.357806 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:31.357806 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:00:31.357806 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:00:31.357806 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:00:31.357806 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:00:31.357806 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:31.357806 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:31.357806 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:31.357806 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:31.357806 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:31.357806 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:31.358964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:31.358964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:31.358964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:31.358964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:31.358964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:31.358964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:31.358964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:31.358964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:31.358964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:31.358964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:31.358964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:00:31.358964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:31.358964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 10:00:31.358964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:31.360866 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 496/999] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 10:00:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:00:31.366888 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55624619-8222-41d2-a0a4-d18b9ab90a84 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:31.394566 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:31.478708 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55624619-8222-41d2-a0a4-d18b9ab90a84 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:31.513846 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3aac9-0967-4b54-9de0-f2466a7c7df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:31.514513 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3aac9-0967-4b54-9de0-f2466a7c7df5 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:31.514793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3aac9-0967-4b54-9de0-f2466a7c7df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:31.515072 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3aac9-0967-4b54-9de0-f2466a7c7df5 None admin] PATH_INFO: `/v3/services` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:31.515778 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3aac9-0967-4b54-9de0-f2466a7c7df5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:31.516086 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3aac9-0967-4b54-9de0-f2466a7c7df5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:31.518086 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3aac9-0967-4b54-9de0-f2466a7c7df5 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:31.523276 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 504/1000] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Jun 22 10:00:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:31.528851 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56761b6-0156-423c-ba22-cfd7b7027916 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:31.611018 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:31.636298 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56761b6-0156-423c-ba22-cfd7b7027916 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:31.676379 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc820ef0-696f-4024-8633-81612040a319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:31.677223 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc820ef0-696f-4024-8633-81612040a319 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:31.677513 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc820ef0-696f-4024-8633-81612040a319 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:31.677792 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc820ef0-696f-4024-8633-81612040a319 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:31.678545 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc820ef0-696f-4024-8633-81612040a319 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:31.680956 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc820ef0-696f-4024-8633-81612040a319 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:31.680956 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc820ef0-696f-4024-8633-81612040a319 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:31.686433 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 497/1001] 10.222.0.46 () {56 vars in 1112 bytes} [Wed Jun 22 10:00:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:31.693221 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3aac9-0967-4b54-9de0-f2466a7c7df5 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:31.781714 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:31.798766 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3aac9-0967-4b54-9de0-f2466a7c7df5 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:31.834768 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b018a6b-d7b8-4732-a9ab-23f00caf40fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:31.835431 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b018a6b-d7b8-4732-a9ab-23f00caf40fd None admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:31.835716 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b018a6b-d7b8-4732-a9ab-23f00caf40fd None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:31.835992 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b018a6b-d7b8-4732-a9ab-23f00caf40fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:31.836746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b018a6b-d7b8-4732-a9ab-23f00caf40fd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:31.838136 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b018a6b-d7b8-4732-a9ab-23f00caf40fd None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:31.916105 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 505/1002] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Jun 22 10:00:31 2022] POST /identity/v3/endpoints => generated 334 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:00:32.552308 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4ad17-93c9-4dd2-892e-5801f18e0a66 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:32.552848 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4ad17-93c9-4dd2-892e-5801f18e0a66 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:32.552848 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4ad17-93c9-4dd2-892e-5801f18e0a66 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:32.554378 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 498/1003] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:32.559267 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f851de-b87a-4fb0-9dfa-79542c7a738a None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:32.559565 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f851de-b87a-4fb0-9dfa-79542c7a738a None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:32.559844 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f851de-b87a-4fb0-9dfa-79542c7a738a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:32.577282 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-b7f851de-b87a-4fb0-9dfa-79542c7a738a None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:32.578454 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-b7f851de-b87a-4fb0-9dfa-79542c7a738a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:32.653516 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 506/1004] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:32 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:00:32.676960 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4ad17-93c9-4dd2-892e-5801f18e0a66 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:32.787601 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4ad17-93c9-4dd2-892e-5801f18e0a66 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:32.821453 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa95471-ebcb-4a47-9434-229e6b54ca07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:32.822177 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa95471-ebcb-4a47-9434-229e6b54ca07 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:32.822461 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa95471-ebcb-4a47-9434-229e6b54ca07 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:32.822738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa95471-ebcb-4a47-9434-229e6b54ca07 None admin] PATH_INFO: `/v3/services/image` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:32.823464 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa95471-ebcb-4a47-9434-229e6b54ca07 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:32.824893 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa95471-ebcb-4a47-9434-229e6b54ca07 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:32.838206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-2fa95471-ebcb-4a47-9434-229e6b54ca07 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 10:00:32.838206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:32.838206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:00:32.838206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:00:32.838206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:00:32.838206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:00:32.838206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:00:32.838206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:32.838206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 10:00:32.838206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:32.838206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:00:32.838206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:32.838206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:32.838206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:32.838206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:32.838206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:32.838206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:32.839320 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:32.839320 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:32.839320 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:32.839320 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:32.839320 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:32.839320 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:32.839320 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:00:32.839320 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:00:32.839320 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:00:32.839320 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:00:32.839320 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:32.839320 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:32.839320 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:32.839320 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:32.839320 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:32.839320 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:32.840162 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:32.840162 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:32.840162 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:32.840162 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:32.840162 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:32.840162 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:32.840162 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:32.840162 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:32.840162 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:32.840162 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:32.840162 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:00:32.840162 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:32.840162 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 10:00:32.840162 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:32.841696 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 499/1005] 10.222.0.46 () {56 vars in 1105 bytes} [Wed Jun 22 10:00:32 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:32.845944 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f851de-b87a-4fb0-9dfa-79542c7a738a None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:32.914765 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:32.951574 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f851de-b87a-4fb0-9dfa-79542c7a738a None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:32.990819 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e8245-24c0-444c-aec6-17357cfd715c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:32.991508 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e8245-24c0-444c-aec6-17357cfd715c None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:32.991789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e8245-24c0-444c-aec6-17357cfd715c None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:32.992066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e8245-24c0-444c-aec6-17357cfd715c None admin] PATH_INFO: `/v3/services` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:32.992788 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e8245-24c0-444c-aec6-17357cfd715c None admin] RBAC: Adding query filter params (name=image) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:32.993130 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e8245-24c0-444c-aec6-17357cfd715c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:32.994507 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e8245-24c0-444c-aec6-17357cfd715c None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:33.004849 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 507/1006] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:00:33.006091 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa95471-ebcb-4a47-9434-229e6b54ca07 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:33.010247 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:33.110957 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa95471-ebcb-4a47-9434-229e6b54ca07 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:33.147362 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b5fb1-e8f8-49ee-8bc8-e316fe481fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:33.148027 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b5fb1-e8f8-49ee-8bc8-e316fe481fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:33.148306 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b5fb1-e8f8-49ee-8bc8-e316fe481fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:33.148579 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b5fb1-e8f8-49ee-8bc8-e316fe481fd9 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:33.149312 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b5fb1-e8f8-49ee-8bc8-e316fe481fd9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:33.149619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b5fb1-e8f8-49ee-8bc8-e316fe481fd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:33.151093 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b5fb1-e8f8-49ee-8bc8-e316fe481fd9 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:33.155607 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 500/1007] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:33 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:33.405366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580b984-230e-48fe-9d40-8e83e707a313 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:33.405724 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580b984-230e-48fe-9d40-8e83e707a313 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:33.405923 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580b984-230e-48fe-9d40-8e83e707a313 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:33.407271 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 508/1008] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:33.412617 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd65db3-aab9-4bb0-9665-3cfc76e36d85 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:33.412969 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd65db3-aab9-4bb0-9665-3cfc76e36d85 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:33.413258 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd65db3-aab9-4bb0-9665-3cfc76e36d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:33.430648 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-3dd65db3-aab9-4bb0-9665-3cfc76e36d85 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:33.431837 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-3dd65db3-aab9-4bb0-9665-3cfc76e36d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:33.497953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:33.504324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 501/1009] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:33 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:00:33.527490 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580b984-230e-48fe-9d40-8e83e707a313 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:33.642585 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580b984-230e-48fe-9d40-8e83e707a313 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:33.675354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:33.680856 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b9d2e-70f2-4380-ac38-df0e7950934c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:33.684241 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b9d2e-70f2-4380-ac38-df0e7950934c None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:33.684241 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b9d2e-70f2-4380-ac38-df0e7950934c None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:33.684241 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b9d2e-70f2-4380-ac38-df0e7950934c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:33.684241 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b9d2e-70f2-4380-ac38-df0e7950934c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:33.684241 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b9d2e-70f2-4380-ac38-df0e7950934c None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:33.697723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-de7b9d2e-70f2-4380-ac38-df0e7950934c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:00:33.697723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:33.697723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:00:33.697723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:00:33.697723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:00:33.697723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:00:33.697723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:00:33.697723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:33.697723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:00:33.697723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:33.697723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:00:33.697723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:33.697723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:33.697723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:33.697723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:33.697723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:33.697723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:33.698744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:33.698744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:33.698744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:33.698744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:33.698744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:33.698744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:33.698744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:00:33.698744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:00:33.698744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:00:33.698744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:00:33.698744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:33.698744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:33.698744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:33.698744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:33.698744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:33.698744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:33.705157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:33.705157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:33.705157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:33.705157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:33.705157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:33.705157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:33.705157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:33.705157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:33.705157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:33.705157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:33.705157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:00:33.705157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:33.705157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:00:33.705157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:33.705157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 509/1010] 10.222.0.46 () {56 vars in 1126 bytes} [Wed Jun 22 10:00:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:33.706314 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd65db3-aab9-4bb0-9665-3cfc76e36d85 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:33.809246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd65db3-aab9-4bb0-9665-3cfc76e36d85 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:33.845426 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cb4cb-1af3-4a4a-8453-ea173f135cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:33.846036 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cb4cb-1af3-4a4a-8453-ea173f135cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:33.846318 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cb4cb-1af3-4a4a-8453-ea173f135cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:33.846591 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cb4cb-1af3-4a4a-8453-ea173f135cc5 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:33.847305 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cb4cb-1af3-4a4a-8453-ea173f135cc5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:33.847612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cb4cb-1af3-4a4a-8453-ea173f135cc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:33.849009 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cb4cb-1af3-4a4a-8453-ea173f135cc5 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:33.854933 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 502/1011] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Jun 22 10:00:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:33.860555 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b9d2e-70f2-4380-ac38-df0e7950934c None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:33.965255 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b9d2e-70f2-4380-ac38-df0e7950934c None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:33.999966 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738d510-118c-4af0-96e0-6135aa6984c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:34.000638 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738d510-118c-4af0-96e0-6135aa6984c1 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:34.000978 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738d510-118c-4af0-96e0-6135aa6984c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:34.001257 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738d510-118c-4af0-96e0-6135aa6984c1 None admin] PATH_INFO: `/v3/services` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:34.001963 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738d510-118c-4af0-96e0-6135aa6984c1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:34.002296 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738d510-118c-4af0-96e0-6135aa6984c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:34.003629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738d510-118c-4af0-96e0-6135aa6984c1 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:34.009000 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 510/1012] 10.222.0.46 () {56 vars in 1122 bytes} [Wed Jun 22 10:00:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:34.014580 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cb4cb-1af3-4a4a-8453-ea173f135cc5 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:34.055693 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6781f32-a526-4407-94da-9c7759d80f65 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:34.056002 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6781f32-a526-4407-94da-9c7759d80f65 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:34.056247 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6781f32-a526-4407-94da-9c7759d80f65 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:34.057858 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 511/1013] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:00:34.062494 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06576a4-9eef-4c5a-a352-1ea089a23509 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:34.062783 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06576a4-9eef-4c5a-a352-1ea089a23509 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:34.063062 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06576a4-9eef-4c5a-a352-1ea089a23509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:34.077197 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:34.080806 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-a06576a4-9eef-4c5a-a352-1ea089a23509 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:34.082028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-a06576a4-9eef-4c5a-a352-1ea089a23509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:34.120401 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cb4cb-1af3-4a4a-8453-ea173f135cc5 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:34.143516 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:34.155615 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 512/1014] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:34 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:00:34.157999 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d632a-3e70-464e-8e51-d284567b0214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:34.158662 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d632a-3e70-464e-8e51-d284567b0214 None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:34.158947 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d632a-3e70-464e-8e51-d284567b0214 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:34.159225 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d632a-3e70-464e-8e51-d284567b0214 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:34.159982 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d632a-3e70-464e-8e51-d284567b0214 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:34.161413 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d632a-3e70-464e-8e51-d284567b0214 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:34.179220 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06576a4-9eef-4c5a-a352-1ea089a23509 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:34.244549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 503/1015] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Jun 22 10:00:34 2022] POST /identity/v3/endpoints => generated 325 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:00:34.291118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06576a4-9eef-4c5a-a352-1ea089a23509 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:34.335754 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced3bbd-3bc3-44f2-825c-3f705ad2e7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:34.336599 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced3bbd-3bc3-44f2-825c-3f705ad2e7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:34.336913 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced3bbd-3bc3-44f2-825c-3f705ad2e7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:34.337194 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced3bbd-3bc3-44f2-825c-3f705ad2e7a7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:34.349502 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced3bbd-3bc3-44f2-825c-3f705ad2e7a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:00:34.357991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-cced3bbd-3bc3-44f2-825c-3f705ad2e7a7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:00:34.357991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:34.357991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:34.357991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:34.357991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:34.357991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:34.357991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:34.357991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:34.357991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:34.357991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:34.357991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:34.357991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:34.357991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:00:34.357991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:00:34.357991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:00:34.357991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:00:34.359057 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:00:34.359057 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:00:34.359057 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:00:34.359057 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:00:34.359057 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:34.359057 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:34.359057 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:34.359057 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:34.359057 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:34.359057 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:34.359057 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:34.359057 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:34.359057 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:34.359057 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:34.359057 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:34.359057 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:34.359920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:34.359920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:34.359920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:34.359920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:34.359920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:00:34.359920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:00:34.359920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:00:34.359920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:00:34.359920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:00:34.359920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:00:34.359920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:00:34.359920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:34.359920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 513/1016] 10.222.0.46 () {56 vars in 1120 bytes} [Wed Jun 22 10:00:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:00:34.365388 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d632a-3e70-464e-8e51-d284567b0214 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:34.479064 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d632a-3e70-464e-8e51-d284567b0214 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:34.502691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:34.513733 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd12c86-f570-47d5-8298-ec4fac3d1cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:34.514420 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd12c86-f570-47d5-8298-ec4fac3d1cfb None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:34.514703 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd12c86-f570-47d5-8298-ec4fac3d1cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:34.515183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd12c86-f570-47d5-8298-ec4fac3d1cfb None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:34.515938 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd12c86-f570-47d5-8298-ec4fac3d1cfb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:34.516249 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd12c86-f570-47d5-8298-ec4fac3d1cfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:34.518260 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd12c86-f570-47d5-8298-ec4fac3d1cfb None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:34.527658 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 504/1017] 10.222.0.46 () {56 vars in 1115 bytes} [Wed Jun 22 10:00:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:34.533129 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced3bbd-3bc3-44f2-825c-3f705ad2e7a7 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:34.585809 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:34.640118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced3bbd-3bc3-44f2-825c-3f705ad2e7a7 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:34.676736 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004e8d3-f796-45be-ba3b-20b7429c07bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:34.677569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004e8d3-f796-45be-ba3b-20b7429c07bd None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:34.677860 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004e8d3-f796-45be-ba3b-20b7429c07bd None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:34.678140 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004e8d3-f796-45be-ba3b-20b7429c07bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:34.691382 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004e8d3-f796-45be-ba3b-20b7429c07bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:34.692854 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004e8d3-f796-45be-ba3b-20b7429c07bd None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:34.711211 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-9004e8d3-f796-45be-ba3b-20b7429c07bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:34.711211 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:34.711211 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:34.711211 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:34.711211 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:34.711211 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:34.711211 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:34.711211 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:34.711211 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:34.711211 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:34.711211 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:34.711211 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:34.711211 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:00:34.711211 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:00:34.711211 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:00:34.712138 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:00:34.712138 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:34.712138 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:34.712138 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:34.712138 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:34.712138 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:34.712138 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:34.712138 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:34.712138 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:34.712138 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:34.712138 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:34.712138 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:34.712138 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:34.712138 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:34.712138 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:34.712138 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:34.712138 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:34.713109 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:00:34.713109 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:00:34.713109 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:34.713109 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:34.713109 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 514/1018] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:34.719306 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd12c86-f570-47d5-8298-ec4fac3d1cfb None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:34.821777 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd12c86-f570-47d5-8298-ec4fac3d1cfb None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:34.856339 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e94e6b-1846-42ce-af5e-d2b99e70ab42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:34.857053 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e94e6b-1846-42ce-af5e-d2b99e70ab42 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:34.857338 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e94e6b-1846-42ce-af5e-d2b99e70ab42 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:34.857612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e94e6b-1846-42ce-af5e-d2b99e70ab42 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:34.858345 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e94e6b-1846-42ce-af5e-d2b99e70ab42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:34.858649 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e94e6b-1846-42ce-af5e-d2b99e70ab42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:34.860037 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e94e6b-1846-42ce-af5e-d2b99e70ab42 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:34.872911 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 505/1019] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:34.878637 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004e8d3-f796-45be-ba3b-20b7429c07bd None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:34.981620 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:34.986650 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004e8d3-f796-45be-ba3b-20b7429c07bd None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:35.021696 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7dbcd7-74f6-4d99-ba53-a9cb3e576e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:35.022499 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dbcd7-74f6-4d99-ba53-a9cb3e576e6b None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:35.022784 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dbcd7-74f6-4d99-ba53-a9cb3e576e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:35.023064 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dbcd7-74f6-4d99-ba53-a9cb3e576e6b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:35.030862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7dbcd7-74f6-4d99-ba53-a9cb3e576e6b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:35.032327 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7dbcd7-74f6-4d99-ba53-a9cb3e576e6b None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:35.046231 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-ca7dbcd7-74f6-4d99-ba53-a9cb3e576e6b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:00:35.046231 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:35.046231 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:35.046231 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:35.046231 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:35.046231 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:35.046231 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:35.046231 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:35.046231 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:35.046231 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:35.046231 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:35.046231 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:35.046231 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:00:35.046231 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:00:35.046231 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:00:35.046231 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:00:35.047254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:35.047254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:35.047254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:00:35.047254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:00:35.047254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:00:35.047254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:00:35.047254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:35.047254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:35.047254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:35.047254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:35.047254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:35.047254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:35.047254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:35.047254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:35.047254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:35.047254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:35.047254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:35.047254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:35.049334 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:35.049334 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:35.049334 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:00:35.049334 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:00:35.049334 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:00:35.049334 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:00:35.049334 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:00:35.049334 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:00:35.049334 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:00:35.049334 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:35.050229 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 515/1020] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Jun 22 10:00:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:35.053580 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e94e6b-1846-42ce-af5e-d2b99e70ab42 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:35.101863 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:35.157735 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e94e6b-1846-42ce-af5e-d2b99e70ab42 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:35.191897 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efffdd6e-1997-4da3-979f-e988532b8c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:35.192575 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffdd6e-1997-4da3-979f-e988532b8c14 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:35.192933 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffdd6e-1997-4da3-979f-e988532b8c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:35.193207 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffdd6e-1997-4da3-979f-e988532b8c14 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:35.194058 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efffdd6e-1997-4da3-979f-e988532b8c14 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:35.194363 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efffdd6e-1997-4da3-979f-e988532b8c14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:35.195803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efffdd6e-1997-4da3-979f-e988532b8c14 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:35.217909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 506/1021] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Jun 22 10:00:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:00:35.221208 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7dbcd7-74f6-4d99-ba53-a9cb3e576e6b None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:35.235130 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a323ed5-d7cd-435e-826e-66389827e17f None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:35.235821 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a323ed5-d7cd-435e-826e-66389827e17f None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:35.236094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a323ed5-d7cd-435e-826e-66389827e17f None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:35.237802 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 507/1022] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:35.242884 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd329c-2956-4e8f-a4d9-341840a8654c None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:35.243176 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd329c-2956-4e8f-a4d9-341840a8654c None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:35.243489 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd329c-2956-4e8f-a4d9-341840a8654c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:35.260500 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-a2dd329c-2956-4e8f-a4d9-341840a8654c None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:35.261783 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-a2dd329c-2956-4e8f-a4d9-341840a8654c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:35.331364 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7dbcd7-74f6-4d99-ba53-a9cb3e576e6b None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:35.333409 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 508/1023] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:35 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:00:35.357790 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd329c-2956-4e8f-a4d9-341840a8654c None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:35.376547 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11695c7b-022c-4933-8849-ccf941749285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:35.378747 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11695c7b-022c-4933-8849-ccf941749285 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:35.379031 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11695c7b-022c-4933-8849-ccf941749285 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:35.379312 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11695c7b-022c-4933-8849-ccf941749285 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:35.393952 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:35.413528 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:35.456602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11695c7b-022c-4933-8849-ccf941749285 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:35.458099 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11695c7b-022c-4933-8849-ccf941749285 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:35.483502 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd329c-2956-4e8f-a4d9-341840a8654c None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:35.519165 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e8005-5ae2-4e68-a793-6be0a9f57b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:35.519829 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e8005-5ae2-4e68-a793-6be0a9f57b57 None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:35.520122 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e8005-5ae2-4e68-a793-6be0a9f57b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:35.520403 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e8005-5ae2-4e68-a793-6be0a9f57b57 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:35.521174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e8005-5ae2-4e68-a793-6be0a9f57b57 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:35.522554 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e8005-5ae2-4e68-a793-6be0a9f57b57 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:35.565963 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 516/1024] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 10:00:35 2022] GET /identity/v3/auth/tokens => generated 1863 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:00:35.571473 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11695c7b-022c-4933-8849-ccf941749285 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:35.632935 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 509/1025] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Jun 22 10:00:35 2022] POST /identity/v3/services => generated 242 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:00:35.640338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:35.696030 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11695c7b-022c-4933-8849-ccf941749285 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:35.749887 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663225f-df17-423b-a3d8-77de10434e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:35.750754 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663225f-df17-423b-a3d8-77de10434e90 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:35.751552 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663225f-df17-423b-a3d8-77de10434e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:35.751951 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663225f-df17-423b-a3d8-77de10434e90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:35.764154 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663225f-df17-423b-a3d8-77de10434e90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:35.765655 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663225f-df17-423b-a3d8-77de10434e90 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:35.788482 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-6663225f-df17-423b-a3d8-77de10434e90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:35.788482 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:35.788482 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:35.788482 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:35.788482 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:35.788482 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:35.788482 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:35.788482 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:35.788482 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:35.788482 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:35.788482 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:35.788482 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:35.788482 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:00:35.788482 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:00:35.788482 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:00:35.789680 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:00:35.789680 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:35.789680 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:35.789680 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:35.789680 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:35.789680 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:35.789680 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:35.789680 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:35.789680 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:35.789680 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:35.789680 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:35.789680 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:35.789680 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:35.789680 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:35.789680 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:35.789680 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:35.789680 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:35.795328 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:00:35.795328 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:00:35.795328 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:35.795328 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:35.795328 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 517/1026] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:00:35.797251 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e8005-5ae2-4e68-a793-6be0a9f57b57 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:35.900525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:35.910400 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e8005-5ae2-4e68-a793-6be0a9f57b57 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:35.945095 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dae6c4-ae1b-4e1b-a2d7-e41834e567c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:35.945760 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dae6c4-ae1b-4e1b-a2d7-e41834e567c7 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:35.946043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dae6c4-ae1b-4e1b-a2d7-e41834e567c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:35.946312 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dae6c4-ae1b-4e1b-a2d7-e41834e567c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:35.947127 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dae6c4-ae1b-4e1b-a2d7-e41834e567c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:35.947334 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dae6c4-ae1b-4e1b-a2d7-e41834e567c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:35.948685 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dae6c4-ae1b-4e1b-a2d7-e41834e567c7 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:35.961816 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 510/1027] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:35.967493 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663225f-df17-423b-a3d8-77de10434e90 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:36.071938 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663225f-df17-423b-a3d8-77de10434e90 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:36.080155 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:36.107442 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4ce2b-0199-4d0c-b3fc-ab88eb311fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:36.108159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4ce2b-0199-4d0c-b3fc-ab88eb311fae None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:36.108515 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4ce2b-0199-4d0c-b3fc-ab88eb311fae None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:36.108701 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4ce2b-0199-4d0c-b3fc-ab88eb311fae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:36.116484 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4ce2b-0199-4d0c-b3fc-ab88eb311fae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:36.118033 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4ce2b-0199-4d0c-b3fc-ab88eb311fae None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:36.132545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-7ad4ce2b-0199-4d0c-b3fc-ab88eb311fae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:00:36.132545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:36.132545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:36.132545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:36.132545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:36.132545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:36.132545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:36.132545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:36.132545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:36.132545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:36.132545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:36.132545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:36.132545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:00:36.132545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:00:36.132545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:00:36.133502 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:00:36.133502 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:36.133502 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:36.133502 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:36.133502 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:36.133502 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:36.133502 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:36.133502 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:36.133502 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:36.133502 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:36.133502 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:36.133502 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:36.133502 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:36.133502 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:36.133502 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:36.133502 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:36.133502 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:36.134454 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:00:36.134454 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:00:36.134454 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:00:36.134454 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:00:36.134454 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:00:36.134454 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:00:36.134454 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:00:36.134454 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:36.134893 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 518/1028] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 10:00:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:36.139537 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dae6c4-ae1b-4e1b-a2d7-e41834e567c7 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:36.243605 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dae6c4-ae1b-4e1b-a2d7-e41834e567c7 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:36.276617 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da015998-4e52-4133-81ea-5f456ba161e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:36.277571 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da015998-4e52-4133-81ea-5f456ba161e5 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:36.278046 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da015998-4e52-4133-81ea-5f456ba161e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:36.278492 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da015998-4e52-4133-81ea-5f456ba161e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:36.279454 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da015998-4e52-4133-81ea-5f456ba161e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:36.279953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da015998-4e52-4133-81ea-5f456ba161e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:36.281577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da015998-4e52-4133-81ea-5f456ba161e5 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:36.299445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 511/1029] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 10:00:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:36.300707 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4ce2b-0199-4d0c-b3fc-ab88eb311fae None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:36.343209 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67605423-15af-4146-be56-0c0f5b3acc56 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:36.343501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67605423-15af-4146-be56-0c0f5b3acc56 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:36.343769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67605423-15af-4146-be56-0c0f5b3acc56 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:36.345261 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 512/1030] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:00:36.350252 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46bc8c-0a76-4d06-87e8-6137eeb114f8 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:36.350545 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46bc8c-0a76-4d06-87e8-6137eeb114f8 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:36.350829 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46bc8c-0a76-4d06-87e8-6137eeb114f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:36.367976 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-2c46bc8c-0a76-4d06-87e8-6137eeb114f8 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:36.369229 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-2c46bc8c-0a76-4d06-87e8-6137eeb114f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:36.377952 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:36.411110 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4ce2b-0199-4d0c-b3fc-ab88eb311fae None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:36.444669 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 513/1031] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:00:36.452612 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3dbda9-1680-46c6-8c44-d00efe63e083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:36.453308 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dbda9-1680-46c6-8c44-d00efe63e083 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:36.453594 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dbda9-1680-46c6-8c44-d00efe63e083 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:36.453894 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dbda9-1680-46c6-8c44-d00efe63e083 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:36.454737 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3dbda9-1680-46c6-8c44-d00efe63e083 None admin] RBAC: Adding query filter params (role.id=263cc0eba7e54b5ab2d884bfb15f6a93, scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9, user.id=4ed9a00723ab4af2b633ab7614d178a8) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:36.455054 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3dbda9-1680-46c6-8c44-d00efe63e083 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:36.456480 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3dbda9-1680-46c6-8c44-d00efe63e083 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:36.469038 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 519/1032] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 10:00:36 2022] GET /identity/v3/role_assignments?user.id=4ed9a00723ab4af2b633ab7614d178a8&scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9&role.id=263cc0eba7e54b5ab2d884bfb15f6a93 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:36.470013 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46bc8c-0a76-4d06-87e8-6137eeb114f8 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:36.580565 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46bc8c-0a76-4d06-87e8-6137eeb114f8 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:36.618474 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b018c18-3c27-4de8-bbd5-c5ec0306c3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:36.619272 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b018c18-3c27-4de8-bbd5-c5ec0306c3e2 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:36.619558 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b018c18-3c27-4de8-bbd5-c5ec0306c3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:36.619836 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b018c18-3c27-4de8-bbd5-c5ec0306c3e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:36.621063 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b018c18-3c27-4de8-bbd5-c5ec0306c3e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:36.622507 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b018c18-3c27-4de8-bbd5-c5ec0306c3e2 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:36.628909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 514/1033] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:36.630876 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3dbda9-1680-46c6-8c44-d00efe63e083 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:36.670712 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:36.744240 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3dbda9-1680-46c6-8c44-d00efe63e083 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:36.778184 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8e8d5-5ddd-4b52-8f38-927894b53d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:36.778862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8e8d5-5ddd-4b52-8f38-927894b53d34 None admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:36.779143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8e8d5-5ddd-4b52-8f38-927894b53d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:36.779418 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8e8d5-5ddd-4b52-8f38-927894b53d34 None admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:36.780157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8e8d5-5ddd-4b52-8f38-927894b53d34 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:36.781656 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8e8d5-5ddd-4b52-8f38-927894b53d34 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:36.894053 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 520/1034] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Jun 22 10:00:36 2022] POST /identity/v3/projects => generated 311 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:00:37.728259 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7c6c3-e811-47e4-91fe-1d39548dce7e None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:37.728767 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7c6c3-e811-47e4-91fe-1d39548dce7e None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:37.729057 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7c6c3-e811-47e4-91fe-1d39548dce7e None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:37.730260 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 515/1035] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:37.735345 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66100c3e-476f-49ab-8ea3-2bfc06174ef4 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:37.735732 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66100c3e-476f-49ab-8ea3-2bfc06174ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:37.735900 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66100c3e-476f-49ab-8ea3-2bfc06174ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:37.752555 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-66100c3e-476f-49ab-8ea3-2bfc06174ef4 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:37.753779 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-66100c3e-476f-49ab-8ea3-2bfc06174ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:37.820380 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 521/1036] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:00:37.843405 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7c6c3-e811-47e4-91fe-1d39548dce7e None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:37.855873 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:37.946824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7c6c3-e811-47e4-91fe-1d39548dce7e None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:37.980780 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286684ee-7e77-44a4-a9ea-8955236dbba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:37.981647 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286684ee-7e77-44a4-a9ea-8955236dbba5 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:37.981926 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286684ee-7e77-44a4-a9ea-8955236dbba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:37.982198 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286684ee-7e77-44a4-a9ea-8955236dbba5 None admin] PATH_INFO: `/v3/services/image` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:37.982903 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286684ee-7e77-44a4-a9ea-8955236dbba5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:37.984270 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286684ee-7e77-44a4-a9ea-8955236dbba5 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:37.997140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-286684ee-7e77-44a4-a9ea-8955236dbba5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 10:00:37.997140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:37.997140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:00:37.997140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:00:37.997140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:00:37.997140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:00:37.997140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:00:37.997140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:37.997140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 10:00:37.997140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:37.997140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:00:37.997140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:37.997140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:37.997140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:37.997140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:37.997140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:37.997140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:37.998174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:37.998174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:37.998174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:37.998174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:37.998174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:37.998174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:37.998174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:00:37.998174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:00:37.998174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:00:37.998174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:00:37.998174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:37.998174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:37.998174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:37.998174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:37.998174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:37.998174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:37.999011 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:37.999011 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:37.999011 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:37.999011 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:37.999011 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:37.999011 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:37.999011 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:37.999011 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:37.999011 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:37.999011 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:37.999011 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:00:37.999011 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:37.999011 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 10:00:37.999011 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:38.001266 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 516/1037] 10.222.0.46 () {56 vars in 1105 bytes} [Wed Jun 22 10:00:37 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:38.004883 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66100c3e-476f-49ab-8ea3-2bfc06174ef4 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:38.019957 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:38.112112 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66100c3e-476f-49ab-8ea3-2bfc06174ef4 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:38.147007 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f2bbf-7081-47ee-b964-1ce836ef8343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:38.147677 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f2bbf-7081-47ee-b964-1ce836ef8343 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:38.147973 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f2bbf-7081-47ee-b964-1ce836ef8343 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:38.148238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f2bbf-7081-47ee-b964-1ce836ef8343 None admin] PATH_INFO: `/v3/services` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:38.148979 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f2bbf-7081-47ee-b964-1ce836ef8343 None admin] RBAC: Adding query filter params (name=image) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:38.149292 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f2bbf-7081-47ee-b964-1ce836ef8343 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:38.150650 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f2bbf-7081-47ee-b964-1ce836ef8343 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:38.160247 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 522/1038] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:38.161819 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286684ee-7e77-44a4-a9ea-8955236dbba5 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:38.239523 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:38.264005 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286684ee-7e77-44a4-a9ea-8955236dbba5 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:38.298559 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995803a-b270-4f10-88d6-d214bca30c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:38.299224 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995803a-b270-4f10-88d6-d214bca30c31 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:38.299507 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995803a-b270-4f10-88d6-d214bca30c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:38.299785 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995803a-b270-4f10-88d6-d214bca30c31 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:38.300489 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995803a-b270-4f10-88d6-d214bca30c31 None admin] RBAC: Adding query filter params (type=image) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:38.300897 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995803a-b270-4f10-88d6-d214bca30c31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:38.302201 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995803a-b270-4f10-88d6-d214bca30c31 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:38.311825 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 517/1039] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:38 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:00:38.313913 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f2bbf-7081-47ee-b964-1ce836ef8343 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:38.396169 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:38.420093 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f2bbf-7081-47ee-b964-1ce836ef8343 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:38.455601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b931fab-f03b-4266-b8b5-47885fcde81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:38.456644 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b931fab-f03b-4266-b8b5-47885fcde81a None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:38.457158 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b931fab-f03b-4266-b8b5-47885fcde81a None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:38.457658 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b931fab-f03b-4266-b8b5-47885fcde81a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:38.458649 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b931fab-f03b-4266-b8b5-47885fcde81a None admin] RBAC: Adding query filter params (interface=public, service_id=119e8df810f44a96b0337752e929ea78, region_id=RegionOne) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:38.459177 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b931fab-f03b-4266-b8b5-47885fcde81a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:38.460731 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b931fab-f03b-4266-b8b5-47885fcde81a None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:38.466454 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 523/1040] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Jun 22 10:00:38 2022] GET /identity/v3/endpoints?service_id=119e8df810f44a96b0337752e929ea78&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:38.471881 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995803a-b270-4f10-88d6-d214bca30c31 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:38.526467 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8aca2-5eeb-4a20-9f52-77285cdad323 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:38.526658 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8aca2-5eeb-4a20-9f52-77285cdad323 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:38.526946 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8aca2-5eeb-4a20-9f52-77285cdad323 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:38.528933 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 524/1041] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:00:38.534041 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03cb2c-8c66-4728-9e94-d23596df3d82 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:38.534546 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03cb2c-8c66-4728-9e94-d23596df3d82 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:38.534837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03cb2c-8c66-4728-9e94-d23596df3d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:38.552315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-af03cb2c-8c66-4728-9e94-d23596df3d82 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:38.553769 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-af03cb2c-8c66-4728-9e94-d23596df3d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:38.579268 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995803a-b270-4f10-88d6-d214bca30c31 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:38.616316 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab2fa2-23b9-4338-bb66-95902c9404cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:38.617016 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab2fa2-23b9-4338-bb66-95902c9404cf None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:38.617298 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab2fa2-23b9-4338-bb66-95902c9404cf None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:38.617577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab2fa2-23b9-4338-bb66-95902c9404cf None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:38.618265 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab2fa2-23b9-4338-bb66-95902c9404cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:38.619640 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab2fa2-23b9-4338-bb66-95902c9404cf None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:38.638167 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 518/1042] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Jun 22 10:00:38 2022] GET /identity/v3/services => generated 1957 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:00:38.638386 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 525/1043] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:00:38.656089 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab2fa2-23b9-4338-bb66-95902c9404cf None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:38.659178 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:38.778752 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab2fa2-23b9-4338-bb66-95902c9404cf None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:38.816744 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc119dad-a460-4d1e-86da-77d47a12f22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:38.817837 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc119dad-a460-4d1e-86da-77d47a12f22c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:38.818126 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc119dad-a460-4d1e-86da-77d47a12f22c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:38.818408 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc119dad-a460-4d1e-86da-77d47a12f22c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:38.829316 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc119dad-a460-4d1e-86da-77d47a12f22c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:00:38.837563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-fc119dad-a460-4d1e-86da-77d47a12f22c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:00:38.837563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:38.837563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:38.837563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:38.837563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:38.837563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:38.837563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:38.837563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:38.837563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:38.837563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:38.837563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:38.837563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:38.837563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:00:38.837563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:00:38.837563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:00:38.837563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:00:38.838468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:00:38.838468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:00:38.838468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:00:38.838468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:00:38.838468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:38.838468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:38.838468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:38.838468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:38.838468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:38.838468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:38.838468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:38.838468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:38.838468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:38.838468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:38.838468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:38.838468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:38.839311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:38.839311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:38.839311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:38.839311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:38.839311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:00:38.839311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:00:38.839311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:00:38.839311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:00:38.839311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:00:38.839311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:00:38.839311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:00:38.839311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:38.839311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 519/1044] 10.222.0.46 () {56 vars in 1120 bytes} [Wed Jun 22 10:00:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:38.844957 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03cb2c-8c66-4728-9e94-d23596df3d82 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:38.917457 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:38.948318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03cb2c-8c66-4728-9e94-d23596df3d82 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:38.984464 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfa86b-e410-4a33-91aa-9441f3cca4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:38.985794 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfa86b-e410-4a33-91aa-9441f3cca4bf None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:38.986077 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfa86b-e410-4a33-91aa-9441f3cca4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:38.986348 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfa86b-e410-4a33-91aa-9441f3cca4bf None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:38.987099 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dfa86b-e410-4a33-91aa-9441f3cca4bf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:38.987499 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dfa86b-e410-4a33-91aa-9441f3cca4bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:38.988890 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dfa86b-e410-4a33-91aa-9441f3cca4bf None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:39.016526 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 526/1045] 10.222.0.46 () {56 vars in 1115 bytes} [Wed Jun 22 10:00:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:39.016748 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052076d4-b4a8-4827-bff2-0310cdc55cb7 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:39.016892 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052076d4-b4a8-4827-bff2-0310cdc55cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:39.020863 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052076d4-b4a8-4827-bff2-0310cdc55cb7 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:39.020863 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 520/1046] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:00:39.022946 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfa86b-e410-4a33-91aa-9441f3cca4bf None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:39.024285 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b11ff9-17af-4ab7-b202-e310ce0bc960 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:39.024581 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b11ff9-17af-4ab7-b202-e310ce0bc960 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:39.024895 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b11ff9-17af-4ab7-b202-e310ce0bc960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:39.052531 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-12b11ff9-17af-4ab7-b202-e310ce0bc960 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:39.053765 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-12b11ff9-17af-4ab7-b202-e310ce0bc960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:39.115539 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:39.125870 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 521/1047] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:00:39.137341 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfa86b-e410-4a33-91aa-9441f3cca4bf None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:39.150302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b11ff9-17af-4ab7-b202-e310ce0bc960 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:39.169883 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:39.175661 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a8169-35f1-472d-8019-938f2c05e478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:39.176601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a8169-35f1-472d-8019-938f2c05e478 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:39.176909 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a8169-35f1-472d-8019-938f2c05e478 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:39.177196 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a8169-35f1-472d-8019-938f2c05e478 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:39.188349 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a8169-35f1-472d-8019-938f2c05e478 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:39.189916 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a8169-35f1-472d-8019-938f2c05e478 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:39.209028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-308a8169-35f1-472d-8019-938f2c05e478 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:39.209028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:39.209028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:39.209028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:39.209028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:39.209028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:39.209028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:39.209028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:39.209028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:39.209028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:39.209028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:39.209028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:39.209028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:00:39.209028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:00:39.209028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:00:39.209998 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:00:39.209998 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:39.209998 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:39.209998 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:39.209998 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:39.209998 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:39.209998 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:39.209998 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:39.209998 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:39.209998 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:39.209998 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:39.209998 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:39.209998 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:39.209998 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:39.209998 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:39.209998 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:39.209998 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:39.210970 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:00:39.210970 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:00:39.210970 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:39.210970 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:39.215052 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 527/1048] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:39.215863 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a8169-35f1-472d-8019-938f2c05e478 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:39.261538 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b11ff9-17af-4ab7-b202-e310ce0bc960 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:39.299541 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11430b65-b51e-4bff-9e1e-2cfdc3b19ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:39.300341 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11430b65-b51e-4bff-9e1e-2cfdc3b19ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:39.300630 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11430b65-b51e-4bff-9e1e-2cfdc3b19ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:39.300945 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11430b65-b51e-4bff-9e1e-2cfdc3b19ce0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:39.302143 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11430b65-b51e-4bff-9e1e-2cfdc3b19ce0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:39.303669 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11430b65-b51e-4bff-9e1e-2cfdc3b19ce0 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:39.305466 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 522/1049] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:00:39.310781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11430b65-b51e-4bff-9e1e-2cfdc3b19ce0 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:39.320418 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a8169-35f1-472d-8019-938f2c05e478 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:39.358410 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da133f19-82f9-4a25-b7a6-443a5a4423a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:39.359082 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da133f19-82f9-4a25-b7a6-443a5a4423a5 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:39.359479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da133f19-82f9-4a25-b7a6-443a5a4423a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:39.360035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da133f19-82f9-4a25-b7a6-443a5a4423a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:39.360775 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da133f19-82f9-4a25-b7a6-443a5a4423a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:39.361430 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da133f19-82f9-4a25-b7a6-443a5a4423a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:39.363096 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da133f19-82f9-4a25-b7a6-443a5a4423a5 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:39.376613 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:39.383755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 528/1050] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:00:39.385173 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da133f19-82f9-4a25-b7a6-443a5a4423a5 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:39.419461 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11430b65-b51e-4bff-9e1e-2cfdc3b19ce0 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:39.439266 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:39.454752 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cfa9d6-a657-4bc3-8398-7296cd994149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:39.455411 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfa9d6-a657-4bc3-8398-7296cd994149 None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:39.455695 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfa9d6-a657-4bc3-8398-7296cd994149 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:39.455974 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfa9d6-a657-4bc3-8398-7296cd994149 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:39.456674 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cfa9d6-a657-4bc3-8398-7296cd994149 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:39.458133 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cfa9d6-a657-4bc3-8398-7296cd994149 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:39.496503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da133f19-82f9-4a25-b7a6-443a5a4423a5 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:39.529403 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd93289-8dae-4ef0-890d-b9bac5de2eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:39.530185 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd93289-8dae-4ef0-890d-b9bac5de2eca None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:39.530469 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd93289-8dae-4ef0-890d-b9bac5de2eca None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:39.530748 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd93289-8dae-4ef0-890d-b9bac5de2eca None admin] PATH_INFO: `/v3/users/nova` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:39.538109 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd93289-8dae-4ef0-890d-b9bac5de2eca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:39.539526 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd93289-8dae-4ef0-890d-b9bac5de2eca None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:39.553418 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-5bd93289-8dae-4ef0-890d-b9bac5de2eca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:00:39.553418 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:39.553418 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:39.553418 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:39.553418 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:39.553418 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:39.553418 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:39.553418 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:39.553418 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:39.553418 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:39.553418 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:39.553418 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:39.553418 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:00:39.553418 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:00:39.553418 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:00:39.553418 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:00:39.554602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:39.554602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:39.554602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:00:39.554602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:00:39.554602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:00:39.554602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:00:39.554602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:39.554602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:39.554602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:39.554602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:39.554602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:39.554602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:39.554602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:39.554602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:39.554602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:39.554602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:39.554602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:39.554602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:39.555602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:39.555602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:39.555602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:00:39.555602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:00:39.555602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:00:39.555602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:00:39.555602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:00:39.555602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:00:39.555602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:00:39.555602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:39.555602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 529/1051] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Jun 22 10:00:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:00:39.560062 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd93289-8dae-4ef0-890d-b9bac5de2eca None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:39.619184 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 523/1052] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 22 10:00:39 2022] POST /identity/v3/users => generated 285 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:00:39.669274 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd93289-8dae-4ef0-890d-b9bac5de2eca None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:39.672157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:39.716347 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b64c3-fb1f-46de-8d15-12f95aa5e64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:39.717345 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b64c3-fb1f-46de-8d15-12f95aa5e64f None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:39.717799 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b64c3-fb1f-46de-8d15-12f95aa5e64f None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:39.718225 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b64c3-fb1f-46de-8d15-12f95aa5e64f None admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:39.719763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b64c3-fb1f-46de-8d15-12f95aa5e64f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:39.720243 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b64c3-fb1f-46de-8d15-12f95aa5e64f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:39.721931 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b64c3-fb1f-46de-8d15-12f95aa5e64f None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:39.742720 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 530/1053] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Jun 22 10:00:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:00:39.748091 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cfa9d6-a657-4bc3-8398-7296cd994149 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:39.862562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cfa9d6-a657-4bc3-8398-7296cd994149 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:39.880708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:39.899759 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9836fe-6097-4cc3-9009-6e81a7201693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:39.900779 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9836fe-6097-4cc3-9009-6e81a7201693 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:39.901260 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9836fe-6097-4cc3-9009-6e81a7201693 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:39.901550 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9836fe-6097-4cc3-9009-6e81a7201693 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:39.912890 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9836fe-6097-4cc3-9009-6e81a7201693 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:39.914335 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9836fe-6097-4cc3-9009-6e81a7201693 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:39.931894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-cc9836fe-6097-4cc3-9009-6e81a7201693 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:39.931894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:39.931894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:39.931894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:39.931894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:39.931894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:39.931894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:39.931894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:39.931894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:39.931894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:39.931894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:39.931894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:39.931894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:00:39.931894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:00:39.931894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:00:39.932856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:00:39.932856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:39.932856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:39.932856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:39.932856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:39.932856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:39.932856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:39.932856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:39.932856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:39.932856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:39.932856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:39.932856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:39.932856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:39.932856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:39.932856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:39.932856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:39.932856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:39.934204 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:00:39.934204 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:00:39.934204 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:39.934204 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:39.934204 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 524/1054] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:39.939443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b64c3-fb1f-46de-8d15-12f95aa5e64f None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:40.042487 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b64c3-fb1f-46de-8d15-12f95aa5e64f None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:40.076966 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1e76d-88d7-4188-af8c-bdc33c5d83e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:40.077640 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1e76d-88d7-4188-af8c-bdc33c5d83e4 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:40.077928 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1e76d-88d7-4188-af8c-bdc33c5d83e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:40.078289 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1e76d-88d7-4188-af8c-bdc33c5d83e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:40.079610 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1e76d-88d7-4188-af8c-bdc33c5d83e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:40.079927 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1e76d-88d7-4188-af8c-bdc33c5d83e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:40.081338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1e76d-88d7-4188-af8c-bdc33c5d83e4 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:40.097445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 531/1055] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:40.098795 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9836fe-6097-4cc3-9009-6e81a7201693 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:40.204128 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9836fe-6097-4cc3-9009-6e81a7201693 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:40.237701 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a09d2b-c672-49b6-add7-7ba3428a956c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:40.238498 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a09d2b-c672-49b6-add7-7ba3428a956c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:40.238787 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a09d2b-c672-49b6-add7-7ba3428a956c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:40.239066 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a09d2b-c672-49b6-add7-7ba3428a956c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:40.246006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a09d2b-c672-49b6-add7-7ba3428a956c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:40.247465 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a09d2b-c672-49b6-add7-7ba3428a956c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:40.261887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-53a09d2b-c672-49b6-add7-7ba3428a956c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:00:40.261887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:40.261887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:40.261887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:40.261887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:40.261887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:40.261887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:40.261887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:40.261887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:40.261887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:40.261887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:40.261887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:40.261887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:00:40.261887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:00:40.261887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:00:40.262814 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:00:40.262814 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:40.262814 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:40.262814 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:40.262814 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:40.262814 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:40.262814 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:40.262814 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:40.262814 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:40.262814 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:40.262814 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:40.262814 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:40.262814 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:40.262814 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:40.262814 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:40.262814 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:40.262814 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:40.263725 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:00:40.263725 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:00:40.263725 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:00:40.263725 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:00:40.263725 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:00:40.263725 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:00:40.263725 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:00:40.263725 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:40.265031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 525/1056] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 10:00:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:40.269574 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1e76d-88d7-4188-af8c-bdc33c5d83e4 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:40.296049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:40.380213 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1e76d-88d7-4188-af8c-bdc33c5d83e4 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:40.416085 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f6622-a15f-423c-a143-4fc29cc1a50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:40.416844 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f6622-a15f-423c-a143-4fc29cc1a50e None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:40.417201 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f6622-a15f-423c-a143-4fc29cc1a50e None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:40.417479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f6622-a15f-423c-a143-4fc29cc1a50e None admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:40.418280 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f6622-a15f-423c-a143-4fc29cc1a50e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:40.418587 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f6622-a15f-423c-a143-4fc29cc1a50e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:40.420018 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f6622-a15f-423c-a143-4fc29cc1a50e None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:40.436850 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 532/1057] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 10:00:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:40.439158 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a09d2b-c672-49b6-add7-7ba3428a956c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:40.469259 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:40.541516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a09d2b-c672-49b6-add7-7ba3428a956c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:40.575525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214acc87-3881-441f-b38f-45dbd72587ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:40.576408 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214acc87-3881-441f-b38f-45dbd72587ef None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:40.576685 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214acc87-3881-441f-b38f-45dbd72587ef None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:40.576986 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214acc87-3881-441f-b38f-45dbd72587ef None admin] PATH_INFO: `/v3/projects/a2bb614e4d7747c1a3fff154c8bc18d9/users/4ed9a00723ab4af2b633ab7614d178a8/roles/263cc0eba7e54b5ab2d884bfb15f6a93` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:40.579767 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214acc87-3881-441f-b38f-45dbd72587ef None admin] RBAC: Authorizing `identity:create_grant(project_id=a2bb614e4d7747c1a3fff154c8bc18d9, user_id=4ed9a00723ab4af2b633ab7614d178a8, role_id=263cc0eba7e54b5ab2d884bfb15f6a93)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:40.581237 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214acc87-3881-441f-b38f-45dbd72587ef None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:40.655238 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 526/1058] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 22 10:00:40 2022] PUT /identity/v3/projects/a2bb614e4d7747c1a3fff154c8bc18d9/users/4ed9a00723ab4af2b633ab7614d178a8/roles/263cc0eba7e54b5ab2d884bfb15f6a93 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:00:40.713098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179e530-56ea-4e49-a0df-1ced53ccd101 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:40.713443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179e530-56ea-4e49-a0df-1ced53ccd101 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:40.713666 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179e530-56ea-4e49-a0df-1ced53ccd101 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:40.715578 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 533/1059] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:40.721899 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca0c79-a54f-4ae0-b640-ee31579937ae None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:40.722085 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca0c79-a54f-4ae0-b640-ee31579937ae None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:40.722356 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca0c79-a54f-4ae0-b640-ee31579937ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:40.745677 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-17ca0c79-a54f-4ae0-b640-ee31579937ae None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:40.746904 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-17ca0c79-a54f-4ae0-b640-ee31579937ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:40.837087 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 527/1060] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:00:40.861076 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179e530-56ea-4e49-a0df-1ced53ccd101 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:40.948233 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:40.968561 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179e530-56ea-4e49-a0df-1ced53ccd101 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:41.003910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdf8b9-db90-4696-9d5d-d7d25a0ef596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:41.004622 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdf8b9-db90-4696-9d5d-d7d25a0ef596 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:41.004938 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdf8b9-db90-4696-9d5d-d7d25a0ef596 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:41.005217 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdf8b9-db90-4696-9d5d-d7d25a0ef596 None admin] PATH_INFO: `/v3/services/image` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:41.005871 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fdf8b9-db90-4696-9d5d-d7d25a0ef596 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:41.007232 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fdf8b9-db90-4696-9d5d-d7d25a0ef596 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:41.019719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-08fdf8b9-db90-4696-9d5d-d7d25a0ef596 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 10:00:41.019719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:41.019719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:00:41.019719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:00:41.019719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:00:41.019719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:00:41.019719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:00:41.019719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:41.019719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 10:00:41.019719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:41.019719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:00:41.019719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:41.019719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:41.019719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:41.019719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:41.019719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:41.019719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:41.020745 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:41.020745 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:41.020745 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:41.020745 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:41.020745 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:41.020745 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:41.020745 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:00:41.020745 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:00:41.020745 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:00:41.020745 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:00:41.020745 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:41.020745 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:41.020745 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:41.020745 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:41.020745 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:41.020745 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:41.027013 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:41.027013 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:41.027013 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:41.027013 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:41.027013 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:41.027013 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:41.027013 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:41.027013 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:41.027013 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:41.027013 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:41.027013 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:00:41.027013 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:00:41.027013 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 10:00:41.027013 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:41.027013 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 534/1061] 10.222.0.46 () {56 vars in 1105 bytes} [Wed Jun 22 10:00:40 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:41.032005 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca0c79-a54f-4ae0-b640-ee31579937ae None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:41.050969 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:41.146751 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca0c79-a54f-4ae0-b640-ee31579937ae None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:41.183061 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146aa3d-3306-438b-b94f-e9adce7c6d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:41.183836 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146aa3d-3306-438b-b94f-e9adce7c6d4d None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:41.184115 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146aa3d-3306-438b-b94f-e9adce7c6d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:41.184393 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146aa3d-3306-438b-b94f-e9adce7c6d4d None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:41.185130 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146aa3d-3306-438b-b94f-e9adce7c6d4d None admin] RBAC: Adding query filter params (name=image) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:41.185437 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146aa3d-3306-438b-b94f-e9adce7c6d4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:41.186804 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146aa3d-3306-438b-b94f-e9adce7c6d4d None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:41.196535 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 528/1062] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:41.197836 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdf8b9-db90-4696-9d5d-d7d25a0ef596 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:41.301571 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdf8b9-db90-4696-9d5d-d7d25a0ef596 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:41.336079 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27cf4a8-3be3-45a4-ac27-2e185024e02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:41.336748 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cf4a8-3be3-45a4-ac27-2e185024e02a None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:41.337061 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cf4a8-3be3-45a4-ac27-2e185024e02a None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:41.337344 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cf4a8-3be3-45a4-ac27-2e185024e02a None admin] PATH_INFO: `/v3/services` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:41.338061 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27cf4a8-3be3-45a4-ac27-2e185024e02a None admin] RBAC: Adding query filter params (type=image) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:41.338379 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27cf4a8-3be3-45a4-ac27-2e185024e02a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:41.339767 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27cf4a8-3be3-45a4-ac27-2e185024e02a None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:41.349222 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 535/1063] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:41.350429 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146aa3d-3306-438b-b94f-e9adce7c6d4d None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:41.440049 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:41.460152 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146aa3d-3306-438b-b94f-e9adce7c6d4d None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:41.501726 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95858645-d125-4dd8-a7a6-26b34910d059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:41.502375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95858645-d125-4dd8-a7a6-26b34910d059 None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:41.502656 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95858645-d125-4dd8-a7a6-26b34910d059 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:41.502930 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95858645-d125-4dd8-a7a6-26b34910d059 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:41.503662 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95858645-d125-4dd8-a7a6-26b34910d059 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:41.505052 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95858645-d125-4dd8-a7a6-26b34910d059 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:41.588927 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 529/1064] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Jun 22 10:00:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:00:41.782353 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a22b6-5bcc-4c4e-b8b3-9722563a23aa None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:41.782697 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a22b6-5bcc-4c4e-b8b3-9722563a23aa None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:41.782914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a22b6-5bcc-4c4e-b8b3-9722563a23aa None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:41.784560 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 536/1065] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:41.790638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a47031-d7f0-4934-ab44-b814928aca5c None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:41.790936 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a47031-d7f0-4934-ab44-b814928aca5c None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:41.791213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a47031-d7f0-4934-ab44-b814928aca5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:41.809512 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-20a47031-d7f0-4934-ab44-b814928aca5c None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:41.810714 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-20a47031-d7f0-4934-ab44-b814928aca5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:41.887792 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 530/1066] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:00:41.920019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a22b6-5bcc-4c4e-b8b3-9722563a23aa None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:41.935004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:42.028947 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a22b6-5bcc-4c4e-b8b3-9722563a23aa None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:42.064286 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf0d9d-a96f-475a-9174-0af912250d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:42.065107 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf0d9d-a96f-475a-9174-0af912250d55 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:42.065397 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf0d9d-a96f-475a-9174-0af912250d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:42.065674 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf0d9d-a96f-475a-9174-0af912250d55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:42.078474 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf0d9d-a96f-475a-9174-0af912250d55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:00:42.086144 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-78cf0d9d-a96f-475a-9174-0af912250d55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:00:42.086144 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:42.086144 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:42.086144 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:42.086144 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:42.086144 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:42.086144 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:42.086144 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:42.086144 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:42.086144 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:42.086144 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:42.086144 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:42.086144 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:00:42.086144 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:00:42.086144 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:00:42.086144 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:00:42.087063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:00:42.087063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:00:42.087063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:00:42.087063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:00:42.087063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:42.087063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:42.087063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:42.087063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:42.087063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:42.087063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:42.087063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:42.087063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:42.087063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:42.087063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:42.087063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:42.087063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:42.093172 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:42.093172 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:42.093172 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:42.093172 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:42.093172 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:00:42.093172 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:00:42.093172 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:00:42.093172 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:00:42.093172 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:00:42.093172 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:00:42.093172 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:00:42.093172 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:42.093172 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 537/1067] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 10:00:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:00:42.095707 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a47031-d7f0-4934-ab44-b814928aca5c None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:42.162692 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:42.200523 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a47031-d7f0-4934-ab44-b814928aca5c None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:42.235924 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cad724-9976-44e4-a28d-2332a2402de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:42.236661 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cad724-9976-44e4-a28d-2332a2402de3 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:42.236980 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cad724-9976-44e4-a28d-2332a2402de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:42.237260 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cad724-9976-44e4-a28d-2332a2402de3 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:42.238018 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cad724-9976-44e4-a28d-2332a2402de3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:42.238332 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cad724-9976-44e4-a28d-2332a2402de3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:42.239714 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cad724-9976-44e4-a28d-2332a2402de3 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:42.253441 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 531/1068] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 10:00:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:42.254621 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf0d9d-a96f-475a-9174-0af912250d55 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:42.324545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:42.357033 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf0d9d-a96f-475a-9174-0af912250d55 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:42.391925 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8567171-0fde-40eb-ac69-b9e6ec44eb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:42.392807 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8567171-0fde-40eb-ac69-b9e6ec44eb38 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:42.393124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8567171-0fde-40eb-ac69-b9e6ec44eb38 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:42.393401 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8567171-0fde-40eb-ac69-b9e6ec44eb38 None admin] PATH_INFO: `/v3/users/c4a2dcb9213044f9b5759efa015e4abd` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:42.408399 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8567171-0fde-40eb-ac69-b9e6ec44eb38 None admin] RBAC: Authorizing `identity:get_user(user_id=c4a2dcb9213044f9b5759efa015e4abd)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:42.410083 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8567171-0fde-40eb-ac69-b9e6ec44eb38 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:42.416416 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 538/1069] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 10:00:42 2022] GET /identity/v3/users/c4a2dcb9213044f9b5759efa015e4abd => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:42.417582 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cad724-9976-44e4-a28d-2332a2402de3 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:42.520953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cad724-9976-44e4-a28d-2332a2402de3 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:42.546149 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:42.555128 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df4d86-ba80-430e-b78b-0176df65a44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:42.555780 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df4d86-ba80-430e-b78b-0176df65a44f None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:42.561589 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df4d86-ba80-430e-b78b-0176df65a44f None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:42.561589 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df4d86-ba80-430e-b78b-0176df65a44f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:42.625223 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df4d86-ba80-430e-b78b-0176df65a44f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:42.626685 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df4d86-ba80-430e-b78b-0176df65a44f None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:42.717788 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45139b0-3e4d-41e8-af26-142fefb2cfd7 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:42.717997 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45139b0-3e4d-41e8-af26-142fefb2cfd7 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:42.718255 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45139b0-3e4d-41e8-af26-142fefb2cfd7 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:42.720449 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 539/1070] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:00:42.726054 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101aa09-7831-4d6c-8595-61f9b5f6a74f None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:42.726365 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101aa09-7831-4d6c-8595-61f9b5f6a74f None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:42.726606 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101aa09-7831-4d6c-8595-61f9b5f6a74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:42.740588 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 532/1071] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 10:00:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 10:00:42.741700 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df4d86-ba80-430e-b78b-0176df65a44f None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:42.747060 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-e101aa09-7831-4d6c-8595-61f9b5f6a74f None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:42.748235 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-e101aa09-7831-4d6c-8595-61f9b5f6a74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:42.770065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:42.834438 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 540/1072] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:00:42.855050 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df4d86-ba80-430e-b78b-0176df65a44f None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:42.858663 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101aa09-7831-4d6c-8595-61f9b5f6a74f None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:42.892140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7788f19-92e2-4183-8656-4ec446d2286b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:42.893024 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7788f19-92e2-4183-8656-4ec446d2286b None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:42.893398 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7788f19-92e2-4183-8656-4ec446d2286b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:42.893670 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7788f19-92e2-4183-8656-4ec446d2286b None admin] PATH_INFO: `/v3/projects/a9093805bc0c49198e89c6b77395a22b` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:42.894847 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7788f19-92e2-4183-8656-4ec446d2286b None admin] RBAC: Authorizing `identity:get_project(project_id=a9093805bc0c49198e89c6b77395a22b)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:42.896278 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7788f19-92e2-4183-8656-4ec446d2286b None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:42.899109 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 533/1073] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 10:00:42 2022] GET /identity/v3/projects/a9093805bc0c49198e89c6b77395a22b => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:00:42.903899 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7788f19-92e2-4183-8656-4ec446d2286b None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:42.920008 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:42.962761 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101aa09-7831-4d6c-8595-61f9b5f6a74f None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:43.002625 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:43.007529 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8954c-3bab-412c-b76b-4650385d18d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:43.008348 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8954c-3bab-412c-b76b-4650385d18d5 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:43.008453 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7788f19-92e2-4183-8656-4ec446d2286b None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:43.008627 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8954c-3bab-412c-b76b-4650385d18d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:43.008926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8954c-3bab-412c-b76b-4650385d18d5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:43.020272 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8954c-3bab-412c-b76b-4650385d18d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:00:43.029304 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-88c8954c-3bab-412c-b76b-4650385d18d5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:00:43.029304 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:43.029304 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:43.029304 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:43.029304 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:43.029304 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:43.029304 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:43.029304 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:43.029304 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:43.029304 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:43.029304 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:43.029304 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:43.029304 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:00:43.029304 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:00:43.029304 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:00:43.029304 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:00:43.030822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:00:43.030822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:00:43.030822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:00:43.030822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:00:43.030822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:43.030822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:43.030822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:43.030822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:43.030822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:43.030822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:43.030822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:43.030822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:43.030822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:43.030822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:43.030822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:43.030822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:43.031795 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:43.031795 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:43.031795 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:43.031795 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:43.031795 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:00:43.031795 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:00:43.031795 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:00:43.031795 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:00:43.031795 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:00:43.031795 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:00:43.031795 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:00:43.031795 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:43.032691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 541/1074] 10.222.0.46 () {56 vars in 1120 bytes} [Wed Jun 22 10:00:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:00:43.038340 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8954c-3bab-412c-b76b-4650385d18d5 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:43.048247 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704772b-1583-40a8-a3dc-b5863268a615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:43.048930 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704772b-1583-40a8-a3dc-b5863268a615 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:43.049256 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704772b-1583-40a8-a3dc-b5863268a615 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:43.049495 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704772b-1583-40a8-a3dc-b5863268a615 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:43.050455 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3704772b-1583-40a8-a3dc-b5863268a615 None admin] RBAC: Adding query filter params (role.id=106aa464a69a49b09de7de5417083d3c, scope.project.id=a9093805bc0c49198e89c6b77395a22b, user.id=c4a2dcb9213044f9b5759efa015e4abd) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:43.050768 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3704772b-1583-40a8-a3dc-b5863268a615 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:43.052328 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3704772b-1583-40a8-a3dc-b5863268a615 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:43.058252 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 534/1075] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 10:00:42 2022] GET /identity/v3/role_assignments?user.id=c4a2dcb9213044f9b5759efa015e4abd&scope.project.id=a9093805bc0c49198e89c6b77395a22b&role.id=106aa464a69a49b09de7de5417083d3c => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:00:43.160804 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8954c-3bab-412c-b76b-4650385d18d5 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:43.195448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:43.222759 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775177a-95df-4a50-b0a0-a353508d0b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:43.223450 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775177a-95df-4a50-b0a0-a353508d0b81 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:43.223733 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775177a-95df-4a50-b0a0-a353508d0b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:43.224005 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775177a-95df-4a50-b0a0-a353508d0b81 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:43.224961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775177a-95df-4a50-b0a0-a353508d0b81 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:43.225269 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775177a-95df-4a50-b0a0-a353508d0b81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:43.226649 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775177a-95df-4a50-b0a0-a353508d0b81 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:43.237502 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 542/1076] 10.222.0.46 () {56 vars in 1115 bytes} [Wed Jun 22 10:00:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:00:43.243532 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704772b-1583-40a8-a3dc-b5863268a615 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:43.352131 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704772b-1583-40a8-a3dc-b5863268a615 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:43.385736 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44719eae-0cce-4baa-83a5-896b5d66939e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:43.386525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44719eae-0cce-4baa-83a5-896b5d66939e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:43.386805 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44719eae-0cce-4baa-83a5-896b5d66939e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:43.387076 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44719eae-0cce-4baa-83a5-896b5d66939e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:43.398116 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44719eae-0cce-4baa-83a5-896b5d66939e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:43.399565 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44719eae-0cce-4baa-83a5-896b5d66939e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:43.417948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-44719eae-0cce-4baa-83a5-896b5d66939e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:43.417948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:43.417948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:43.417948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:43.417948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:43.417948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:43.417948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:43.417948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:43.417948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:43.417948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:43.417948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:43.417948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:43.417948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:00:43.417948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:00:43.417948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:00:43.418883 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:00:43.418883 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:43.418883 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:43.418883 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:43.418883 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:43.418883 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:43.418883 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:43.418883 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:43.418883 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:43.418883 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:43.418883 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:43.418883 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:43.418883 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:43.418883 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:43.418883 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:43.418883 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:43.418883 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:43.419780 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:00:43.419780 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:00:43.419780 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:43.419780 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:43.424009 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 535/1077] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:43.425054 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775177a-95df-4a50-b0a0-a353508d0b81 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:43.533637 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775177a-95df-4a50-b0a0-a353508d0b81 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:43.569223 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69289b28-148c-4ea8-b816-d0e8cf7ebc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:43.569890 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69289b28-148c-4ea8-b816-d0e8cf7ebc65 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:43.570175 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69289b28-148c-4ea8-b816-d0e8cf7ebc65 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:43.570448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69289b28-148c-4ea8-b816-d0e8cf7ebc65 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:43.571169 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69289b28-148c-4ea8-b816-d0e8cf7ebc65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:43.571473 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69289b28-148c-4ea8-b816-d0e8cf7ebc65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:43.572856 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69289b28-148c-4ea8-b816-d0e8cf7ebc65 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:43.585484 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 543/1078] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:43.590845 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44719eae-0cce-4baa-83a5-896b5d66939e None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:43.603394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:43.672326 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e64e3-f185-4508-b354-64defa29477a None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:43.672580 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e64e3-f185-4508-b354-64defa29477a None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:43.672959 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e64e3-f185-4508-b354-64defa29477a None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:43.674380 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 544/1079] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:43.682259 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c602b-9e23-4975-bc9d-5f5f3d761721 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:43.682614 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c602b-9e23-4975-bc9d-5f5f3d761721 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:43.683380 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c602b-9e23-4975-bc9d-5f5f3d761721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:43.702590 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-c64c602b-9e23-4975-bc9d-5f5f3d761721 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:43.704547 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-c64c602b-9e23-4975-bc9d-5f5f3d761721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:43.706014 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44719eae-0cce-4baa-83a5-896b5d66939e None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:43.741328 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:43.743641 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe668c3-829c-4bd8-91b4-f9ec865a5a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:43.744440 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe668c3-829c-4bd8-91b4-f9ec865a5a95 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:43.744723 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe668c3-829c-4bd8-91b4-f9ec865a5a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:43.745030 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe668c3-829c-4bd8-91b4-f9ec865a5a95 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:43.752908 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe668c3-829c-4bd8-91b4-f9ec865a5a95 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:43.754352 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe668c3-829c-4bd8-91b4-f9ec865a5a95 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:43.769600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-dbe668c3-829c-4bd8-91b4-f9ec865a5a95 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:00:43.769600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:43.769600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:43.769600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:43.769600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:43.769600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:43.769600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:43.769600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:43.769600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:43.769600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:43.769600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:43.769600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:43.769600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:00:43.769600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:00:43.769600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:00:43.769600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:00:43.770798 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:43.770798 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:43.770798 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:00:43.770798 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:00:43.770798 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:00:43.770798 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:00:43.770798 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:43.770798 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:43.770798 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:43.770798 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:43.770798 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:43.770798 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:43.770798 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:43.770798 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:43.770798 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:43.770798 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:43.770798 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:43.770798 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:43.772056 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:43.772056 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:43.772056 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:00:43.772056 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:00:43.772056 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:00:43.772056 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:00:43.772056 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:00:43.772056 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:00:43.772056 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:00:43.772056 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:43.775662 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 536/1080] 10.222.0.46 () {56 vars in 1093 bytes} [Wed Jun 22 10:00:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:43.776393 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe668c3-829c-4bd8-91b4-f9ec865a5a95 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:43.781303 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 545/1081] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:00:43.803145 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c602b-9e23-4975-bc9d-5f5f3d761721 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:43.857033 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:43.890247 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe668c3-829c-4bd8-91b4-f9ec865a5a95 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:43.913477 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c602b-9e23-4975-bc9d-5f5f3d761721 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:43.926169 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d342b-a3ed-4124-9d22-53c53195a085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:43.926921 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d342b-a3ed-4124-9d22-53c53195a085 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:43.927242 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d342b-a3ed-4124-9d22-53c53195a085 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:43.927472 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d342b-a3ed-4124-9d22-53c53195a085 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:43.928287 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d342b-a3ed-4124-9d22-53c53195a085 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:43.928595 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d342b-a3ed-4124-9d22-53c53195a085 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:43.930073 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d342b-a3ed-4124-9d22-53c53195a085 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:43.952497 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba64698-77ed-400a-8049-e2ad483dcc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:43.953209 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba64698-77ed-400a-8049-e2ad483dcc2c None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:43.953493 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba64698-77ed-400a-8049-e2ad483dcc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:43.953772 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba64698-77ed-400a-8049-e2ad483dcc2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:43.999311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 537/1082] 10.222.0.46 () {56 vars in 1133 bytes} [Wed Jun 22 10:00:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:00:44.001043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d342b-a3ed-4124-9d22-53c53195a085 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:44.026666 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:44.059733 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba64698-77ed-400a-8049-e2ad483dcc2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:44.061443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba64698-77ed-400a-8049-e2ad483dcc2c None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:44.117817 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d342b-a3ed-4124-9d22-53c53195a085 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:44.147578 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:44.157507 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874000c-b4d6-4ef9-a505-e6d2c5393a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:44.165913 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874000c-b4d6-4ef9-a505-e6d2c5393a6a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:44.165913 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874000c-b4d6-4ef9-a505-e6d2c5393a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:44.165913 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874000c-b4d6-4ef9-a505-e6d2c5393a6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:44.180856 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 546/1083] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 10:00:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 10:00:44.183990 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba64698-77ed-400a-8049-e2ad483dcc2c None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:44.234955 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874000c-b4d6-4ef9-a505-e6d2c5393a6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:44.236444 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874000c-b4d6-4ef9-a505-e6d2c5393a6a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:44.259967 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:44.293381 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba64698-77ed-400a-8049-e2ad483dcc2c None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:44.330819 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df071c43-9f57-4368-9f48-8a9cf736b076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:44.331977 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df071c43-9f57-4368-9f48-8a9cf736b076 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:44.332270 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df071c43-9f57-4368-9f48-8a9cf736b076 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:44.332555 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df071c43-9f57-4368-9f48-8a9cf736b076 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:44.343249 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df071c43-9f57-4368-9f48-8a9cf736b076 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:44.345343 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 538/1084] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 10:00:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:00:44.345794 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df071c43-9f57-4368-9f48-8a9cf736b076 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:44.350938 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874000c-b4d6-4ef9-a505-e6d2c5393a6a None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:44.366503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-df071c43-9f57-4368-9f48-8a9cf736b076 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:44.366503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:44.366503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:44.366503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:44.366503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:44.366503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:44.366503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:44.366503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:44.366503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:44.366503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:44.366503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:44.366503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:44.366503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:00:44.366503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:00:44.366503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:00:44.367519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:00:44.367519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:44.367519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:44.367519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:44.367519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:44.367519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:44.367519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:44.367519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:44.367519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:44.367519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:44.367519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:44.367519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:44.367519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:44.367519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:44.367519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:44.367519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:44.367519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:44.368582 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:00:44.368582 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:00:44.368582 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:44.368582 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:44.368582 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 547/1085] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:00:44.375846 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df071c43-9f57-4368-9f48-8a9cf736b076 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:44.383432 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:44.466185 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874000c-b4d6-4ef9-a505-e6d2c5393a6a None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:44.479815 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df071c43-9f57-4368-9f48-8a9cf736b076 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:44.504649 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:44.511029 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de90c6-d7c4-4cbe-a611-e33694d2ba3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:44.512078 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de90c6-d7c4-4cbe-a611-e33694d2ba3c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:44.512367 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de90c6-d7c4-4cbe-a611-e33694d2ba3c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:44.512646 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de90c6-d7c4-4cbe-a611-e33694d2ba3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:44.515365 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c2eef-ba59-4d6a-be9d-42053ca243e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:44.516029 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c2eef-ba59-4d6a-be9d-42053ca243e4 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:44.516314 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c2eef-ba59-4d6a-be9d-42053ca243e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:44.516593 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c2eef-ba59-4d6a-be9d-42053ca243e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:44.517405 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c2eef-ba59-4d6a-be9d-42053ca243e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:44.523295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c2eef-ba59-4d6a-be9d-42053ca243e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:44.523295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c2eef-ba59-4d6a-be9d-42053ca243e4 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:44.524806 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de90c6-d7c4-4cbe-a611-e33694d2ba3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:44.526953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de90c6-d7c4-4cbe-a611-e33694d2ba3c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:44.540853 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 548/1086] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:44.548788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-25de90c6-d7c4-4cbe-a611-e33694d2ba3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:44.548788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:44.548788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:44.548788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:44.548788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:44.548788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:44.548788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:44.548788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:44.548788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:44.548788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:44.548788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:44.548788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:44.548788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:00:44.548788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:00:44.548788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:00:44.549807 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:00:44.549807 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:44.549807 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:44.549807 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:44.549807 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:44.549807 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:44.549807 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:44.549807 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:44.549807 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:44.549807 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:44.549807 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:44.549807 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:44.549807 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:44.549807 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:44.549807 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:44.549807 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:44.549807 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:44.550727 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:00:44.550727 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:00:44.550727 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:00:44.550727 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:44.553195 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 539/1087] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:00:44.556071 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c2eef-ba59-4d6a-be9d-42053ca243e4 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:44.673200 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c2eef-ba59-4d6a-be9d-42053ca243e4 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:44.713744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d875e5-a05f-482c-a6ed-6a6b077d0957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:44.714853 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d875e5-a05f-482c-a6ed-6a6b077d0957 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:44.714853 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d875e5-a05f-482c-a6ed-6a6b077d0957 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:44.715091 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d875e5-a05f-482c-a6ed-6a6b077d0957 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:44.715779 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d875e5-a05f-482c-a6ed-6a6b077d0957 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:44.716086 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d875e5-a05f-482c-a6ed-6a6b077d0957 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:44.717493 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d875e5-a05f-482c-a6ed-6a6b077d0957 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:44.731266 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 549/1088] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:44.737105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de90c6-d7c4-4cbe-a611-e33694d2ba3c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:44.826568 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:44.847640 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de90c6-d7c4-4cbe-a611-e33694d2ba3c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:44.882800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16bc8e-d94f-41d5-8b43-45c1e2c9c930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:44.883600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16bc8e-d94f-41d5-8b43-45c1e2c9c930 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:44.883885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16bc8e-d94f-41d5-8b43-45c1e2c9c930 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:44.884164 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16bc8e-d94f-41d5-8b43-45c1e2c9c930 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:44.891691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16bc8e-d94f-41d5-8b43-45c1e2c9c930 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:44.893249 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16bc8e-d94f-41d5-8b43-45c1e2c9c930 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:44.907997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-0c16bc8e-d94f-41d5-8b43-45c1e2c9c930 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:00:44.907997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:44.907997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:44.907997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:44.907997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:44.907997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:44.907997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:44.907997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:44.907997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:44.907997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:44.907997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:44.907997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:44.907997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:00:44.907997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:00:44.907997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:00:44.908945 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:00:44.908945 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:44.908945 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:44.908945 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:44.908945 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:44.908945 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:44.908945 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:44.908945 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:44.908945 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:44.908945 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:44.908945 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:44.908945 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:44.908945 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:44.908945 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:44.908945 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:44.908945 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:44.908945 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:44.910015 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:00:44.910015 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:00:44.910015 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:00:44.910015 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:00:44.910015 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:00:44.910015 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:00:44.910015 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:00:44.910015 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:44.910015 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 540/1089] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 10:00:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:44.915111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d875e5-a05f-482c-a6ed-6a6b077d0957 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:45.026973 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:45.081473 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d875e5-a05f-482c-a6ed-6a6b077d0957 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:45.114316 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccf699-99f9-43ef-9248-661dfd83568d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:45.114975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccf699-99f9-43ef-9248-661dfd83568d None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:45.115255 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccf699-99f9-43ef-9248-661dfd83568d None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:45.115534 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccf699-99f9-43ef-9248-661dfd83568d None admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:45.116314 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccf699-99f9-43ef-9248-661dfd83568d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:45.116619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccf699-99f9-43ef-9248-661dfd83568d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:45.118090 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccf699-99f9-43ef-9248-661dfd83568d None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:45.129813 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 550/1090] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 10:00:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:45.135750 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16bc8e-d94f-41d5-8b43-45c1e2c9c930 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:45.141323 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfe067-b0cf-4ddd-8923-b32300173e6b None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:45.141612 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfe067-b0cf-4ddd-8923-b32300173e6b None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:45.141894 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfe067-b0cf-4ddd-8923-b32300173e6b None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:45.143245 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 551/1091] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:45.148384 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7a16c-df3a-465a-8781-a47f786d3f60 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:45.148675 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7a16c-df3a-465a-8781-a47f786d3f60 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:45.148992 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7a16c-df3a-465a-8781-a47f786d3f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:45.165270 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-86a7a16c-df3a-465a-8781-a47f786d3f60 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:45.166451 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-86a7a16c-df3a-465a-8781-a47f786d3f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:45.233511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16bc8e-d94f-41d5-8b43-45c1e2c9c930 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:45.233829 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 552/1092] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:00:45.257136 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7a16c-df3a-465a-8781-a47f786d3f60 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:45.266938 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab501e4-0cd3-4fd9-b182-a6535abd0a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:45.267595 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab501e4-0cd3-4fd9-b182-a6535abd0a8a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:45.267873 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab501e4-0cd3-4fd9-b182-a6535abd0a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:45.268146 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab501e4-0cd3-4fd9-b182-a6535abd0a8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:45.268992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab501e4-0cd3-4fd9-b182-a6535abd0a8a None admin] RBAC: Adding query filter params (role.id=263cc0eba7e54b5ab2d884bfb15f6a93, scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9, user.id=4ed9a00723ab4af2b633ab7614d178a8) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:45.269300 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab501e4-0cd3-4fd9-b182-a6535abd0a8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:45.271003 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab501e4-0cd3-4fd9-b182-a6535abd0a8a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:45.277126 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 541/1093] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 10:00:45 2022] GET /identity/v3/role_assignments?user.id=4ed9a00723ab4af2b633ab7614d178a8&scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9&role.id=263cc0eba7e54b5ab2d884bfb15f6a93 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:45.287222 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:45.362201 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7a16c-df3a-465a-8781-a47f786d3f60 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:45.398804 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9e39b-2173-46a3-a7b6-dc167b709f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:45.399600 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9e39b-2173-46a3-a7b6-dc167b709f61 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:45.399879 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9e39b-2173-46a3-a7b6-dc167b709f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:45.400149 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9e39b-2173-46a3-a7b6-dc167b709f61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:45.411684 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9e39b-2173-46a3-a7b6-dc167b709f61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:00:45.419586 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-95d9e39b-2173-46a3-a7b6-dc167b709f61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:00:45.419586 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:45.419586 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:45.419586 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:45.419586 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:45.419586 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:45.419586 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:45.419586 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:45.419586 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:45.419586 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:45.419586 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:45.419586 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:45.419586 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:00:45.419586 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:00:45.419586 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:00:45.419586 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:00:45.420626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:00:45.420626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:00:45.420626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:00:45.420626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:00:45.420626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:45.420626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:45.420626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:45.420626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:45.420626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:45.420626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:45.420626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:45.420626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:45.420626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:45.420626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:45.420626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:45.420626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:45.422007 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:45.422007 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:45.422007 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:45.422007 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:45.422007 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:00:45.422007 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:00:45.422007 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:00:45.422007 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:00:45.422007 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:00:45.422007 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:00:45.422007 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:00:45.422007 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:00:45.422007 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 553/1094] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 10:00:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:00:45.427659 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab501e4-0cd3-4fd9-b182-a6535abd0a8a None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:45.431533 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:45.534445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab501e4-0cd3-4fd9-b182-a6535abd0a8a None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:45.572291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034eb881-cc8c-4d8b-8195-32af0de78ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:45.572999 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034eb881-cc8c-4d8b-8195-32af0de78ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:45.573283 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034eb881-cc8c-4d8b-8195-32af0de78ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:45.573560 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034eb881-cc8c-4d8b-8195-32af0de78ed1 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:45.574573 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034eb881-cc8c-4d8b-8195-32af0de78ed1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:45.574882 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034eb881-cc8c-4d8b-8195-32af0de78ed1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:45.576254 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034eb881-cc8c-4d8b-8195-32af0de78ed1 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:45.586215 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 542/1095] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 10:00:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:45.592359 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9e39b-2173-46a3-a7b6-dc167b709f61 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:45.691778 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:45.700513 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9e39b-2173-46a3-a7b6-dc167b709f61 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:45.737129 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8efb0d-fbb3-4f4d-9f70-80bfc09753cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:45.738004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8efb0d-fbb3-4f4d-9f70-80bfc09753cb None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:45.738288 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8efb0d-fbb3-4f4d-9f70-80bfc09753cb None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:45.738563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8efb0d-fbb3-4f4d-9f70-80bfc09753cb None admin] PATH_INFO: `/v3/users/c4a2dcb9213044f9b5759efa015e4abd` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:45.739773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8efb0d-fbb3-4f4d-9f70-80bfc09753cb None admin] RBAC: Authorizing `identity:get_user(user_id=c4a2dcb9213044f9b5759efa015e4abd)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:45.741234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8efb0d-fbb3-4f4d-9f70-80bfc09753cb None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:45.742880 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 554/1096] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 10:00:45 2022] GET /identity/v3/users/c4a2dcb9213044f9b5759efa015e4abd => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:45.748611 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034eb881-cc8c-4d8b-8195-32af0de78ed1 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:45.819792 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:45.856221 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034eb881-cc8c-4d8b-8195-32af0de78ed1 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:45.890586 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed7a9b-11dc-4707-a0df-37620bc87ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:45.891451 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed7a9b-11dc-4707-a0df-37620bc87ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:45.891740 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed7a9b-11dc-4707-a0df-37620bc87ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:45.892019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed7a9b-11dc-4707-a0df-37620bc87ea7 None admin] PATH_INFO: `/v3/projects/a9093805bc0c49198e89c6b77395a22b` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:45.893290 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed7a9b-11dc-4707-a0df-37620bc87ea7 None admin] RBAC: Authorizing `identity:get_project(project_id=a9093805bc0c49198e89c6b77395a22b)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:45.900390 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed7a9b-11dc-4707-a0df-37620bc87ea7 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:45.900390 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 543/1097] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 10:00:45 2022] GET /identity/v3/projects/a9093805bc0c49198e89c6b77395a22b => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:45.902984 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8efb0d-fbb3-4f4d-9f70-80bfc09753cb None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:46.045740 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8efb0d-fbb3-4f4d-9f70-80bfc09753cb None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:46.082639 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fa88f-1723-44a8-90de-939d1c915806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:46.083462 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fa88f-1723-44a8-90de-939d1c915806 None admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:46.083745 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fa88f-1723-44a8-90de-939d1c915806 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:46.084020 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fa88f-1723-44a8-90de-939d1c915806 None admin] PATH_INFO: `/v3/projects/a9093805bc0c49198e89c6b77395a22b/users/c4a2dcb9213044f9b5759efa015e4abd/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:46.086031 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665fa88f-1723-44a8-90de-939d1c915806 None admin] RBAC: Authorizing `identity:create_grant(project_id=a9093805bc0c49198e89c6b77395a22b, user_id=c4a2dcb9213044f9b5759efa015e4abd, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:46.087461 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665fa88f-1723-44a8-90de-939d1c915806 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:46.159704 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 555/1098] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 22 10:00:45 2022] PUT /identity/v3/projects/a9093805bc0c49198e89c6b77395a22b/users/c4a2dcb9213044f9b5759efa015e4abd/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:00:48.168707 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc513e-c331-4ae0-ae96-fcdaa702baa9 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:48.169282 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc513e-c331-4ae0-ae96-fcdaa702baa9 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:48.169282 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc513e-c331-4ae0-ae96-fcdaa702baa9 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:48.170651 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 544/1099] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:48.176284 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8049c-2e8b-4980-80bb-7ff5d7a8dac1 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:48.176707 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8049c-2e8b-4980-80bb-7ff5d7a8dac1 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:48.176865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8049c-2e8b-4980-80bb-7ff5d7a8dac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:48.193654 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-12a8049c-2e8b-4980-80bb-7ff5d7a8dac1 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:48.194831 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-12a8049c-2e8b-4980-80bb-7ff5d7a8dac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:48.208485 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:48.259238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 556/1100] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:00:48.283886 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc513e-c331-4ae0-ae96-fcdaa702baa9 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:48.382565 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc513e-c331-4ae0-ae96-fcdaa702baa9 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:48.415636 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13340695-6034-459c-bd5d-fbd02ff18d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:48.416422 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13340695-6034-459c-bd5d-fbd02ff18d9e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:48.416708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13340695-6034-459c-bd5d-fbd02ff18d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:48.417011 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13340695-6034-459c-bd5d-fbd02ff18d9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:48.418905 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:48.427313 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13340695-6034-459c-bd5d-fbd02ff18d9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:00:48.434977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-13340695-6034-459c-bd5d-fbd02ff18d9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:00:48.434977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:00:48.434977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:00:48.434977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:00:48.434977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:00:48.434977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:00:48.434977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:00:48.434977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:00:48.434977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:00:48.434977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:00:48.434977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:00:48.434977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:00:48.434977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:00:48.434977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:00:48.434977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:00:48.434977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:00:48.440963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:00:48.440963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:00:48.440963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:00:48.440963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:00:48.440963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:00:48.440963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:00:48.440963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:00:48.440963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:00:48.440963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:00:48.440963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:00:48.440963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:00:48.440963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:00:48.440963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:00:48.440963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:00:48.440963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:00:48.440963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:00:48.441997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:00:48.441997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:00:48.441997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:00:48.441997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:00:48.441997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:00:48.441997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:00:48.441997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:00:48.441997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:00:48.441997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:00:48.441997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:00:48.441997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:00:48.441997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:00:48.441997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 545/1101] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 10:00:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:00:48.442867 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8049c-2e8b-4980-80bb-7ff5d7a8dac1 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:48.538203 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8049c-2e8b-4980-80bb-7ff5d7a8dac1 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:48.570606 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f9456-d958-4fe2-a892-bb7ea43bfa38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:48.571267 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f9456-d958-4fe2-a892-bb7ea43bfa38 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:48.571551 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f9456-d958-4fe2-a892-bb7ea43bfa38 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:48.571829 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f9456-d958-4fe2-a892-bb7ea43bfa38 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:48.572572 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f9456-d958-4fe2-a892-bb7ea43bfa38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:48.572911 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f9456-d958-4fe2-a892-bb7ea43bfa38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:48.574534 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f9456-d958-4fe2-a892-bb7ea43bfa38 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:48.582892 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 557/1102] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 10:00:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:48.588982 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13340695-6034-459c-bd5d-fbd02ff18d9e None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:48.695638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13340695-6034-459c-bd5d-fbd02ff18d9e None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:48.729082 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613bf87-84c8-4316-b569-cfbf5ad6926e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:48.729951 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613bf87-84c8-4316-b569-cfbf5ad6926e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:48.730302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613bf87-84c8-4316-b569-cfbf5ad6926e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:48.730585 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613bf87-84c8-4316-b569-cfbf5ad6926e None admin] PATH_INFO: `/v3/users/c4a2dcb9213044f9b5759efa015e4abd` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:48.731782 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613bf87-84c8-4316-b569-cfbf5ad6926e None admin] RBAC: Authorizing `identity:get_user(user_id=c4a2dcb9213044f9b5759efa015e4abd)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:48.733260 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613bf87-84c8-4316-b569-cfbf5ad6926e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:48.735448 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 546/1103] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 10:00:48 2022] GET /identity/v3/users/c4a2dcb9213044f9b5759efa015e4abd => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:48.741237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f9456-d958-4fe2-a892-bb7ea43bfa38 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:48.755985 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:48.838244 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f9456-d958-4fe2-a892-bb7ea43bfa38 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:48.871029 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fe694-e11d-429e-835e-3815075539f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:48.871669 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fe694-e11d-429e-835e-3815075539f4 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:48.871953 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fe694-e11d-429e-835e-3815075539f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:48.872224 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fe694-e11d-429e-835e-3815075539f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:48.943678 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962fe694-e11d-429e-835e-3815075539f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:48.945157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962fe694-e11d-429e-835e-3815075539f4 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:48.960703 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:49.042953 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 558/1104] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 10:00:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:00:49.048911 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613bf87-84c8-4316-b569-cfbf5ad6926e None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:49.108470 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:49.146008 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613bf87-84c8-4316-b569-cfbf5ad6926e None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:49.177712 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657c050-5efc-4fd7-ae22-5978cb01e6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:49.178557 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657c050-5efc-4fd7-ae22-5978cb01e6ce None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:49.178839 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657c050-5efc-4fd7-ae22-5978cb01e6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:49.179114 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657c050-5efc-4fd7-ae22-5978cb01e6ce None admin] PATH_INFO: `/v3/projects/a9093805bc0c49198e89c6b77395a22b` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:49.180295 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657c050-5efc-4fd7-ae22-5978cb01e6ce None admin] RBAC: Authorizing `identity:get_project(project_id=a9093805bc0c49198e89c6b77395a22b)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:49.181751 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657c050-5efc-4fd7-ae22-5978cb01e6ce None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:49.183451 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 547/1105] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 10:00:49 2022] GET /identity/v3/projects/a9093805bc0c49198e89c6b77395a22b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:49.190157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fe694-e11d-429e-835e-3815075539f4 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:49.285377 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fe694-e11d-429e-835e-3815075539f4 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:49.300372 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:49.321285 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583ba53-ba1e-4724-9e86-f0ac7e7ee99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:49.324277 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583ba53-ba1e-4724-9e86-f0ac7e7ee99f None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:49.324277 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583ba53-ba1e-4724-9e86-f0ac7e7ee99f None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:49.324277 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583ba53-ba1e-4724-9e86-f0ac7e7ee99f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:49.324277 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583ba53-ba1e-4724-9e86-f0ac7e7ee99f None admin] RBAC: Adding query filter params (role.id=106aa464a69a49b09de7de5417083d3c, scope.project.id=a9093805bc0c49198e89c6b77395a22b, user.id=c4a2dcb9213044f9b5759efa015e4abd) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:49.324277 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583ba53-ba1e-4724-9e86-f0ac7e7ee99f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:49.325287 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583ba53-ba1e-4724-9e86-f0ac7e7ee99f None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:49.331556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 559/1106] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 10:00:49 2022] GET /identity/v3/role_assignments?user.id=c4a2dcb9213044f9b5759efa015e4abd&scope.project.id=a9093805bc0c49198e89c6b77395a22b&role.id=106aa464a69a49b09de7de5417083d3c => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:51.393349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93411a8-0fe9-46be-bcd1-9f0a58f45ad8 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:51.393912 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93411a8-0fe9-46be-bcd1-9f0a58f45ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:51.393912 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93411a8-0fe9-46be-bcd1-9f0a58f45ad8 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:51.395262 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 548/1107] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:51.400532 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f089b-cf4b-40ef-a638-f188d56a00aa None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:51.400977 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f089b-cf4b-40ef-a638-f188d56a00aa None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:51.401111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f089b-cf4b-40ef-a638-f188d56a00aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:51.417522 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-cb4f089b-cf4b-40ef-a638-f188d56a00aa None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:51.418693 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-cb4f089b-cf4b-40ef-a638-f188d56a00aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:51.482481 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 560/1108] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:00:51.507761 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93411a8-0fe9-46be-bcd1-9f0a58f45ad8 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:51.616909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93411a8-0fe9-46be-bcd1-9f0a58f45ad8 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:51.645648 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:51.651255 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee236fe-a32e-4ddf-944a-ba083dc72be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:51.652047 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee236fe-a32e-4ddf-944a-ba083dc72be1 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:51.652332 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee236fe-a32e-4ddf-944a-ba083dc72be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:51.652612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee236fe-a32e-4ddf-944a-ba083dc72be1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:51.653813 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee236fe-a32e-4ddf-944a-ba083dc72be1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:51.662012 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee236fe-a32e-4ddf-944a-ba083dc72be1 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:51.662012 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 549/1109] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:00:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:51.663104 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f089b-cf4b-40ef-a638-f188d56a00aa None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:51.759677 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f089b-cf4b-40ef-a638-f188d56a00aa None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:51.766664 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:51.792006 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8143dcc-36d4-412f-96d5-fb5689e89a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:51.792885 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8143dcc-36d4-412f-96d5-fb5689e89a4b None admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:51.793380 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8143dcc-36d4-412f-96d5-fb5689e89a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:51.793944 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8143dcc-36d4-412f-96d5-fb5689e89a4b None admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:51.794674 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8143dcc-36d4-412f-96d5-fb5689e89a4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:51.796614 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8143dcc-36d4-412f-96d5-fb5689e89a4b None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:51.884289 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 561/1110] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 22 10:00:51 2022] POST /identity/v3/users => generated 286 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:00:53.961386 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf5b9e-477f-4477-8c1d-9d2eb550755b None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:53.961889 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf5b9e-477f-4477-8c1d-9d2eb550755b None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:53.961981 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf5b9e-477f-4477-8c1d-9d2eb550755b None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:53.963914 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 550/1111] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:53.969830 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b02b5-fb99-4c77-a6ed-b371e4c79aaf None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:53.970254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b02b5-fb99-4c77-a6ed-b371e4c79aaf None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:53.970392 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b02b5-fb99-4c77-a6ed-b371e4c79aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:53.987281 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-207b02b5-fb99-4c77-a6ed-b371e4c79aaf None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:53.988460 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-207b02b5-fb99-4c77-a6ed-b371e4c79aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:54.052178 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 562/1112] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:00:54.076585 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf5b9e-477f-4477-8c1d-9d2eb550755b None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:54.175507 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf5b9e-477f-4477-8c1d-9d2eb550755b None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:54.208442 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4837c6f-13d6-4f4a-9914-b56aee042a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:54.209311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4837c6f-13d6-4f4a-9914-b56aee042a07 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:54.209592 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4837c6f-13d6-4f4a-9914-b56aee042a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:54.209864 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4837c6f-13d6-4f4a-9914-b56aee042a07 None admin] PATH_INFO: `/v3/roles/7783830649d941ea9507439a113fc5d9` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:54.211331 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4837c6f-13d6-4f4a-9914-b56aee042a07 None admin] RBAC: Authorizing `identity:get_role(role_id=7783830649d941ea9507439a113fc5d9)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:54.212751 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4837c6f-13d6-4f4a-9914-b56aee042a07 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:54.214248 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 551/1113] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 10:00:54 2022] GET /identity/v3/roles/7783830649d941ea9507439a113fc5d9 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:54.220193 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b02b5-fb99-4c77-a6ed-b371e4c79aaf None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:54.313110 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:54.321817 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b02b5-fb99-4c77-a6ed-b371e4c79aaf None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:54.355971 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c04e4-6df3-4922-b306-b50ef712f3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:54.358213 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c04e4-6df3-4922-b306-b50ef712f3ff None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:54.358213 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c04e4-6df3-4922-b306-b50ef712f3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:54.358213 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c04e4-6df3-4922-b306-b50ef712f3ff None admin] PATH_INFO: `/v3/users/78ac278bff3748268d5f353e8f7a309a` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:54.370222 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c04e4-6df3-4922-b306-b50ef712f3ff None admin] RBAC: Authorizing `identity:get_user(user_id=78ac278bff3748268d5f353e8f7a309a)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:54.371675 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c04e4-6df3-4922-b306-b50ef712f3ff None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:54.373419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 563/1114] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 10:00:54 2022] GET /identity/v3/users/78ac278bff3748268d5f353e8f7a309a => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:54.379756 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4837c6f-13d6-4f4a-9914-b56aee042a07 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:54.444186 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:54.478031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4837c6f-13d6-4f4a-9914-b56aee042a07 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:54.511086 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f43b2-41ec-4f7e-9644-533e198e88ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:54.511712 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f43b2-41ec-4f7e-9644-533e198e88ea None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:54.511998 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f43b2-41ec-4f7e-9644-533e198e88ea None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:54.512278 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f43b2-41ec-4f7e-9644-533e198e88ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:54.577451 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f43b2-41ec-4f7e-9644-533e198e88ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:54.578900 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f43b2-41ec-4f7e-9644-533e198e88ea None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:54.641767 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:54.675177 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 552/1115] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 10:00:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:00:54.681251 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c04e4-6df3-4922-b306-b50ef712f3ff None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:54.779369 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c04e4-6df3-4922-b306-b50ef712f3ff None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:54.811862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f1d2b-c1d3-414f-845e-19b456c7d2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:54.812703 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f1d2b-c1d3-414f-845e-19b456c7d2d9 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:54.813017 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f1d2b-c1d3-414f-845e-19b456c7d2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:54.813295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f1d2b-c1d3-414f-845e-19b456c7d2d9 None admin] PATH_INFO: `/v3/projects/a9093805bc0c49198e89c6b77395a22b` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:54.814468 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f1d2b-c1d3-414f-845e-19b456c7d2d9 None admin] RBAC: Authorizing `identity:get_project(project_id=a9093805bc0c49198e89c6b77395a22b)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:54.815877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f1d2b-c1d3-414f-845e-19b456c7d2d9 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:54.817599 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 564/1116] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 10:00:54 2022] GET /identity/v3/projects/a9093805bc0c49198e89c6b77395a22b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:54.823973 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f43b2-41ec-4f7e-9644-533e198e88ea None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:54.920172 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f43b2-41ec-4f7e-9644-533e198e88ea None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:54.953245 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa35dec-8203-4152-9822-59224f8eba9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:54.953892 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa35dec-8203-4152-9822-59224f8eba9d None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:54.954176 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa35dec-8203-4152-9822-59224f8eba9d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:54.954457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa35dec-8203-4152-9822-59224f8eba9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:54.955320 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa35dec-8203-4152-9822-59224f8eba9d None admin] RBAC: Adding query filter params (role.id=7783830649d941ea9507439a113fc5d9, scope.project.id=a9093805bc0c49198e89c6b77395a22b, user.id=78ac278bff3748268d5f353e8f7a309a) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:00:54.955641 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa35dec-8203-4152-9822-59224f8eba9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:54.957095 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa35dec-8203-4152-9822-59224f8eba9d None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:54.962381 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 553/1117] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 10:00:54 2022] GET /identity/v3/role_assignments?user.id=78ac278bff3748268d5f353e8f7a309a&scope.project.id=a9093805bc0c49198e89c6b77395a22b&role.id=7783830649d941ea9507439a113fc5d9 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:56.970865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c2479-6763-4d89-af90-1858985a9538 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:56.971358 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c2479-6763-4d89-af90-1858985a9538 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:56.971358 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c2479-6763-4d89-af90-1858985a9538 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:56.972703 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 565/1118] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:00:56.977893 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864a702-c218-4a20-8990-d3906ce2b2ac None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:56.978335 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864a702-c218-4a20-8990-d3906ce2b2ac None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:56.978451 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864a702-c218-4a20-8990-d3906ce2b2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:57.007430 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-5864a702-c218-4a20-8990-d3906ce2b2ac None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:57.008652 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-5864a702-c218-4a20-8990-d3906ce2b2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:57.036421 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:57.078816 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 554/1119] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:00:57.101385 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c2479-6763-4d89-af90-1858985a9538 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:57.119943 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:57.201144 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c2479-6763-4d89-af90-1858985a9538 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:57.234827 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19888199-6c4a-4d64-9141-e65d31201d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:57.235606 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19888199-6c4a-4d64-9141-e65d31201d08 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:57.235898 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19888199-6c4a-4d64-9141-e65d31201d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:57.236179 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19888199-6c4a-4d64-9141-e65d31201d08 None admin] PATH_INFO: `/v3/roles/7783830649d941ea9507439a113fc5d9` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:57.237760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19888199-6c4a-4d64-9141-e65d31201d08 None admin] RBAC: Authorizing `identity:get_role(role_id=7783830649d941ea9507439a113fc5d9)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:57.239124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19888199-6c4a-4d64-9141-e65d31201d08 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:57.240510 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 566/1120] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 10:00:57 2022] GET /identity/v3/roles/7783830649d941ea9507439a113fc5d9 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:57.246742 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864a702-c218-4a20-8990-d3906ce2b2ac None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:57.345209 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864a702-c218-4a20-8990-d3906ce2b2ac None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:57.378785 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033bff3-5ed1-4f0b-9e8e-5c1cdac4e098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:57.379653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033bff3-5ed1-4f0b-9e8e-5c1cdac4e098 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:57.379935 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033bff3-5ed1-4f0b-9e8e-5c1cdac4e098 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:57.380215 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033bff3-5ed1-4f0b-9e8e-5c1cdac4e098 None admin] PATH_INFO: `/v3/users/78ac278bff3748268d5f353e8f7a309a` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:57.381427 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033bff3-5ed1-4f0b-9e8e-5c1cdac4e098 None admin] RBAC: Authorizing `identity:get_user(user_id=78ac278bff3748268d5f353e8f7a309a)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:57.382859 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033bff3-5ed1-4f0b-9e8e-5c1cdac4e098 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:57.384495 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 555/1121] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 10:00:57 2022] GET /identity/v3/users/78ac278bff3748268d5f353e8f7a309a => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:00:57.391102 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19888199-6c4a-4d64-9141-e65d31201d08 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:57.473823 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:57.490315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19888199-6c4a-4d64-9141-e65d31201d08 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:57.521542 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b213bc-221b-4211-854e-c44fd6c48a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:57.522391 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b213bc-221b-4211-854e-c44fd6c48a80 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:57.522674 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b213bc-221b-4211-854e-c44fd6c48a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:57.522950 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b213bc-221b-4211-854e-c44fd6c48a80 None admin] PATH_INFO: `/v3/projects/a9093805bc0c49198e89c6b77395a22b` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:57.524127 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b213bc-221b-4211-854e-c44fd6c48a80 None admin] RBAC: Authorizing `identity:get_project(project_id=a9093805bc0c49198e89c6b77395a22b)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:57.525581 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b213bc-221b-4211-854e-c44fd6c48a80 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:57.527273 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 567/1122] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 10:00:57 2022] GET /identity/v3/projects/a9093805bc0c49198e89c6b77395a22b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:00:57.533293 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033bff3-5ed1-4f0b-9e8e-5c1cdac4e098 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:00:57.560248 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:00:57.628899 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033bff3-5ed1-4f0b-9e8e-5c1cdac4e098 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:00:57.671226 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c650c1-e7b8-4a96-a9e2-f4c68a6fa92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:00:57.672112 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c650c1-e7b8-4a96-a9e2-f4c68a6fa92b None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:57.672396 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c650c1-e7b8-4a96-a9e2-f4c68a6fa92b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:57.672674 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c650c1-e7b8-4a96-a9e2-f4c68a6fa92b None admin] PATH_INFO: `/v3/projects/a9093805bc0c49198e89c6b77395a22b/users/78ac278bff3748268d5f353e8f7a309a/roles/7783830649d941ea9507439a113fc5d9` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:57.674911 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c650c1-e7b8-4a96-a9e2-f4c68a6fa92b None admin] RBAC: Authorizing `identity:create_grant(project_id=a9093805bc0c49198e89c6b77395a22b, user_id=78ac278bff3748268d5f353e8f7a309a, role_id=7783830649d941ea9507439a113fc5d9)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:00:57.676347 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c650c1-e7b8-4a96-a9e2-f4c68a6fa92b None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:00:57.761564 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 556/1123] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 22 10:00:57 2022] PUT /identity/v3/projects/a9093805bc0c49198e89c6b77395a22b/users/78ac278bff3748268d5f353e8f7a309a/roles/7783830649d941ea9507439a113fc5d9 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:00:59.791706 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cd483-a924-4fce-9cef-3664de92af4c None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:59.792250 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cd483-a924-4fce-9cef-3664de92af4c None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:59.792250 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cd483-a924-4fce-9cef-3664de92af4c None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:59.793655 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 568/1124] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:00:59.799330 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73177fe-1720-4ad0-866b-888ee39444d6 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:00:59.799701 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73177fe-1720-4ad0-866b-888ee39444d6 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:00:59.799890 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73177fe-1720-4ad0-866b-888ee39444d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:00:59.816443 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-a73177fe-1720-4ad0-866b-888ee39444d6 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:00:59.817672 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-a73177fe-1720-4ad0-866b-888ee39444d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:00:59.882685 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 557/1125] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:00:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:00:59.906644 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633cd483-a924-4fce-9cef-3664de92af4c None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:00.006916 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633cd483-a924-4fce-9cef-3664de92af4c None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:00.040160 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca73b9f-fc7c-40f4-8547-0c8b9656e64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:00.041029 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca73b9f-fc7c-40f4-8547-0c8b9656e64e None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:00.041313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca73b9f-fc7c-40f4-8547-0c8b9656e64e None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:00.041590 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca73b9f-fc7c-40f4-8547-0c8b9656e64e None admin] PATH_INFO: `/v3/roles/7783830649d941ea9507439a113fc5d9` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:00.043051 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca73b9f-fc7c-40f4-8547-0c8b9656e64e None admin] RBAC: Authorizing `identity:get_role(role_id=7783830649d941ea9507439a113fc5d9)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:00.044407 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca73b9f-fc7c-40f4-8547-0c8b9656e64e None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:00.045834 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 569/1126] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 10:00:59 2022] GET /identity/v3/roles/7783830649d941ea9507439a113fc5d9 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:00.051823 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73177fe-1720-4ad0-866b-888ee39444d6 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:00.069763 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:00.149718 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73177fe-1720-4ad0-866b-888ee39444d6 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:00.183146 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510480b9-8724-4cb5-befa-a4f955e1af59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:00.184028 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510480b9-8724-4cb5-befa-a4f955e1af59 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:00.184315 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510480b9-8724-4cb5-befa-a4f955e1af59 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:00.184594 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510480b9-8724-4cb5-befa-a4f955e1af59 None admin] PATH_INFO: `/v3/users/78ac278bff3748268d5f353e8f7a309a` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:00.186411 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510480b9-8724-4cb5-befa-a4f955e1af59 None admin] RBAC: Authorizing `identity:get_user(user_id=78ac278bff3748268d5f353e8f7a309a)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:00.187850 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510480b9-8724-4cb5-befa-a4f955e1af59 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:00.189511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 558/1127] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 10:01:00 2022] GET /identity/v3/users/78ac278bff3748268d5f353e8f7a309a => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:00.195559 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca73b9f-fc7c-40f4-8547-0c8b9656e64e None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:00.219611 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:00.292081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca73b9f-fc7c-40f4-8547-0c8b9656e64e None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:00.325440 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1c57c-4a1b-4447-9ea4-60e8ae277620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:00.326085 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1c57c-4a1b-4447-9ea4-60e8ae277620 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:00.326392 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1c57c-4a1b-4447-9ea4-60e8ae277620 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:00.326672 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1c57c-4a1b-4447-9ea4-60e8ae277620 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:00.390863 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1c57c-4a1b-4447-9ea4-60e8ae277620 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:00.392302 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1c57c-4a1b-4447-9ea4-60e8ae277620 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:00.414881 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:00.488108 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 570/1128] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 10:01:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:01:00.494001 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510480b9-8724-4cb5-befa-a4f955e1af59 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:00.574097 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:00.587905 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510480b9-8724-4cb5-befa-a4f955e1af59 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:00.621650 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b32d15-ec3b-443e-bc80-84f056a3bb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:00.622503 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b32d15-ec3b-443e-bc80-84f056a3bb22 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:00.622785 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b32d15-ec3b-443e-bc80-84f056a3bb22 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:00.623059 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b32d15-ec3b-443e-bc80-84f056a3bb22 None admin] PATH_INFO: `/v3/projects/a9093805bc0c49198e89c6b77395a22b` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:00.624251 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b32d15-ec3b-443e-bc80-84f056a3bb22 None admin] RBAC: Authorizing `identity:get_project(project_id=a9093805bc0c49198e89c6b77395a22b)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:00.625726 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b32d15-ec3b-443e-bc80-84f056a3bb22 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:00.627434 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 559/1129] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 10:01:00 2022] GET /identity/v3/projects/a9093805bc0c49198e89c6b77395a22b => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:00.633486 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1c57c-4a1b-4447-9ea4-60e8ae277620 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:00.729925 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1c57c-4a1b-4447-9ea4-60e8ae277620 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:00.752653 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:00.765666 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd0af6-01d9-4ff1-bb8e-61e80f59f442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:00.766317 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd0af6-01d9-4ff1-bb8e-61e80f59f442 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:00.766601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd0af6-01d9-4ff1-bb8e-61e80f59f442 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:00.766874 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd0af6-01d9-4ff1-bb8e-61e80f59f442 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:00.767700 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd0af6-01d9-4ff1-bb8e-61e80f59f442 None admin] RBAC: Adding query filter params (role.id=7783830649d941ea9507439a113fc5d9, scope.project.id=a9093805bc0c49198e89c6b77395a22b, user.id=78ac278bff3748268d5f353e8f7a309a) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:01:00.768035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd0af6-01d9-4ff1-bb8e-61e80f59f442 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:00.769489 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd0af6-01d9-4ff1-bb8e-61e80f59f442 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:00.775225 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 571/1130] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 10:01:00 2022] GET /identity/v3/role_assignments?user.id=78ac278bff3748268d5f353e8f7a309a&scope.project.id=a9093805bc0c49198e89c6b77395a22b&role.id=7783830649d941ea9507439a113fc5d9 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:02.812607 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565628c2-ce22-41f4-b2f7-37f5f7acbfa8 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:02.813178 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565628c2-ce22-41f4-b2f7-37f5f7acbfa8 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:02.813178 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565628c2-ce22-41f4-b2f7-37f5f7acbfa8 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:02.814551 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 560/1131] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:01:02.820158 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00721d-8149-485e-9e55-4490010e5afb None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:02.820621 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00721d-8149-485e-9e55-4490010e5afb None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:02.820802 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00721d-8149-485e-9e55-4490010e5afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:02.838763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-dd00721d-8149-485e-9e55-4490010e5afb None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:01:02.839959 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-dd00721d-8149-485e-9e55-4490010e5afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:01:02.910586 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 572/1132] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:01:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:01:02.934948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565628c2-ce22-41f4-b2f7-37f5f7acbfa8 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:03.037552 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565628c2-ce22-41f4-b2f7-37f5f7acbfa8 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:03.071119 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325e1a8-5453-4b0d-8cf3-6c5f48d72cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:03.071905 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325e1a8-5453-4b0d-8cf3-6c5f48d72cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:03.072191 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325e1a8-5453-4b0d-8cf3-6c5f48d72cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:03.072470 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325e1a8-5453-4b0d-8cf3-6c5f48d72cf0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:03.073950 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325e1a8-5453-4b0d-8cf3-6c5f48d72cf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:03.075380 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325e1a8-5453-4b0d-8cf3-6c5f48d72cf0 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:03.077055 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 561/1133] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:01:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:03.082905 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00721d-8149-485e-9e55-4490010e5afb None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:03.179839 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00721d-8149-485e-9e55-4490010e5afb None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:03.196460 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:03.213929 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0c048-c65d-4634-90c0-6403f5687eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:03.214585 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0c048-c65d-4634-90c0-6403f5687eae None admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:03.214872 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0c048-c65d-4634-90c0-6403f5687eae None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:03.215151 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0c048-c65d-4634-90c0-6403f5687eae None admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:03.215855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a0c048-c65d-4634-90c0-6403f5687eae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:03.217344 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a0c048-c65d-4634-90c0-6403f5687eae None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:03.299150 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 573/1134] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Jun 22 10:01:03 2022] POST /identity/v3/projects => generated 311 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:01:05.346318 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f20c0c-40af-4a43-9e27-9ae0b1267bf4 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:05.346840 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f20c0c-40af-4a43-9e27-9ae0b1267bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:05.346840 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f20c0c-40af-4a43-9e27-9ae0b1267bf4 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:05.348228 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 562/1135] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:01:05.353469 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187e9b2-13b8-490b-bd4e-0da6452ec748 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:05.353867 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187e9b2-13b8-490b-bd4e-0da6452ec748 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:05.354035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187e9b2-13b8-490b-bd4e-0da6452ec748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:05.371830 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-7187e9b2-13b8-490b-bd4e-0da6452ec748 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:01:05.373588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-7187e9b2-13b8-490b-bd4e-0da6452ec748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:01:05.438307 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 574/1136] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:01:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:01:05.463261 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f20c0c-40af-4a43-9e27-9ae0b1267bf4 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:05.487012 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:05.561504 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f20c0c-40af-4a43-9e27-9ae0b1267bf4 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:05.594638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb9467-a865-426f-9cc7-3823bffb72b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:05.595424 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb9467-a865-426f-9cc7-3823bffb72b8 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:05.595702 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb9467-a865-426f-9cc7-3823bffb72b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:05.595974 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb9467-a865-426f-9cc7-3823bffb72b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:05.597226 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb9467-a865-426f-9cc7-3823bffb72b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:05.598784 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb9467-a865-426f-9cc7-3823bffb72b8 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:05.600395 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 563/1137] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:01:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:05.606230 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187e9b2-13b8-490b-bd4e-0da6452ec748 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:05.699961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:05.703546 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187e9b2-13b8-490b-bd4e-0da6452ec748 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:05.738683 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae2848-8347-4f76-9015-fda6b3d99ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:05.739433 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae2848-8347-4f76-9015-fda6b3d99ff6 None admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:05.739897 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae2848-8347-4f76-9015-fda6b3d99ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:05.740373 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae2848-8347-4f76-9015-fda6b3d99ff6 None admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:05.741710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae2848-8347-4f76-9015-fda6b3d99ff6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:05.744422 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae2848-8347-4f76-9015-fda6b3d99ff6 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:05.840638 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 575/1138] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 22 10:01:05 2022] POST /identity/v3/users => generated 286 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:01:07.932680 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f0593-a5b4-4fa7-8514-57526cab5fb6 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:07.933255 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f0593-a5b4-4fa7-8514-57526cab5fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:07.933255 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f0593-a5b4-4fa7-8514-57526cab5fb6 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:07.934542 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 564/1139] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:01:07.940351 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eadc9f-9d2c-4b74-a68f-dc5adfc958d4 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:07.940731 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eadc9f-9d2c-4b74-a68f-dc5adfc958d4 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:07.940949 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eadc9f-9d2c-4b74-a68f-dc5adfc958d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:07.958151 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-72eadc9f-9d2c-4b74-a68f-dc5adfc958d4 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:01:07.959332 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-72eadc9f-9d2c-4b74-a68f-dc5adfc958d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:01:08.024420 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 576/1140] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:01:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:01:08.047945 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f0593-a5b4-4fa7-8514-57526cab5fb6 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:08.136351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:08.147033 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f0593-a5b4-4fa7-8514-57526cab5fb6 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:08.178705 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775c2f5-cfe7-4a8e-a820-99c37116af97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:08.179793 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775c2f5-cfe7-4a8e-a820-99c37116af97 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:08.180337 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775c2f5-cfe7-4a8e-a820-99c37116af97 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:08.181072 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775c2f5-cfe7-4a8e-a820-99c37116af97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:08.191381 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775c2f5-cfe7-4a8e-a820-99c37116af97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:01:08.199170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-5775c2f5-cfe7-4a8e-a820-99c37116af97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:01:08.199170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:01:08.199170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:01:08.199170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:01:08.199170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:01:08.199170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:01:08.199170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:01:08.199170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:01:08.199170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:01:08.199170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:01:08.199170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:01:08.199170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:01:08.199170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:01:08.199170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:01:08.199170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:01:08.199170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:01:08.200238 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:01:08.200238 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:01:08.200238 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:01:08.200238 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:01:08.200238 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:01:08.200238 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:01:08.200238 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:01:08.200238 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:01:08.200238 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:01:08.200238 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:01:08.200238 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:01:08.200238 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:01:08.200238 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:01:08.200238 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:01:08.200238 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:01:08.200238 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:01:08.201781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:01:08.201781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:01:08.201781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:01:08.201781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:01:08.201781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:01:08.201781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:01:08.201781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:01:08.201781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:01:08.201781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:01:08.201781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:01:08.201781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:01:08.201781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:01:08.201781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 565/1141] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 10:01:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:01:08.206949 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eadc9f-9d2c-4b74-a68f-dc5adfc958d4 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:08.287591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:08.302926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eadc9f-9d2c-4b74-a68f-dc5adfc958d4 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:08.336685 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decafe6c-cbd7-4a02-be8c-517ecf4292e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:08.337377 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decafe6c-cbd7-4a02-be8c-517ecf4292e3 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:08.337660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decafe6c-cbd7-4a02-be8c-517ecf4292e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:08.337938 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decafe6c-cbd7-4a02-be8c-517ecf4292e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:08.338682 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decafe6c-cbd7-4a02-be8c-517ecf4292e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:01:08.338989 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decafe6c-cbd7-4a02-be8c-517ecf4292e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:08.340355 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decafe6c-cbd7-4a02-be8c-517ecf4292e3 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:08.348189 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 577/1142] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 10:01:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:08.354277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775c2f5-cfe7-4a8e-a820-99c37116af97 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:08.451018 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775c2f5-cfe7-4a8e-a820-99c37116af97 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:08.483169 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb8f6f-7473-4c8c-a157-5ce5adb01ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:08.484026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb8f6f-7473-4c8c-a157-5ce5adb01ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:08.484309 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb8f6f-7473-4c8c-a157-5ce5adb01ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:08.484590 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb8f6f-7473-4c8c-a157-5ce5adb01ee9 None admin] PATH_INFO: `/v3/users/c5374c81e1b94eaba0faa7070ca4792d` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:08.497902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb8f6f-7473-4c8c-a157-5ce5adb01ee9 None admin] RBAC: Authorizing `identity:get_user(user_id=c5374c81e1b94eaba0faa7070ca4792d)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:08.499335 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb8f6f-7473-4c8c-a157-5ce5adb01ee9 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:08.501011 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 566/1143] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 10:01:08 2022] GET /identity/v3/users/c5374c81e1b94eaba0faa7070ca4792d => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:08.506743 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decafe6c-cbd7-4a02-be8c-517ecf4292e3 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:08.602197 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decafe6c-cbd7-4a02-be8c-517ecf4292e3 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:08.635233 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3434bc-3b79-424d-b1ad-85ec2e93c007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:08.635870 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3434bc-3b79-424d-b1ad-85ec2e93c007 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:08.636151 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3434bc-3b79-424d-b1ad-85ec2e93c007 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:08.636430 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3434bc-3b79-424d-b1ad-85ec2e93c007 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:08.650897 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:08.701617 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3434bc-3b79-424d-b1ad-85ec2e93c007 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:08.702993 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3434bc-3b79-424d-b1ad-85ec2e93c007 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:08.800152 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 578/1144] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 10:01:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:01:08.806126 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb8f6f-7473-4c8c-a157-5ce5adb01ee9 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:08.816586 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:08.901394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb8f6f-7473-4c8c-a157-5ce5adb01ee9 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:08.935200 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cddb72-4204-42c2-b6e0-78b620d63f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:08.936057 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cddb72-4204-42c2-b6e0-78b620d63f81 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:08.936341 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cddb72-4204-42c2-b6e0-78b620d63f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:08.936620 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cddb72-4204-42c2-b6e0-78b620d63f81 None admin] PATH_INFO: `/v3/projects/0515eb6acc7c46e7afde585eaf3fc743` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:08.937832 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cddb72-4204-42c2-b6e0-78b620d63f81 None admin] RBAC: Authorizing `identity:get_project(project_id=0515eb6acc7c46e7afde585eaf3fc743)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:08.939259 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cddb72-4204-42c2-b6e0-78b620d63f81 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:08.940972 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 567/1145] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 10:01:08 2022] GET /identity/v3/projects/0515eb6acc7c46e7afde585eaf3fc743 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:08.947443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3434bc-3b79-424d-b1ad-85ec2e93c007 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:08.991817 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:09.042741 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3434bc-3b79-424d-b1ad-85ec2e93c007 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:09.074645 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba33983-e34c-4397-ad81-a639299d0b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:09.075817 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba33983-e34c-4397-ad81-a639299d0b25 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:09.076095 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba33983-e34c-4397-ad81-a639299d0b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:09.076366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba33983-e34c-4397-ad81-a639299d0b25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:09.077213 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba33983-e34c-4397-ad81-a639299d0b25 None admin] RBAC: Adding query filter params (role.id=106aa464a69a49b09de7de5417083d3c, scope.project.id=0515eb6acc7c46e7afde585eaf3fc743, user.id=c5374c81e1b94eaba0faa7070ca4792d) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:01:09.077522 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba33983-e34c-4397-ad81-a639299d0b25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:09.078933 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba33983-e34c-4397-ad81-a639299d0b25 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:09.084136 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 579/1146] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 10:01:08 2022] GET /identity/v3/role_assignments?user.id=c5374c81e1b94eaba0faa7070ca4792d&scope.project.id=0515eb6acc7c46e7afde585eaf3fc743&role.id=106aa464a69a49b09de7de5417083d3c => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:11.078576 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f982a-7dbb-4551-9d75-0d36fd687405 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:11.079103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f982a-7dbb-4551-9d75-0d36fd687405 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:11.079103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f982a-7dbb-4551-9d75-0d36fd687405 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:11.080498 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 568/1147] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:01:11.085839 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f92a9c-8946-47fb-b1a7-c8566466fecd None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:11.086236 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f92a9c-8946-47fb-b1a7-c8566466fecd None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:11.086406 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f92a9c-8946-47fb-b1a7-c8566466fecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:11.102897 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-a0f92a9c-8946-47fb-b1a7-c8566466fecd None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:01:11.104075 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-a0f92a9c-8946-47fb-b1a7-c8566466fecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:01:11.168240 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 580/1148] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:01:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:01:11.190873 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f982a-7dbb-4551-9d75-0d36fd687405 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:11.266185 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:11.289361 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f982a-7dbb-4551-9d75-0d36fd687405 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:11.322242 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a44ba8-f2b2-4af6-b35d-9394f08888ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:11.323014 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a44ba8-f2b2-4af6-b35d-9394f08888ad None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:11.323293 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a44ba8-f2b2-4af6-b35d-9394f08888ad None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:11.323563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a44ba8-f2b2-4af6-b35d-9394f08888ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:11.333925 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a44ba8-f2b2-4af6-b35d-9394f08888ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:01:11.341953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-76a44ba8-f2b2-4af6-b35d-9394f08888ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:01:11.341953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:01:11.341953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:01:11.341953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:01:11.341953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:01:11.341953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:01:11.341953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:01:11.341953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:01:11.341953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:01:11.341953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:01:11.341953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:01:11.341953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:01:11.341953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:01:11.341953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:01:11.341953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:01:11.341953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:01:11.343375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:01:11.343375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:01:11.343375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:01:11.343375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:01:11.343375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:01:11.343375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:01:11.343375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:01:11.343375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:01:11.343375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:01:11.343375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:01:11.343375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:01:11.343375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:01:11.343375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:01:11.343375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:01:11.343375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:01:11.343375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:01:11.345183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:01:11.345183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:01:11.345183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:01:11.345183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:01:11.345183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:01:11.345183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:01:11.345183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:01:11.345183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:01:11.345183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:01:11.345183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:01:11.345183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:01:11.345183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:01:11.345183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 569/1149] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 10:01:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:01:11.349326 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f92a9c-8946-47fb-b1a7-c8566466fecd None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:11.394786 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:11.452347 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f92a9c-8946-47fb-b1a7-c8566466fecd None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:11.485014 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ce621-bfbe-45c5-a10a-76a0507e3f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:11.485676 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ce621-bfbe-45c5-a10a-76a0507e3f8c None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:11.485964 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ce621-bfbe-45c5-a10a-76a0507e3f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:11.486245 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ce621-bfbe-45c5-a10a-76a0507e3f8c None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:11.486992 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ce621-bfbe-45c5-a10a-76a0507e3f8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:01:11.487306 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ce621-bfbe-45c5-a10a-76a0507e3f8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:11.488675 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ce621-bfbe-45c5-a10a-76a0507e3f8c None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:11.496480 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 581/1150] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 10:01:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:11.502424 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a44ba8-f2b2-4af6-b35d-9394f08888ad None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:11.605590 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a44ba8-f2b2-4af6-b35d-9394f08888ad None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:11.638249 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb49053-bea4-4e3b-817c-94b65bbb15f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:11.639229 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb49053-bea4-4e3b-817c-94b65bbb15f5 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:11.639404 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb49053-bea4-4e3b-817c-94b65bbb15f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:11.639678 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb49053-bea4-4e3b-817c-94b65bbb15f5 None admin] PATH_INFO: `/v3/users/c5374c81e1b94eaba0faa7070ca4792d` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:11.640905 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb49053-bea4-4e3b-817c-94b65bbb15f5 None admin] RBAC: Authorizing `identity:get_user(user_id=c5374c81e1b94eaba0faa7070ca4792d)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:11.642342 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb49053-bea4-4e3b-817c-94b65bbb15f5 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:11.643968 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 570/1151] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 10:01:11 2022] GET /identity/v3/users/c5374c81e1b94eaba0faa7070ca4792d => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:11.649887 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ce621-bfbe-45c5-a10a-76a0507e3f8c None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:11.748968 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ce621-bfbe-45c5-a10a-76a0507e3f8c None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:11.750469 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:11.781980 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57357f5c-987f-4630-83d5-73008b812b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:11.782879 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57357f5c-987f-4630-83d5-73008b812b45 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:11.783164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57357f5c-987f-4630-83d5-73008b812b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:11.783448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57357f5c-987f-4630-83d5-73008b812b45 None admin] PATH_INFO: `/v3/projects/0515eb6acc7c46e7afde585eaf3fc743` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:11.784622 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57357f5c-987f-4630-83d5-73008b812b45 None admin] RBAC: Authorizing `identity:get_project(project_id=0515eb6acc7c46e7afde585eaf3fc743)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:11.786080 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57357f5c-987f-4630-83d5-73008b812b45 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:11.787822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 582/1152] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 10:01:11 2022] GET /identity/v3/projects/0515eb6acc7c46e7afde585eaf3fc743 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:11.793853 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb49053-bea4-4e3b-817c-94b65bbb15f5 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:11.797561 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:11.914652 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb49053-bea4-4e3b-817c-94b65bbb15f5 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:11.947772 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aed53c-4eeb-4ce6-a6f3-59364335bbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:11.948646 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aed53c-4eeb-4ce6-a6f3-59364335bbfb None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:11.948953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aed53c-4eeb-4ce6-a6f3-59364335bbfb None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:11.949230 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aed53c-4eeb-4ce6-a6f3-59364335bbfb None admin] PATH_INFO: `/v3/projects/0515eb6acc7c46e7afde585eaf3fc743/users/c5374c81e1b94eaba0faa7070ca4792d/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:11.951837 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aed53c-4eeb-4ce6-a6f3-59364335bbfb None admin] RBAC: Authorizing `identity:create_grant(project_id=0515eb6acc7c46e7afde585eaf3fc743, user_id=c5374c81e1b94eaba0faa7070ca4792d, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:11.953323 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aed53c-4eeb-4ce6-a6f3-59364335bbfb None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:12.039671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 571/1153] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 22 10:01:11 2022] PUT /identity/v3/projects/0515eb6acc7c46e7afde585eaf3fc743/users/c5374c81e1b94eaba0faa7070ca4792d/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:01:14.091917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88903126-420c-4ad9-9b94-c17885ac27a2 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:14.092447 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88903126-420c-4ad9-9b94-c17885ac27a2 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:14.092565 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88903126-420c-4ad9-9b94-c17885ac27a2 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:14.094043 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 583/1154] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:01:14.099444 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b03620-67c9-48e4-a6e3-52682647dfd9 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:14.100161 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b03620-67c9-48e4-a6e3-52682647dfd9 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:14.100161 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b03620-67c9-48e4-a6e3-52682647dfd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:14.116456 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-39b03620-67c9-48e4-a6e3-52682647dfd9 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:01:14.117669 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-39b03620-67c9-48e4-a6e3-52682647dfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:01:14.174547 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:14.182488 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 572/1155] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:01:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:01:14.210960 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88903126-420c-4ad9-9b94-c17885ac27a2 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:14.326975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88903126-420c-4ad9-9b94-c17885ac27a2 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:14.359614 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e96513-3f5b-4bec-b611-f5138b79e2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:14.360320 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e96513-3f5b-4bec-b611-f5138b79e2cb None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:14.360605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e96513-3f5b-4bec-b611-f5138b79e2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:14.360911 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e96513-3f5b-4bec-b611-f5138b79e2cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:14.371393 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e96513-3f5b-4bec-b611-f5138b79e2cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:01:14.379157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-d4e96513-3f5b-4bec-b611-f5138b79e2cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:01:14.379157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:01:14.379157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:01:14.379157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:01:14.379157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:01:14.379157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:01:14.379157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:01:14.379157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:01:14.379157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:01:14.379157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:01:14.379157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:01:14.379157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:01:14.379157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:01:14.379157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:01:14.379157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:01:14.379157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:01:14.380325 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:01:14.380325 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:01:14.380325 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:01:14.380325 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:01:14.380325 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:01:14.380325 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:01:14.380325 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:01:14.380325 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:01:14.380325 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:01:14.380325 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:01:14.380325 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:01:14.380325 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:01:14.380325 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:01:14.380325 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:01:14.380325 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:01:14.380325 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:01:14.381315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:01:14.381315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:01:14.381315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:01:14.381315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:01:14.381315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:01:14.381315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:01:14.381315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:01:14.381315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:01:14.381315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:01:14.381315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:01:14.381315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:01:14.381315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:01:14.381315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 584/1156] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 10:01:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:01:14.386527 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b03620-67c9-48e4-a6e3-52682647dfd9 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:14.483583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b03620-67c9-48e4-a6e3-52682647dfd9 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:14.516772 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc23534-aed8-4e6a-aef2-7682a9ea7db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:14.517467 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc23534-aed8-4e6a-aef2-7682a9ea7db5 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:14.517752 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc23534-aed8-4e6a-aef2-7682a9ea7db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:14.518031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc23534-aed8-4e6a-aef2-7682a9ea7db5 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:14.518780 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc23534-aed8-4e6a-aef2-7682a9ea7db5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:01:14.519092 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc23534-aed8-4e6a-aef2-7682a9ea7db5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:14.520466 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc23534-aed8-4e6a-aef2-7682a9ea7db5 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:14.528904 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 573/1157] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 10:01:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:14.534641 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e96513-3f5b-4bec-b611-f5138b79e2cb None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:14.583814 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:14.651299 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e96513-3f5b-4bec-b611-f5138b79e2cb None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:14.684433 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e08f6-d611-4acf-b4ea-537e0e7b5dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:14.685356 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e08f6-d611-4acf-b4ea-537e0e7b5dfb None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:14.685641 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e08f6-d611-4acf-b4ea-537e0e7b5dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:14.685917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e08f6-d611-4acf-b4ea-537e0e7b5dfb None admin] PATH_INFO: `/v3/users/c5374c81e1b94eaba0faa7070ca4792d` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:14.687111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e08f6-d611-4acf-b4ea-537e0e7b5dfb None admin] RBAC: Authorizing `identity:get_user(user_id=c5374c81e1b94eaba0faa7070ca4792d)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:14.688533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e08f6-d611-4acf-b4ea-537e0e7b5dfb None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:14.690187 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 585/1158] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 10:01:14 2022] GET /identity/v3/users/c5374c81e1b94eaba0faa7070ca4792d => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:14.695917 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc23534-aed8-4e6a-aef2-7682a9ea7db5 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:14.750505 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:14.792983 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc23534-aed8-4e6a-aef2-7682a9ea7db5 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:14.827450 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae42ad-8959-4046-98b5-eba608b5135a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:14.828087 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae42ad-8959-4046-98b5-eba608b5135a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:14.828371 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae42ad-8959-4046-98b5-eba608b5135a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:14.828681 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae42ad-8959-4046-98b5-eba608b5135a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:14.896134 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae42ad-8959-4046-98b5-eba608b5135a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:14.903849 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae42ad-8959-4046-98b5-eba608b5135a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:14.951068 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:14.994145 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 574/1159] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 10:01:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:01:15.000630 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e08f6-d611-4acf-b4ea-537e0e7b5dfb None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:15.092991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:15.096750 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e08f6-d611-4acf-b4ea-537e0e7b5dfb None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:15.130270 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440b9da-affa-44a3-9467-9690edde8c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:15.131115 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440b9da-affa-44a3-9467-9690edde8c59 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:15.131398 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440b9da-affa-44a3-9467-9690edde8c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:15.131674 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440b9da-affa-44a3-9467-9690edde8c59 None admin] PATH_INFO: `/v3/projects/0515eb6acc7c46e7afde585eaf3fc743` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:15.132974 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440b9da-affa-44a3-9467-9690edde8c59 None admin] RBAC: Authorizing `identity:get_project(project_id=0515eb6acc7c46e7afde585eaf3fc743)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:15.134392 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440b9da-affa-44a3-9467-9690edde8c59 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:15.136149 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 586/1160] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 10:01:14 2022] GET /identity/v3/projects/0515eb6acc7c46e7afde585eaf3fc743 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:15.142280 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae42ad-8959-4046-98b5-eba608b5135a None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:15.237988 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae42ad-8959-4046-98b5-eba608b5135a None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:15.271758 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a906f4a-d5bc-44b5-87c1-b823ffc2bb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:15.272407 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a906f4a-d5bc-44b5-87c1-b823ffc2bb41 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:15.272692 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a906f4a-d5bc-44b5-87c1-b823ffc2bb41 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:15.273002 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a906f4a-d5bc-44b5-87c1-b823ffc2bb41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:15.273838 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a906f4a-d5bc-44b5-87c1-b823ffc2bb41 None admin] RBAC: Adding query filter params (role.id=106aa464a69a49b09de7de5417083d3c, scope.project.id=0515eb6acc7c46e7afde585eaf3fc743, user.id=c5374c81e1b94eaba0faa7070ca4792d) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:01:15.274152 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a906f4a-d5bc-44b5-87c1-b823ffc2bb41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:15.275591 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a906f4a-d5bc-44b5-87c1-b823ffc2bb41 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:15.281857 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 575/1161] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 10:01:15 2022] GET /identity/v3/role_assignments?user.id=c5374c81e1b94eaba0faa7070ca4792d&scope.project.id=0515eb6acc7c46e7afde585eaf3fc743&role.id=106aa464a69a49b09de7de5417083d3c => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:17.311693 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a1fc0-e60f-41e8-808d-1dca50fb802e None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:17.312253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a1fc0-e60f-41e8-808d-1dca50fb802e None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:17.312253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a1fc0-e60f-41e8-808d-1dca50fb802e None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:17.313645 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 587/1162] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:01:17.318791 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81293095-8681-4455-b45c-fc31da092a64 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:17.319173 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81293095-8681-4455-b45c-fc31da092a64 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:17.319351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81293095-8681-4455-b45c-fc31da092a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:17.336476 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-81293095-8681-4455-b45c-fc31da092a64 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:01:17.337699 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-81293095-8681-4455-b45c-fc31da092a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:01:17.352290 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:17.402607 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 576/1163] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:01:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:01:17.444260 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a1fc0-e60f-41e8-808d-1dca50fb802e None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:17.524983 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a1fc0-e60f-41e8-808d-1dca50fb802e None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:17.558298 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecdb027-bde3-4874-bad4-b1b4787c82e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:17.558943 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdb027-bde3-4874-bad4-b1b4787c82e7 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:17.559229 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdb027-bde3-4874-bad4-b1b4787c82e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:17.559509 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdb027-bde3-4874-bad4-b1b4787c82e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:17.592485 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:17.625292 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecdb027-bde3-4874-bad4-b1b4787c82e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:17.626740 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecdb027-bde3-4874-bad4-b1b4787c82e7 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:17.722599 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 588/1164] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 10:01:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:01:17.728598 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81293095-8681-4455-b45c-fc31da092a64 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:17.822944 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81293095-8681-4455-b45c-fc31da092a64 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:17.855765 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77470a-f0c3-4059-9c59-7b1547fdbc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:17.856495 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77470a-f0c3-4059-9c59-7b1547fdbc2e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:17.856779 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77470a-f0c3-4059-9c59-7b1547fdbc2e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:17.857091 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77470a-f0c3-4059-9c59-7b1547fdbc2e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:17.863718 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f77470a-f0c3-4059-9c59-7b1547fdbc2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:17.865188 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f77470a-f0c3-4059-9c59-7b1547fdbc2e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:17.879549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-9f77470a-f0c3-4059-9c59-7b1547fdbc2e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 22 10:01:17.879549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:01:17.879549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 22 10:01:17.879549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 22 10:01:17.879549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:01:17.879549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:01:17.879549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:01:17.879549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:01:17.879549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 22 10:01:17.879549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:01:17.879549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:01:17.879549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:01:17.879549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:01:17.879549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:01:17.879549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:01:17.879549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:01:17.879549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:01:17.880622 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:01:17.880622 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:01:17.880622 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:01:17.880622 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:01:17.880622 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:01:17.880622 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:01:17.880622 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:01:17.880622 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:01:17.880622 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:01:17.880622 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:01:17.880622 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:01:17.880622 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:01:17.880622 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:01:17.880622 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:01:17.880622 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:01:17.880622 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:01:17.881713 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:01:17.881713 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:01:17.881713 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:01:17.881713 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:01:17.881713 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:01:17.881713 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:01:17.881713 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:01:17.881713 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:01:17.881713 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:01:17.881713 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:01:17.881713 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 22 10:01:17.881713 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:01:17.881713 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 22 10:01:17.881713 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:01:17.881713 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 577/1165] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Jun 22 10:01:17 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:01:17.886753 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecdb027-bde3-4874-bad4-b1b4787c82e7 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:17.950872 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:17.982938 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecdb027-bde3-4874-bad4-b1b4787c82e7 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:18.015849 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6628855-6d04-457f-b6ef-89974ae31404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:18.016507 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6628855-6d04-457f-b6ef-89974ae31404 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:18.016787 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6628855-6d04-457f-b6ef-89974ae31404 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:18.017095 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6628855-6d04-457f-b6ef-89974ae31404 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:18.017808 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6628855-6d04-457f-b6ef-89974ae31404 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:01:18.018116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6628855-6d04-457f-b6ef-89974ae31404 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:18.019476 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6628855-6d04-457f-b6ef-89974ae31404 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:18.026445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 589/1166] 10.222.0.46 () {56 vars in 1115 bytes} [Wed Jun 22 10:01:17 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:20.018971 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a110f6b-264e-4fe3-a7a1-e946c90c8fe4 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:20.019481 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a110f6b-264e-4fe3-a7a1-e946c90c8fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:20.019481 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a110f6b-264e-4fe3-a7a1-e946c90c8fe4 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:20.020806 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 578/1167] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:01:20.026007 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49641c-55b0-4205-a8a6-23740f5cdade None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:20.026442 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49641c-55b0-4205-a8a6-23740f5cdade None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:20.026571 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49641c-55b0-4205-a8a6-23740f5cdade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:20.043014 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-3b49641c-55b0-4205-a8a6-23740f5cdade None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:01:20.044250 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-3b49641c-55b0-4205-a8a6-23740f5cdade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:01:20.108519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 590/1168] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:01:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:01:20.131538 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a110f6b-264e-4fe3-a7a1-e946c90c8fe4 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:20.144947 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:20.232768 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a110f6b-264e-4fe3-a7a1-e946c90c8fe4 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:20.265102 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163b8de-38c7-41a8-aa83-cb89d88471f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:20.265757 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163b8de-38c7-41a8-aa83-cb89d88471f5 None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:20.266037 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163b8de-38c7-41a8-aa83-cb89d88471f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:20.266307 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163b8de-38c7-41a8-aa83-cb89d88471f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:20.267040 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163b8de-38c7-41a8-aa83-cb89d88471f5 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:20.268407 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163b8de-38c7-41a8-aa83-cb89d88471f5 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:20.343600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 579/1169] 10.222.0.46 () {60 vars in 1138 bytes} [Wed Jun 22 10:01:20 2022] POST /identity/v3/domains => generated 267 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:01:22.404769 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcbb22-ebbd-4bc3-aa43-e95a6dbe857e None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:22.405338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcbb22-ebbd-4bc3-aa43-e95a6dbe857e None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:22.405338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcbb22-ebbd-4bc3-aa43-e95a6dbe857e None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:22.406728 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 591/1170] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:01:22.411875 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ebe61-bc01-4fef-923c-493f3e809b9e None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:22.412291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ebe61-bc01-4fef-923c-493f3e809b9e None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:22.412437 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ebe61-bc01-4fef-923c-493f3e809b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:22.429056 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-c55ebe61-bc01-4fef-923c-493f3e809b9e None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:01:22.430260 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-c55ebe61-bc01-4fef-923c-493f3e809b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:01:22.491265 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:22.496359 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 580/1171] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:01:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:01:22.520507 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcbb22-ebbd-4bc3-aa43-e95a6dbe857e None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:22.578830 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:22.621436 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcbb22-ebbd-4bc3-aa43-e95a6dbe857e None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:22.654214 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae0537-e395-4eef-90bf-7be9c7fcfd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:22.655136 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae0537-e395-4eef-90bf-7be9c7fcfd04 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:22.655364 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae0537-e395-4eef-90bf-7be9c7fcfd04 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:22.655640 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae0537-e395-4eef-90bf-7be9c7fcfd04 None admin] PATH_INFO: `/v3/domains/fb41c270e3f241f8b53df21fb1e95c16` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:22.666128 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae0537-e395-4eef-90bf-7be9c7fcfd04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=fb41c270e3f241f8b53df21fb1e95c16)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:22.668069 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae0537-e395-4eef-90bf-7be9c7fcfd04 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:22.669806 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 592/1172] 10.222.0.46 () {56 vars in 1183 bytes} [Wed Jun 22 10:01:22 2022] GET /identity/v3/domains/fb41c270e3f241f8b53df21fb1e95c16 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:22.675699 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ebe61-bc01-4fef-923c-493f3e809b9e None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:22.776945 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ebe61-bc01-4fef-923c-493f3e809b9e None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:22.810433 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808610ff-b26c-4e26-bbe7-cc781665066b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:22.811095 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808610ff-b26c-4e26-bbe7-cc781665066b None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:22.811376 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808610ff-b26c-4e26-bbe7-cc781665066b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:22.811647 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808610ff-b26c-4e26-bbe7-cc781665066b None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:22.812350 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808610ff-b26c-4e26-bbe7-cc781665066b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:22.813811 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808610ff-b26c-4e26-bbe7-cc781665066b None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:22.909427 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 581/1173] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Jun 22 10:01:22 2022] POST /identity/v3/projects => generated 361 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:01:24.957686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe887ff-5f90-4a9b-9bb0-f108c310ea84 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:24.958196 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe887ff-5f90-4a9b-9bb0-f108c310ea84 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:24.958196 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe887ff-5f90-4a9b-9bb0-f108c310ea84 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:24.959540 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 593/1174] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:01:24.965419 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4459d-08a4-4e46-a144-0b882afa8703 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:24.965793 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4459d-08a4-4e46-a144-0b882afa8703 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:24.965988 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4459d-08a4-4e46-a144-0b882afa8703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:24.983186 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-9ab4459d-08a4-4e46-a144-0b882afa8703 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:01:24.984374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-9ab4459d-08a4-4e46-a144-0b882afa8703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:01:25.030196 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:25.049406 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 582/1175] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:01:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:01:25.075043 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe887ff-5f90-4a9b-9bb0-f108c310ea84 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:25.172840 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe887ff-5f90-4a9b-9bb0-f108c310ea84 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:25.192078 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:25.205972 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e87519-aa80-4eae-81af-256b54e7b340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:25.206822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e87519-aa80-4eae-81af-256b54e7b340 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:25.207105 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e87519-aa80-4eae-81af-256b54e7b340 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:25.207379 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e87519-aa80-4eae-81af-256b54e7b340 None admin] PATH_INFO: `/v3/domains/fb41c270e3f241f8b53df21fb1e95c16` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:25.208603 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e87519-aa80-4eae-81af-256b54e7b340 None admin] RBAC: Authorizing `identity:get_domain(domain_id=fb41c270e3f241f8b53df21fb1e95c16)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:25.209991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e87519-aa80-4eae-81af-256b54e7b340 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:25.211605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 594/1176] 10.222.0.46 () {56 vars in 1183 bytes} [Wed Jun 22 10:01:25 2022] GET /identity/v3/domains/fb41c270e3f241f8b53df21fb1e95c16 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:25.217688 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4459d-08a4-4e46-a144-0b882afa8703 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:25.312158 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4459d-08a4-4e46-a144-0b882afa8703 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:25.349058 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ceb4a6-08e7-4136-8874-131da05e6c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:25.349732 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ceb4a6-08e7-4136-8874-131da05e6c5b None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:25.350016 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ceb4a6-08e7-4136-8874-131da05e6c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:25.350295 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ceb4a6-08e7-4136-8874-131da05e6c5b None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:25.351029 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ceb4a6-08e7-4136-8874-131da05e6c5b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:25.352461 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ceb4a6-08e7-4136-8874-131da05e6c5b None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:25.450890 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 583/1177] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 22 10:01:25 2022] POST /identity/v3/users => generated 311 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:01:27.510026 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3776187-fbb0-49c1-a679-073dddbe5c5d None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:27.510583 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3776187-fbb0-49c1-a679-073dddbe5c5d None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:27.510583 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3776187-fbb0-49c1-a679-073dddbe5c5d None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:27.511952 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 595/1178] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:01:27.517133 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1348a2b-bf6d-49ff-b5cb-1c74a7643a9e None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:27.517525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1348a2b-bf6d-49ff-b5cb-1c74a7643a9e None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:27.517685 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1348a2b-bf6d-49ff-b5cb-1c74a7643a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:27.534409 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-c1348a2b-bf6d-49ff-b5cb-1c74a7643a9e None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:01:27.536063 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-c1348a2b-bf6d-49ff-b5cb-1c74a7643a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:01:27.564464 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:27.600172 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 584/1179] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:01:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:01:27.624616 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3776187-fbb0-49c1-a679-073dddbe5c5d None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:27.723872 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3776187-fbb0-49c1-a679-073dddbe5c5d None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:27.757248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc39f1-aa9f-4f96-aa74-a089672efee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:27.758026 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc39f1-aa9f-4f96-aa74-a089672efee1 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:27.758307 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc39f1-aa9f-4f96-aa74-a089672efee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:27.758583 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc39f1-aa9f-4f96-aa74-a089672efee1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:27.770643 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc39f1-aa9f-4f96-aa74-a089672efee1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:01:27.787789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-dabc39f1-aa9f-4f96-aa74-a089672efee1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:01:27.787789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:01:27.787789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:01:27.787789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:01:27.787789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:01:27.787789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:01:27.787789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:01:27.787789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:01:27.787789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:01:27.787789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:01:27.787789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:01:27.787789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:01:27.787789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:01:27.787789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:01:27.787789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:01:27.787789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:01:27.791403 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:01:27.791403 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:01:27.791403 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:01:27.791403 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:01:27.791403 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:01:27.791403 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:01:27.791403 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:01:27.791403 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:01:27.791403 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:01:27.791403 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:01:27.791403 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:01:27.791403 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:01:27.791403 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:01:27.791403 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:01:27.791403 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:01:27.791403 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:01:27.792591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:01:27.792591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:01:27.792591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:01:27.792591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:01:27.792591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:01:27.792591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:01:27.792591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:01:27.792591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:01:27.792591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:01:27.792591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:01:27.792591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:01:27.792591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:01:27.792591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 596/1180] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 10:01:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:01:27.795770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1348a2b-bf6d-49ff-b5cb-1c74a7643a9e None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:27.894941 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1348a2b-bf6d-49ff-b5cb-1c74a7643a9e None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:27.939339 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5abed-336c-4bc4-993a-7a2747c15afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:27.940057 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5abed-336c-4bc4-993a-7a2747c15afb None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:27.940338 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5abed-336c-4bc4-993a-7a2747c15afb None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:27.940615 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5abed-336c-4bc4-993a-7a2747c15afb None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:27.941400 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5abed-336c-4bc4-993a-7a2747c15afb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:01:27.941710 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5abed-336c-4bc4-993a-7a2747c15afb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:27.943098 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5abed-336c-4bc4-993a-7a2747c15afb None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:27.952237 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 585/1181] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 10:01:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:27.958000 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc39f1-aa9f-4f96-aa74-a089672efee1 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:28.006948 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:28.057662 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc39f1-aa9f-4f96-aa74-a089672efee1 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:28.103948 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fad3bd-169b-495f-a05b-487ebdaa6c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:28.104852 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fad3bd-169b-495f-a05b-487ebdaa6c6a None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:28.105126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fad3bd-169b-495f-a05b-487ebdaa6c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:28.105401 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fad3bd-169b-495f-a05b-487ebdaa6c6a None admin] PATH_INFO: `/v3/users/76252fba49274e5295befc0068b62f4a` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:28.127404 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fad3bd-169b-495f-a05b-487ebdaa6c6a None admin] RBAC: Authorizing `identity:get_user(user_id=76252fba49274e5295befc0068b62f4a)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:28.128917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fad3bd-169b-495f-a05b-487ebdaa6c6a None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:28.130696 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 597/1182] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 10:01:27 2022] GET /identity/v3/users/76252fba49274e5295befc0068b62f4a => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:28.136708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5abed-336c-4bc4-993a-7a2747c15afb None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:28.180373 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:28.259092 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5abed-336c-4bc4-993a-7a2747c15afb None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:28.298770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0c3c9-700f-4c55-8e0a-6734c3b1bc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:28.299868 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0c3c9-700f-4c55-8e0a-6734c3b1bc9c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:28.300257 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0c3c9-700f-4c55-8e0a-6734c3b1bc9c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:28.300536 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0c3c9-700f-4c55-8e0a-6734c3b1bc9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:28.366873 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0c3c9-700f-4c55-8e0a-6734c3b1bc9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:28.368251 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0c3c9-700f-4c55-8e0a-6734c3b1bc9c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:28.400967 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:28.473669 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 586/1183] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 10:01:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:01:28.484695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fad3bd-169b-495f-a05b-487ebdaa6c6a None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:28.584919 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fad3bd-169b-495f-a05b-487ebdaa6c6a None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:28.592182 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:28.618641 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90caff-5c92-49fd-9071-7c59404be894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:28.619421 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90caff-5c92-49fd-9071-7c59404be894 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:28.620053 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90caff-5c92-49fd-9071-7c59404be894 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:28.620812 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90caff-5c92-49fd-9071-7c59404be894 None admin] PATH_INFO: `/v3/projects/a524b6c620fd45c9ad24895791f3b236` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:28.622026 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90caff-5c92-49fd-9071-7c59404be894 None admin] RBAC: Authorizing `identity:get_project(project_id=a524b6c620fd45c9ad24895791f3b236)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:28.623454 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90caff-5c92-49fd-9071-7c59404be894 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:28.625175 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 598/1184] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 10:01:28 2022] GET /identity/v3/projects/a524b6c620fd45c9ad24895791f3b236 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:28.631305 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0c3c9-700f-4c55-8e0a-6734c3b1bc9c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:28.728343 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0c3c9-700f-4c55-8e0a-6734c3b1bc9c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:28.757467 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:28.763690 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133c20f-a93a-47bb-b774-7151cac3e73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:28.764342 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133c20f-a93a-47bb-b774-7151cac3e73e None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:28.764626 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133c20f-a93a-47bb-b774-7151cac3e73e None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:28.765062 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133c20f-a93a-47bb-b774-7151cac3e73e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:28.766099 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133c20f-a93a-47bb-b774-7151cac3e73e None admin] RBAC: Adding query filter params (role.id=106aa464a69a49b09de7de5417083d3c, scope.project.id=a524b6c620fd45c9ad24895791f3b236, user.id=76252fba49274e5295befc0068b62f4a) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:01:28.766193 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133c20f-a93a-47bb-b774-7151cac3e73e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:28.767611 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133c20f-a93a-47bb-b774-7151cac3e73e None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:28.773374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 587/1185] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 10:01:28 2022] GET /identity/v3/role_assignments?user.id=76252fba49274e5295befc0068b62f4a&scope.project.id=a524b6c620fd45c9ad24895791f3b236&role.id=106aa464a69a49b09de7de5417083d3c => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:30.796034 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1885704-1181-4ae6-bbd4-66df9fee21a2 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:30.796587 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1885704-1181-4ae6-bbd4-66df9fee21a2 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:30.796587 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1885704-1181-4ae6-bbd4-66df9fee21a2 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:30.797993 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 599/1186] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:01:30.803345 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e568f-915d-47e7-b0ca-27461599aa5d None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:30.803732 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e568f-915d-47e7-b0ca-27461599aa5d None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:30.803898 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e568f-915d-47e7-b0ca-27461599aa5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:30.820549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-c73e568f-915d-47e7-b0ca-27461599aa5d None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:01:30.821774 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-c73e568f-915d-47e7-b0ca-27461599aa5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:01:30.886519 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 588/1187] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:01:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:01:30.909469 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1885704-1181-4ae6-bbd4-66df9fee21a2 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:31.017769 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1885704-1181-4ae6-bbd4-66df9fee21a2 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:31.051258 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb714f-ff3e-4d15-b143-007ba1aa1ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:31.052051 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb714f-ff3e-4d15-b143-007ba1aa1ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:31.052339 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb714f-ff3e-4d15-b143-007ba1aa1ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:31.052620 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb714f-ff3e-4d15-b143-007ba1aa1ab1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:31.063161 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb714f-ff3e-4d15-b143-007ba1aa1ab1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:01:31.071050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-24eb714f-ff3e-4d15-b143-007ba1aa1ab1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:01:31.071050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:01:31.071050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:01:31.071050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:01:31.071050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:01:31.071050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:01:31.071050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:01:31.071050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:01:31.071050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:01:31.071050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:01:31.071050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:01:31.071050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:01:31.071050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:01:31.071050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:01:31.071050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:01:31.071050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:01:31.072237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:01:31.072237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:01:31.072237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:01:31.072237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:01:31.072237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:01:31.072237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:01:31.072237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:01:31.072237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:01:31.072237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:01:31.072237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:01:31.072237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:01:31.072237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:01:31.072237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:01:31.072237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:01:31.072237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:01:31.072237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:01:31.073212 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:01:31.073212 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:01:31.073212 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:01:31.073212 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:01:31.073212 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:01:31.073212 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:01:31.073212 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:01:31.073212 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:01:31.073212 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:01:31.073212 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:01:31.073212 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:01:31.073212 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:01:31.073212 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 600/1188] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 10:01:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:01:31.078659 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e568f-915d-47e7-b0ca-27461599aa5d None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:31.174208 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e568f-915d-47e7-b0ca-27461599aa5d None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:31.197303 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:31.207612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e44fd3-f1d2-443d-8449-184af9402e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:31.208281 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e44fd3-f1d2-443d-8449-184af9402e51 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:31.208565 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e44fd3-f1d2-443d-8449-184af9402e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:31.208864 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e44fd3-f1d2-443d-8449-184af9402e51 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:31.209619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e44fd3-f1d2-443d-8449-184af9402e51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:01:31.209927 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e44fd3-f1d2-443d-8449-184af9402e51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:31.211302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e44fd3-f1d2-443d-8449-184af9402e51 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:31.219943 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 589/1189] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 10:01:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:31.225838 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb714f-ff3e-4d15-b143-007ba1aa1ab1 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:31.259741 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:31.323662 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb714f-ff3e-4d15-b143-007ba1aa1ab1 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:31.356455 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ef648-ce78-41d7-9461-6e4540b3b3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:31.357350 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ef648-ce78-41d7-9461-6e4540b3b3de None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:31.357632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ef648-ce78-41d7-9461-6e4540b3b3de None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:31.357908 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ef648-ce78-41d7-9461-6e4540b3b3de None admin] PATH_INFO: `/v3/users/76252fba49274e5295befc0068b62f4a` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:31.359081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ef648-ce78-41d7-9461-6e4540b3b3de None admin] RBAC: Authorizing `identity:get_user(user_id=76252fba49274e5295befc0068b62f4a)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:31.360493 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ef648-ce78-41d7-9461-6e4540b3b3de None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:31.362134 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 601/1190] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 10:01:31 2022] GET /identity/v3/users/76252fba49274e5295befc0068b62f4a => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:31.367915 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e44fd3-f1d2-443d-8449-184af9402e51 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:31.464641 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e44fd3-f1d2-443d-8449-184af9402e51 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:31.497308 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4d7f0-03de-4a91-8d50-0057f232ebb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:31.498164 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4d7f0-03de-4a91-8d50-0057f232ebb2 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:31.498447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4d7f0-03de-4a91-8d50-0057f232ebb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:31.498721 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4d7f0-03de-4a91-8d50-0057f232ebb2 None admin] PATH_INFO: `/v3/projects/a524b6c620fd45c9ad24895791f3b236` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:31.499908 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4d7f0-03de-4a91-8d50-0057f232ebb2 None admin] RBAC: Authorizing `identity:get_project(project_id=a524b6c620fd45c9ad24895791f3b236)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:31.501370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4d7f0-03de-4a91-8d50-0057f232ebb2 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:31.503060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 590/1191] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 10:01:31 2022] GET /identity/v3/projects/a524b6c620fd45c9ad24895791f3b236 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:31.508968 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ef648-ce78-41d7-9461-6e4540b3b3de None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:31.604467 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ef648-ce78-41d7-9461-6e4540b3b3de None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:31.605910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:31.636713 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa07cb-ea29-4388-8a39-a33e812669e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:31.637607 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa07cb-ea29-4388-8a39-a33e812669e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:31.637890 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa07cb-ea29-4388-8a39-a33e812669e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:31.638162 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa07cb-ea29-4388-8a39-a33e812669e8 None admin] PATH_INFO: `/v3/projects/a524b6c620fd45c9ad24895791f3b236/users/76252fba49274e5295befc0068b62f4a/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:31.640098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa07cb-ea29-4388-8a39-a33e812669e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=a524b6c620fd45c9ad24895791f3b236, user_id=76252fba49274e5295befc0068b62f4a, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:31.641547 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa07cb-ea29-4388-8a39-a33e812669e8 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:31.695237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 602/1192] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 22 10:01:31 2022] PUT /identity/v3/projects/a524b6c620fd45c9ad24895791f3b236/users/76252fba49274e5295befc0068b62f4a/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:01:33.683171 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a89c3-8c9e-4ff9-a4b2-4da33e9b80e0 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:33.683650 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a89c3-8c9e-4ff9-a4b2-4da33e9b80e0 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:33.683743 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a89c3-8c9e-4ff9-a4b2-4da33e9b80e0 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:33.685106 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 591/1193] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:01:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:01:33.690350 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf24dc-1c00-40bb-a788-6327237f2c9c None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:33.690736 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf24dc-1c00-40bb-a788-6327237f2c9c None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:33.690912 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf24dc-1c00-40bb-a788-6327237f2c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:33.708655 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-47cf24dc-1c00-40bb-a788-6327237f2c9c None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:01:33.709865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-47cf24dc-1c00-40bb-a788-6327237f2c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:01:33.774324 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 603/1194] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:01:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:01:33.797713 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a89c3-8c9e-4ff9-a4b2-4da33e9b80e0 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:33.854807 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:33.900155 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a89c3-8c9e-4ff9-a4b2-4da33e9b80e0 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:33.933601 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51cdc7-7543-47a6-b2aa-84aea845e2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:33.934317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51cdc7-7543-47a6-b2aa-84aea845e2d9 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:33.934598 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51cdc7-7543-47a6-b2aa-84aea845e2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:33.934872 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51cdc7-7543-47a6-b2aa-84aea845e2d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:33.946247 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51cdc7-7543-47a6-b2aa-84aea845e2d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:01:33.953841 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-7e51cdc7-7543-47a6-b2aa-84aea845e2d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:01:33.953841 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:01:33.953841 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:01:33.953841 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:01:33.953841 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:01:33.953841 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:01:33.953841 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:01:33.953841 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:01:33.953841 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:01:33.953841 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:01:33.953841 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:01:33.953841 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:01:33.953841 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:01:33.953841 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:01:33.953841 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:01:33.953841 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:01:33.954946 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:01:33.954946 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:01:33.954946 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:01:33.954946 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:01:33.954946 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:01:33.954946 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:01:33.954946 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:01:33.954946 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:01:33.954946 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:01:33.954946 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:01:33.954946 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:01:33.954946 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:01:33.954946 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:01:33.954946 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:01:33.954946 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:01:33.954946 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:01:33.955948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:01:33.955948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:01:33.955948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:01:33.955948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:01:33.955948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:01:33.955948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:01:33.955948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:01:33.955948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:01:33.955948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:01:33.955948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:01:33.955948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:01:33.955948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:01:33.955948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 592/1195] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 10:01:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:01:33.961130 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf24dc-1c00-40bb-a788-6327237f2c9c None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:34.046530 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:34.054734 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf24dc-1c00-40bb-a788-6327237f2c9c None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:34.089632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b321d5-788a-4adc-ab02-88d6e2d3da1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:34.090264 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b321d5-788a-4adc-ab02-88d6e2d3da1e None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:34.090551 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b321d5-788a-4adc-ab02-88d6e2d3da1e None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:34.090830 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b321d5-788a-4adc-ab02-88d6e2d3da1e None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:34.091575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b321d5-788a-4adc-ab02-88d6e2d3da1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:01:34.091885 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b321d5-788a-4adc-ab02-88d6e2d3da1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:34.093295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b321d5-788a-4adc-ab02-88d6e2d3da1e None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:34.101323 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 604/1196] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 10:01:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:34.107757 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51cdc7-7543-47a6-b2aa-84aea845e2d9 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:34.204490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51cdc7-7543-47a6-b2aa-84aea845e2d9 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:34.218330 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:34.238206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9c11c-8dd4-4b50-85b4-05e3150fe3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:34.239073 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9c11c-8dd4-4b50-85b4-05e3150fe3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:34.239352 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9c11c-8dd4-4b50-85b4-05e3150fe3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:34.239622 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9c11c-8dd4-4b50-85b4-05e3150fe3d7 None admin] PATH_INFO: `/v3/users/76252fba49274e5295befc0068b62f4a` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:34.240869 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9c11c-8dd4-4b50-85b4-05e3150fe3d7 None admin] RBAC: Authorizing `identity:get_user(user_id=76252fba49274e5295befc0068b62f4a)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:34.242296 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9c11c-8dd4-4b50-85b4-05e3150fe3d7 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:34.243917 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 593/1197] 10.222.0.46 () {56 vars in 1177 bytes} [Wed Jun 22 10:01:34 2022] GET /identity/v3/users/76252fba49274e5295befc0068b62f4a => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:34.249763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b321d5-788a-4adc-ab02-88d6e2d3da1e None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:34.362174 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b321d5-788a-4adc-ab02-88d6e2d3da1e None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:34.394539 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247dce5-4d7f-4145-9a8d-7226aab883d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:34.395183 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247dce5-4d7f-4145-9a8d-7226aab883d2 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:34.395463 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247dce5-4d7f-4145-9a8d-7226aab883d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:34.395735 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247dce5-4d7f-4145-9a8d-7226aab883d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:34.419895 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:34.461984 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247dce5-4d7f-4145-9a8d-7226aab883d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:34.463851 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247dce5-4d7f-4145-9a8d-7226aab883d2 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:34.557489 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 605/1198] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 10:01:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:01:34.563332 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9c11c-8dd4-4b50-85b4-05e3150fe3d7 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:34.660373 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9c11c-8dd4-4b50-85b4-05e3150fe3d7 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:34.694923 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663ecfa-30f1-4911-a6d5-4fe907261070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:34.695780 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663ecfa-30f1-4911-a6d5-4fe907261070 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:34.696064 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663ecfa-30f1-4911-a6d5-4fe907261070 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:34.696343 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663ecfa-30f1-4911-a6d5-4fe907261070 None admin] PATH_INFO: `/v3/projects/a524b6c620fd45c9ad24895791f3b236` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:34.698026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663ecfa-30f1-4911-a6d5-4fe907261070 None admin] RBAC: Authorizing `identity:get_project(project_id=a524b6c620fd45c9ad24895791f3b236)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:34.699451 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663ecfa-30f1-4911-a6d5-4fe907261070 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:34.701177 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 594/1199] 10.222.0.46 () {56 vars in 1186 bytes} [Wed Jun 22 10:01:34 2022] GET /identity/v3/projects/a524b6c620fd45c9ad24895791f3b236 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:34.707210 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247dce5-4d7f-4145-9a8d-7226aab883d2 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:34.761778 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:34.804101 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247dce5-4d7f-4145-9a8d-7226aab883d2 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:34.837518 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aecaf9-579c-4d96-ae1a-dd24057fcce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:34.838705 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aecaf9-579c-4d96-ae1a-dd24057fcce1 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:34.838993 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aecaf9-579c-4d96-ae1a-dd24057fcce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:34.839271 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aecaf9-579c-4d96-ae1a-dd24057fcce1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:34.840107 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aecaf9-579c-4d96-ae1a-dd24057fcce1 None admin] RBAC: Adding query filter params (role.id=106aa464a69a49b09de7de5417083d3c, scope.project.id=a524b6c620fd45c9ad24895791f3b236, user.id=76252fba49274e5295befc0068b62f4a) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:01:34.840419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aecaf9-579c-4d96-ae1a-dd24057fcce1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:34.841878 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aecaf9-579c-4d96-ae1a-dd24057fcce1 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:34.847865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 606/1200] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 10:01:34 2022] GET /identity/v3/role_assignments?user.id=76252fba49274e5295befc0068b62f4a&scope.project.id=a524b6c620fd45c9ad24895791f3b236&role.id=106aa464a69a49b09de7de5417083d3c => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:44.690389 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=75 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:44.845093 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=41 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:50.428469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ea6d5-08fb-49c6-b398-a2a1c8425593 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:50.429085 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ea6d5-08fb-49c6-b398-a2a1c8425593 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:50.429085 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ea6d5-08fb-49c6-b398-a2a1c8425593 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:50.430421 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 595/1201] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:50.435739 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580a9fe-11b4-4935-a9c2-9702d42334be None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:50.436184 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580a9fe-11b4-4935-a9c2-9702d42334be None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:50.436284 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580a9fe-11b4-4935-a9c2-9702d42334be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:50.453940 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-d580a9fe-11b4-4935-a9c2-9702d42334be None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:50.455210 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-d580a9fe-11b4-4935-a9c2-9702d42334be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:50.521881 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 607/1202] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:02:50.546966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ea6d5-08fb-49c6-b398-a2a1c8425593 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:50.648141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ea6d5-08fb-49c6-b398-a2a1c8425593 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:50.686273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71888fae-2aaa-4b09-9180-d7fb9652a528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:50.686273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71888fae-2aaa-4b09-9180-d7fb9652a528 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:50.686273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71888fae-2aaa-4b09-9180-d7fb9652a528 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:50.686273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71888fae-2aaa-4b09-9180-d7fb9652a528 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:50.694519 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71888fae-2aaa-4b09-9180-d7fb9652a528 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:50.695988 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71888fae-2aaa-4b09-9180-d7fb9652a528 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:50.713355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-71888fae-2aaa-4b09-9180-d7fb9652a528 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:02:50.713355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:50.713355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:50.713355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:50.713355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:50.713355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:50.713355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:50.713355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:50.713355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:50.713355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:50.713355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:50.713355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:50.713355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:02:50.713355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:02:50.713355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:02:50.714508 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:02:50.714508 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:50.714508 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:50.714508 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:50.714508 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:50.714508 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:50.714508 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:50.714508 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:50.714508 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:50.714508 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:50.714508 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:50.714508 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:50.714508 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:50.714508 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:50.714508 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:50.714508 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:50.714508 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:50.715663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:02:50.715663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:02:50.715663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:02:50.715663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:02:50.715663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 596/1203] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:02:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:50.720802 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d580a9fe-11b4-4935-a9c2-9702d42334be None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:50.817444 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d580a9fe-11b4-4935-a9c2-9702d42334be None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:50.847911 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:50.854216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf1af2-c390-4177-a6c2-94f1803878f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:50.854883 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf1af2-c390-4177-a6c2-94f1803878f0 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:50.855169 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf1af2-c390-4177-a6c2-94f1803878f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:50.855449 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf1af2-c390-4177-a6c2-94f1803878f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:50.856176 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf1af2-c390-4177-a6c2-94f1803878f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:50.856485 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf1af2-c390-4177-a6c2-94f1803878f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:50.857887 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf1af2-c390-4177-a6c2-94f1803878f0 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:50.869642 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 608/1204] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:50.875489 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71888fae-2aaa-4b09-9180-d7fb9652a528 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:50.928294 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:50.974141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71888fae-2aaa-4b09-9180-d7fb9652a528 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:51.007385 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b579763-cbf7-4636-9b1e-ae8fb4c6c08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:51.008071 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b579763-cbf7-4636-9b1e-ae8fb4c6c08b None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:51.008353 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b579763-cbf7-4636-9b1e-ae8fb4c6c08b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:51.008685 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b579763-cbf7-4636-9b1e-ae8fb4c6c08b None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:51.009432 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b579763-cbf7-4636-9b1e-ae8fb4c6c08b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:51.010905 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b579763-cbf7-4636-9b1e-ae8fb4c6c08b None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:51.137876 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 597/1205] 10.222.0.46 () {60 vars in 1132 bytes} [Wed Jun 22 10:02:50 2022] POST /identity/v3/users => generated 251 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:02:53.201624 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88ed55-1b67-4637-9e0b-d7258938a3ca None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:53.202145 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88ed55-1b67-4637-9e0b-d7258938a3ca None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:53.202145 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88ed55-1b67-4637-9e0b-d7258938a3ca None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:53.203531 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 609/1206] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:53.209153 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f278c-5382-4148-9707-7e42a4e849b3 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:53.209583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f278c-5382-4148-9707-7e42a4e849b3 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:53.209726 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f278c-5382-4148-9707-7e42a4e849b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:53.226843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-f60f278c-5382-4148-9707-7e42a4e849b3 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:53.228033 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-f60f278c-5382-4148-9707-7e42a4e849b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:53.293947 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 598/1207] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:02:53.318474 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88ed55-1b67-4637-9e0b-d7258938a3ca None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:53.420995 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88ed55-1b67-4637-9e0b-d7258938a3ca None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:53.459650 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ab3be-c738-4cd1-8a3b-18e39e1619d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:53.459650 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ab3be-c738-4cd1-8a3b-18e39e1619d8 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:53.459650 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ab3be-c738-4cd1-8a3b-18e39e1619d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:53.459650 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ab3be-c738-4cd1-8a3b-18e39e1619d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:53.465886 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ab3be-c738-4cd1-8a3b-18e39e1619d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:53.473423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-7b8ab3be-c738-4cd1-8a3b-18e39e1619d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:02:53.473423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:53.473423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:53.473423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:53.473423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:53.473423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:53.473423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:53.473423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:53.473423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:53.473423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:53.473423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:53.473423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:53.473423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:53.473423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:53.473423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:53.473423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:53.474522 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:53.474522 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:53.474522 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:53.474522 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:53.474522 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:53.474522 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:53.474522 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:53.474522 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:53.474522 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:53.474522 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:53.474522 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:53.474522 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:53.474522 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:53.474522 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:53.474522 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:53.474522 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:53.475413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:53.475413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:53.475413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:53.475413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:53.475413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:53.475413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:53.475413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:53.475413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:53.475413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:53.475413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:53.475413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:02:53.475413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:02:53.475413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 610/1208] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 22 10:02:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:53.480662 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f278c-5382-4148-9707-7e42a4e849b3 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:53.519688 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:53.578148 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f278c-5382-4148-9707-7e42a4e849b3 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:53.610235 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d305a6f-3b2f-4408-b381-17826c4a963d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:53.610899 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d305a6f-3b2f-4408-b381-17826c4a963d None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:53.611185 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d305a6f-3b2f-4408-b381-17826c4a963d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:53.611463 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d305a6f-3b2f-4408-b381-17826c4a963d None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:53.612209 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d305a6f-3b2f-4408-b381-17826c4a963d None admin] RBAC: Adding query filter params (name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:53.612519 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d305a6f-3b2f-4408-b381-17826c4a963d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:53.614441 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d305a6f-3b2f-4408-b381-17826c4a963d None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:53.622487 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 599/1209] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 22 10:02:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:53.628181 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ab3be-c738-4cd1-8a3b-18e39e1619d8 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:53.679168 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:53.728063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ab3be-c738-4cd1-8a3b-18e39e1619d8 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:53.762098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e91e16-0d7c-47a8-b7f0-59ce8ba81d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:53.762878 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e91e16-0d7c-47a8-b7f0-59ce8ba81d51 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:53.763163 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e91e16-0d7c-47a8-b7f0-59ce8ba81d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:53.763442 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e91e16-0d7c-47a8-b7f0-59ce8ba81d51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:53.773434 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e91e16-0d7c-47a8-b7f0-59ce8ba81d51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:53.775146 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e91e16-0d7c-47a8-b7f0-59ce8ba81d51 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:53.793170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-79e91e16-0d7c-47a8-b7f0-59ce8ba81d51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:02:53.793170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:53.793170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:53.793170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:53.793170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:53.793170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:53.793170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:53.793170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:53.793170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:53.793170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:53.793170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:53.793170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:53.793170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:02:53.793170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:02:53.793170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:02:53.794216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:02:53.794216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:53.794216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:53.794216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:53.794216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:53.794216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:53.794216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:53.794216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:53.794216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:53.794216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:53.794216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:53.794216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:53.794216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:53.794216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:53.794216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:53.794216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:53.794216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:53.795426 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:02:53.795426 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:02:53.795426 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:02:53.795426 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:02:53.795426 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 611/1210] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:53.800242 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d305a6f-3b2f-4408-b381-17826c4a963d None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:53.895264 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:53.898221 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d305a6f-3b2f-4408-b381-17826c4a963d None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:53.932390 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a58f5-966a-4b75-98fb-11866e0f60c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:53.933074 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a58f5-966a-4b75-98fb-11866e0f60c8 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:53.933361 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a58f5-966a-4b75-98fb-11866e0f60c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:53.933639 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a58f5-966a-4b75-98fb-11866e0f60c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:53.934358 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a58f5-966a-4b75-98fb-11866e0f60c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:53.934665 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a58f5-966a-4b75-98fb-11866e0f60c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:53.936037 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a58f5-966a-4b75-98fb-11866e0f60c8 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:53.947377 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 600/1211] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:53.953804 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e91e16-0d7c-47a8-b7f0-59ce8ba81d51 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:54.052978 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e91e16-0d7c-47a8-b7f0-59ce8ba81d51 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:54.054495 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:54.090599 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889b506-edca-47de-98be-06c36cd7a1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:54.091396 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889b506-edca-47de-98be-06c36cd7a1ec None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:54.091678 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889b506-edca-47de-98be-06c36cd7a1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:54.091955 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889b506-edca-47de-98be-06c36cd7a1ec None admin] PATH_INFO: `/v3/users/placement` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:54.099969 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889b506-edca-47de-98be-06c36cd7a1ec None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:54.101553 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889b506-edca-47de-98be-06c36cd7a1ec None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:54.116569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-9889b506-edca-47de-98be-06c36cd7a1ec None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:02:54.116569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:54.116569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:54.116569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:54.116569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:54.116569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:54.116569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:54.116569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:54.116569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:54.116569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:54.116569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:54.116569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:54.116569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:02:54.116569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:02:54.116569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:02:54.116569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:02:54.124167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:54.124167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:54.124167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:02:54.124167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:02:54.124167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:02:54.124167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:02:54.124167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:54.124167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:54.124167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:54.124167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:54.124167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:54.124167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:54.124167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:54.124167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:54.124167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:54.124167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:54.124167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:54.124167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:54.125409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:54.125409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:54.125409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:02:54.125409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:02:54.125409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:02:54.125409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:02:54.125409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:02:54.125409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:02:54.125409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:02:54.125409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:02:54.125409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 612/1212] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:02:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:54.126236 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a58f5-966a-4b75-98fb-11866e0f60c8 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:54.225369 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a58f5-966a-4b75-98fb-11866e0f60c8 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:54.257992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498914d-94f2-43c8-aa53-b1de680e5105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:54.258656 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498914d-94f2-43c8-aa53-b1de680e5105 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:54.258937 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498914d-94f2-43c8-aa53-b1de680e5105 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:54.259212 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498914d-94f2-43c8-aa53-b1de680e5105 None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:54.260060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498914d-94f2-43c8-aa53-b1de680e5105 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:54.260368 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498914d-94f2-43c8-aa53-b1de680e5105 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:54.261887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498914d-94f2-43c8-aa53-b1de680e5105 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:54.279053 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 601/1213] 10.222.0.46 () {56 vars in 1143 bytes} [Wed Jun 22 10:02:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:54.284661 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889b506-edca-47de-98be-06c36cd7a1ec None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:54.384542 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889b506-edca-47de-98be-06c36cd7a1ec None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:54.420366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b0bfe-ba8c-4db4-8de0-2319eea0b8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:54.423384 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b0bfe-ba8c-4db4-8de0-2319eea0b8ed None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:54.423384 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b0bfe-ba8c-4db4-8de0-2319eea0b8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:54.423384 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b0bfe-ba8c-4db4-8de0-2319eea0b8ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:54.451995 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:54.489478 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b0bfe-ba8c-4db4-8de0-2319eea0b8ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:54.491263 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b0bfe-ba8c-4db4-8de0-2319eea0b8ed None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:54.587513 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 613/1214] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 10:02:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:02:54.593339 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498914d-94f2-43c8-aa53-b1de680e5105 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:54.612754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:54.691386 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498914d-94f2-43c8-aa53-b1de680e5105 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:54.737604 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e357f54-1519-4bce-abf8-f75942d2393d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:54.738412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e357f54-1519-4bce-abf8-f75942d2393d None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:54.739274 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e357f54-1519-4bce-abf8-f75942d2393d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:54.739546 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e357f54-1519-4bce-abf8-f75942d2393d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:54.749558 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e357f54-1519-4bce-abf8-f75942d2393d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:54.750997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e357f54-1519-4bce-abf8-f75942d2393d None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:54.767936 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-2e357f54-1519-4bce-abf8-f75942d2393d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:02:54.767936 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:54.767936 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:54.767936 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:54.767936 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:54.767936 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:54.767936 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:54.767936 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:54.767936 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:54.767936 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:54.767936 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:54.767936 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:54.767936 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:02:54.767936 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:02:54.767936 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:02:54.769060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:02:54.769060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:54.769060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:54.769060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:54.769060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:54.769060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:54.769060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:54.769060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:54.769060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:54.769060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:54.769060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:54.769060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:54.769060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:54.769060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:54.769060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:54.769060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:54.769060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:54.770256 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:02:54.770256 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:02:54.770256 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:02:54.770256 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:02:54.770256 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 602/1215] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:54.775002 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b0bfe-ba8c-4db4-8de0-2319eea0b8ed None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:54.835454 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:54.874261 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b0bfe-ba8c-4db4-8de0-2319eea0b8ed None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:54.907217 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405db05-1d39-446a-93fb-459b18876060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:54.907908 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405db05-1d39-446a-93fb-459b18876060 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:54.908193 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405db05-1d39-446a-93fb-459b18876060 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:54.908499 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405db05-1d39-446a-93fb-459b18876060 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:54.909254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405db05-1d39-446a-93fb-459b18876060 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:54.909565 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405db05-1d39-446a-93fb-459b18876060 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:54.911551 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405db05-1d39-446a-93fb-459b18876060 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:54.927595 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 614/1216] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:54.929127 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e357f54-1519-4bce-abf8-f75942d2393d None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:55.005508 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:55.026243 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e357f54-1519-4bce-abf8-f75942d2393d None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:55.070513 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c89fa-0fb2-466a-9810-9292b512f0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:55.071320 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c89fa-0fb2-466a-9810-9292b512f0ec None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:55.071607 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c89fa-0fb2-466a-9810-9292b512f0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:55.071889 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c89fa-0fb2-466a-9810-9292b512f0ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:55.080029 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c89fa-0fb2-466a-9810-9292b512f0ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:55.081510 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c89fa-0fb2-466a-9810-9292b512f0ec None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:55.099006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-8e5c89fa-0fb2-466a-9810-9292b512f0ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:02:55.099006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:55.099006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:55.099006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:55.099006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:55.099006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:55.099006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:55.099006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:55.099006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:55.099006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:55.099006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:55.099006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:55.099006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:02:55.099006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:02:55.099006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:02:55.099966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:02:55.099966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:55.099966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:55.099966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:55.099966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:55.099966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:55.099966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:55.099966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:55.099966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:55.099966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:55.099966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:55.099966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:55.099966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:55.099966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:55.099966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:55.099966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:55.099966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:55.106440 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:02:55.106440 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:02:55.106440 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:02:55.106440 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:02:55.106440 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:02:55.106440 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:02:55.106440 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:02:55.106440 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:02:55.106440 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 603/1217] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 10:02:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:55.107073 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405db05-1d39-446a-93fb-459b18876060 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:55.203362 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405db05-1d39-446a-93fb-459b18876060 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:55.226837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:55.237925 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8ea46-0167-4b3b-8224-3134990b27d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:55.238618 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8ea46-0167-4b3b-8224-3134990b27d3 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:55.238927 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8ea46-0167-4b3b-8224-3134990b27d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:55.239321 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8ea46-0167-4b3b-8224-3134990b27d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:55.240103 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8ea46-0167-4b3b-8224-3134990b27d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:55.240409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8ea46-0167-4b3b-8224-3134990b27d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:55.241858 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8ea46-0167-4b3b-8224-3134990b27d3 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:55.253778 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 615/1218] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 10:02:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:55.259989 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c89fa-0fb2-466a-9810-9292b512f0ec None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:55.361882 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c89fa-0fb2-466a-9810-9292b512f0ec None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:55.389496 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:55.395863 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af962ada-e999-4c58-bb26-6c8b146c52d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:55.396512 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af962ada-e999-4c58-bb26-6c8b146c52d2 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:55.396796 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af962ada-e999-4c58-bb26-6c8b146c52d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:55.397100 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af962ada-e999-4c58-bb26-6c8b146c52d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:55.397929 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af962ada-e999-4c58-bb26-6c8b146c52d2 None admin] RBAC: Adding query filter params (role.id=604a13bdd0fd46e182a9749de3b5232d, scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9, user.id=675892a676054b4f86f9ac12d95f4f5c) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:55.398240 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af962ada-e999-4c58-bb26-6c8b146c52d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:55.399670 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af962ada-e999-4c58-bb26-6c8b146c52d2 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:55.404982 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 604/1219] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 10:02:55 2022] GET /identity/v3/role_assignments?user.id=675892a676054b4f86f9ac12d95f4f5c&scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9&role.id=604a13bdd0fd46e182a9749de3b5232d => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:57.402862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5f62e-84cc-4029-a2d3-10790aac4dee None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:57.403393 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5f62e-84cc-4029-a2d3-10790aac4dee None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:57.403482 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5f62e-84cc-4029-a2d3-10790aac4dee None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:57.404785 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 616/1220] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:57.410233 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c10c1-7396-4609-8023-197205795137 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:57.410800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c10c1-7396-4609-8023-197205795137 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:57.410800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c10c1-7396-4609-8023-197205795137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:57.427643 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-b16c10c1-7396-4609-8023-197205795137 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:57.428810 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-b16c10c1-7396-4609-8023-197205795137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:57.494061 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 605/1221] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:02:57.516391 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5f62e-84cc-4029-a2d3-10790aac4dee None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:57.618439 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5f62e-84cc-4029-a2d3-10790aac4dee None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:57.651182 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d9db5-34b7-43f7-a220-0dd0e6e8f231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:57.651963 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d9db5-34b7-43f7-a220-0dd0e6e8f231 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:57.652240 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d9db5-34b7-43f7-a220-0dd0e6e8f231 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:57.652513 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d9db5-34b7-43f7-a220-0dd0e6e8f231 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:57.663125 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d9db5-34b7-43f7-a220-0dd0e6e8f231 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:57.670839 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-5d6d9db5-34b7-43f7-a220-0dd0e6e8f231 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:02:57.670839 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:57.670839 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:57.670839 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:57.670839 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:57.670839 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:57.670839 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:57.670839 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:57.670839 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:57.670839 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:57.670839 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:57.670839 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:57.670839 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:57.670839 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:57.670839 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:57.670839 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:57.671862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:57.671862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:57.671862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:57.671862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:57.671862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:57.671862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:57.671862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:57.671862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:57.671862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:57.671862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:57.671862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:57.671862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:57.671862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:57.671862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:57.671862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:57.671862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:57.673009 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:57.673009 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:57.673009 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:57.673009 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:57.673009 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:57.673009 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:57.673009 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:57.673009 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:57.673009 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:57.673009 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:57.673009 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:02:57.673009 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:02:57.673009 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 617/1222] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 22 10:02:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:57.678380 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c10c1-7396-4609-8023-197205795137 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:57.781754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c10c1-7396-4609-8023-197205795137 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:57.804403 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:57.815097 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f2924-b2ab-4464-b04c-6b9a72817d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:57.815884 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f2924-b2ab-4464-b04c-6b9a72817d96 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:57.816171 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f2924-b2ab-4464-b04c-6b9a72817d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:57.816451 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f2924-b2ab-4464-b04c-6b9a72817d96 None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:57.817740 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f2924-b2ab-4464-b04c-6b9a72817d96 None admin] RBAC: Adding query filter params (name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:57.818056 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f2924-b2ab-4464-b04c-6b9a72817d96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:57.819416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f2924-b2ab-4464-b04c-6b9a72817d96 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:57.827326 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 606/1223] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 22 10:02:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:57.833088 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d9db5-34b7-43f7-a220-0dd0e6e8f231 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:57.877626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:57.933732 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d9db5-34b7-43f7-a220-0dd0e6e8f231 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:57.967736 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460a9c2-19a4-4ca2-9298-71963de3e04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:57.968520 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460a9c2-19a4-4ca2-9298-71963de3e04c None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:57.968801 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460a9c2-19a4-4ca2-9298-71963de3e04c None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:57.969102 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460a9c2-19a4-4ca2-9298-71963de3e04c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:57.980114 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460a9c2-19a4-4ca2-9298-71963de3e04c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:57.981704 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460a9c2-19a4-4ca2-9298-71963de3e04c None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:57.999909 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-f460a9c2-19a4-4ca2-9298-71963de3e04c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:02:57.999909 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:57.999909 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:57.999909 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:57.999909 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:57.999909 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:57.999909 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:57.999909 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:57.999909 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:57.999909 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:57.999909 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:57.999909 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:57.999909 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:02:57.999909 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:02:57.999909 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:02:58.001049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:02:58.001049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:58.001049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:58.001049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:58.001049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:58.001049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:58.001049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:58.001049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:58.001049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:58.001049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:58.001049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:58.001049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:58.001049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:58.001049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:58.001049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:58.001049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:58.001049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:58.002349 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:02:58.002349 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:02:58.002349 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:02:58.002349 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:02:58.002349 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 618/1224] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:02:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:58.007438 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f2924-b2ab-4464-b04c-6b9a72817d96 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:58.109081 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f2924-b2ab-4464-b04c-6b9a72817d96 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:58.143333 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3be793-b3dc-4740-a310-60bcd95ec97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:58.143989 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3be793-b3dc-4740-a310-60bcd95ec97f None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:58.144274 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3be793-b3dc-4740-a310-60bcd95ec97f None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:58.144551 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3be793-b3dc-4740-a310-60bcd95ec97f None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:58.145379 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3be793-b3dc-4740-a310-60bcd95ec97f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:58.145698 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3be793-b3dc-4740-a310-60bcd95ec97f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:58.147144 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3be793-b3dc-4740-a310-60bcd95ec97f None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:58.158714 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 607/1225] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:58.164481 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460a9c2-19a4-4ca2-9298-71963de3e04c None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:58.256551 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:58.262745 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460a9c2-19a4-4ca2-9298-71963de3e04c None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:58.294477 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34716edd-ed6a-4c72-9c4e-84f5d0d1337e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:58.295270 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34716edd-ed6a-4c72-9c4e-84f5d0d1337e None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:58.295553 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34716edd-ed6a-4c72-9c4e-84f5d0d1337e None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:58.295828 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34716edd-ed6a-4c72-9c4e-84f5d0d1337e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:58.303853 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34716edd-ed6a-4c72-9c4e-84f5d0d1337e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:58.305321 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34716edd-ed6a-4c72-9c4e-84f5d0d1337e None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:58.319855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-34716edd-ed6a-4c72-9c4e-84f5d0d1337e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:02:58.319855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:58.319855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:58.319855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:58.319855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:58.319855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:58.319855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:58.319855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:58.319855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:58.319855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:58.319855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:58.319855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:58.319855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:02:58.319855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:02:58.319855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:02:58.319855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:02:58.320849 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:58.320849 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:58.320849 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:02:58.320849 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:02:58.320849 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:02:58.320849 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:02:58.320849 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:58.320849 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:58.320849 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:58.320849 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:58.320849 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:58.320849 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:58.320849 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:58.320849 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:58.320849 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:58.320849 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:58.320849 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:58.320849 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:58.324224 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:58.324224 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:58.324224 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:02:58.324224 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:02:58.324224 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:02:58.324224 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:02:58.324224 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:02:58.324224 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:02:58.324224 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:02:58.324224 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:02:58.324224 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 619/1226] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:02:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:58.330177 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3be793-b3dc-4740-a310-60bcd95ec97f None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:58.375944 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:58.430407 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3be793-b3dc-4740-a310-60bcd95ec97f None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:58.463869 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288ea6c-a3b7-4528-8315-aaf057e4ceba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:58.464532 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288ea6c-a3b7-4528-8315-aaf057e4ceba None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:58.464838 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288ea6c-a3b7-4528-8315-aaf057e4ceba None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:58.465107 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288ea6c-a3b7-4528-8315-aaf057e4ceba None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:58.465936 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288ea6c-a3b7-4528-8315-aaf057e4ceba None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:58.466247 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288ea6c-a3b7-4528-8315-aaf057e4ceba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:58.467683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288ea6c-a3b7-4528-8315-aaf057e4ceba None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:58.485422 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 608/1227] 10.222.0.46 () {56 vars in 1143 bytes} [Wed Jun 22 10:02:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:58.491886 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34716edd-ed6a-4c72-9c4e-84f5d0d1337e None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:58.589442 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34716edd-ed6a-4c72-9c4e-84f5d0d1337e None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:58.623259 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8b6fa-0cdf-49d8-bfac-ac60fdfc5af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:58.624053 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8b6fa-0cdf-49d8-bfac-ac60fdfc5af5 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:58.624319 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8b6fa-0cdf-49d8-bfac-ac60fdfc5af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:58.624589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8b6fa-0cdf-49d8-bfac-ac60fdfc5af5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:58.635008 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8b6fa-0cdf-49d8-bfac-ac60fdfc5af5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:58.636439 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8b6fa-0cdf-49d8-bfac-ac60fdfc5af5 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:58.653285 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-87e8b6fa-0cdf-49d8-bfac-ac60fdfc5af5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:02:58.653285 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:58.653285 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:58.653285 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:58.653285 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:58.653285 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:58.653285 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:58.653285 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:58.653285 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:58.653285 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:58.653285 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:58.653285 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:58.653285 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:02:58.653285 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:02:58.653285 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:02:58.654346 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:02:58.654346 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:58.654346 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:58.654346 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:58.654346 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:58.654346 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:58.654346 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:58.654346 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:58.654346 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:58.654346 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:58.654346 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:58.654346 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:58.654346 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:58.654346 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:58.654346 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:58.654346 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:58.654346 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:58.655477 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:02:58.655477 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:02:58.655477 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:02:58.655477 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:02:58.655477 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 620/1228] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:58.660995 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288ea6c-a3b7-4528-8315-aaf057e4ceba None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:58.759402 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288ea6c-a3b7-4528-8315-aaf057e4ceba None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:58.761678 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:58.791793 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291f770-1810-4446-a53b-b150dd75be48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:58.792447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291f770-1810-4446-a53b-b150dd75be48 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:58.792730 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291f770-1810-4446-a53b-b150dd75be48 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:58.793031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291f770-1810-4446-a53b-b150dd75be48 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:58.793904 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291f770-1810-4446-a53b-b150dd75be48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:58.794209 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291f770-1810-4446-a53b-b150dd75be48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:58.795568 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291f770-1810-4446-a53b-b150dd75be48 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:58.807052 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 609/1229] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:58.813021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8b6fa-0cdf-49d8-bfac-ac60fdfc5af5 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:58.822917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:58.912149 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8b6fa-0cdf-49d8-bfac-ac60fdfc5af5 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:58.945354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec00e7d-0ff4-4f4e-a832-414dde8c5123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:58.946145 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec00e7d-0ff4-4f4e-a832-414dde8c5123 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:58.946431 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec00e7d-0ff4-4f4e-a832-414dde8c5123 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:58.946771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec00e7d-0ff4-4f4e-a832-414dde8c5123 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:58.953478 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec00e7d-0ff4-4f4e-a832-414dde8c5123 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:58.954928 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec00e7d-0ff4-4f4e-a832-414dde8c5123 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:58.969376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-7ec00e7d-0ff4-4f4e-a832-414dde8c5123 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:02:58.969376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:58.969376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:58.969376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:58.969376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:58.969376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:58.969376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:58.969376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:58.969376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:58.969376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:58.969376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:58.969376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:58.969376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:02:58.969376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:02:58.969376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:02:58.970446 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:02:58.970446 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:58.970446 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:58.970446 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:58.970446 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:58.970446 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:58.970446 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:58.970446 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:58.970446 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:58.970446 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:58.970446 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:58.970446 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:58.970446 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:58.970446 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:58.970446 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:58.970446 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:58.970446 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:58.971520 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:02:58.971520 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:02:58.971520 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:02:58.971520 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:02:58.971520 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:02:58.971520 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:02:58.971520 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:02:58.971520 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:02:58.971520 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 621/1230] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 10:02:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:58.977103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291f770-1810-4446-a53b-b150dd75be48 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:59.082463 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291f770-1810-4446-a53b-b150dd75be48 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:59.115505 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf186f-7631-4604-b651-4a2099e12809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:59.116160 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf186f-7631-4604-b651-4a2099e12809 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:59.116445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf186f-7631-4604-b651-4a2099e12809 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:59.116720 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf186f-7631-4604-b651-4a2099e12809 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:59.117541 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf186f-7631-4604-b651-4a2099e12809 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:59.117854 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf186f-7631-4604-b651-4a2099e12809 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:59.119433 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf186f-7631-4604-b651-4a2099e12809 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:59.131802 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 610/1231] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 10:02:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:59.137919 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec00e7d-0ff4-4f4e-a832-414dde8c5123 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:59.203318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:59.236048 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec00e7d-0ff4-4f4e-a832-414dde8c5123 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:59.270311 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56415d45-367e-4810-a505-f57ddef5ab11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:59.271193 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56415d45-367e-4810-a505-f57ddef5ab11 None admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:59.271474 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56415d45-367e-4810-a505-f57ddef5ab11 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:59.271749 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56415d45-367e-4810-a505-f57ddef5ab11 None admin] PATH_INFO: `/v3/projects/a2bb614e4d7747c1a3fff154c8bc18d9/users/675892a676054b4f86f9ac12d95f4f5c/roles/604a13bdd0fd46e182a9749de3b5232d` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:59.287268 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56415d45-367e-4810-a505-f57ddef5ab11 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2bb614e4d7747c1a3fff154c8bc18d9, user_id=675892a676054b4f86f9ac12d95f4f5c, role_id=604a13bdd0fd46e182a9749de3b5232d)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:59.288689 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56415d45-367e-4810-a505-f57ddef5ab11 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:59.360754 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 622/1232] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 22 10:02:59 2022] PUT /identity/v3/projects/a2bb614e4d7747c1a3fff154c8bc18d9/users/675892a676054b4f86f9ac12d95f4f5c/roles/604a13bdd0fd46e182a9749de3b5232d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:03:01.444259 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ba647-d322-4969-8d86-f775418069c8 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:01.444778 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ba647-d322-4969-8d86-f775418069c8 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:01.444950 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ba647-d322-4969-8d86-f775418069c8 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:01.446562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 611/1233] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:03:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:01.451804 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0592f-907f-48f3-adb5-2f8fef488a99 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:01.452221 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0592f-907f-48f3-adb5-2f8fef488a99 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:01.452360 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0592f-907f-48f3-adb5-2f8fef488a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:01.468400 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-83a0592f-907f-48f3-adb5-2f8fef488a99 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:01.469619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-83a0592f-907f-48f3-adb5-2f8fef488a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:01.534333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 623/1234] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:03:01.558607 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ba647-d322-4969-8d86-f775418069c8 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:01.583407 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:01.657535 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ba647-d322-4969-8d86-f775418069c8 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:01.748549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784aced6-de05-4d98-8147-de2524e40d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:01.748549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784aced6-de05-4d98-8147-de2524e40d8c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:01.748549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784aced6-de05-4d98-8147-de2524e40d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:01.748549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784aced6-de05-4d98-8147-de2524e40d8c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:01.749098 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784aced6-de05-4d98-8147-de2524e40d8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:03:01.749098 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-784aced6-de05-4d98-8147-de2524e40d8c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:01.749098 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:01.749098 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:01.749098 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:01.749098 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:01.749098 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:01.749098 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:01.749098 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:01.749098 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:01.749098 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:01.749098 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:01.749098 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:01.749098 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:03:01.750083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:03:01.750083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:03:01.750083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:03:01.750083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:03:01.750083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:03:01.750083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:03:01.750083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:03:01.750083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:01.750083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:01.750083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:01.750083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:01.750083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:01.750083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:01.750083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:01.750083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:01.750083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:01.750083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:01.751023 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:01.751023 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:01.751023 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:01.751023 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:01.751023 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:01.751023 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:01.751023 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:03:01.751023 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:03:01.751023 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:03:01.751023 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:03:01.751023 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:03:01.751023 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:03:01.751023 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:01.751023 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:03:01.751023 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 612/1235] 10.222.0.46 () {56 vars in 1102 bytes} [Wed Jun 22 10:03:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:03:01.751864 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0592f-907f-48f3-adb5-2f8fef488a99 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:01.784110 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:01.837657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0592f-907f-48f3-adb5-2f8fef488a99 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:01.871261 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cfa27-a21b-40ff-b269-79d0521a3ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:01.871926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cfa27-a21b-40ff-b269-79d0521a3ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:01.872211 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cfa27-a21b-40ff-b269-79d0521a3ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:01.872487 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cfa27-a21b-40ff-b269-79d0521a3ed4 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:01.873263 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4cfa27-a21b-40ff-b269-79d0521a3ed4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:01.873571 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4cfa27-a21b-40ff-b269-79d0521a3ed4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:01.874989 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4cfa27-a21b-40ff-b269-79d0521a3ed4 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:01.883188 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 624/1236] 10.222.0.46 () {56 vars in 1103 bytes} [Wed Jun 22 10:03:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:01.888894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784aced6-de05-4d98-8147-de2524e40d8c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:01.972493 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:01.988480 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784aced6-de05-4d98-8147-de2524e40d8c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:02.022326 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da914745-2b62-427b-8484-d689d4187f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:02.023046 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da914745-2b62-427b-8484-d689d4187f16 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:02.023334 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da914745-2b62-427b-8484-d689d4187f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:02.023611 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da914745-2b62-427b-8484-d689d4187f16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:02.033919 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da914745-2b62-427b-8484-d689d4187f16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:02.037456 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da914745-2b62-427b-8484-d689d4187f16 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:02.054953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-da914745-2b62-427b-8484-d689d4187f16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:02.054953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:02.054953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:02.054953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:02.054953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:02.054953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:02.054953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:02.054953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:02.054953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:02.054953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:02.054953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:02.054953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:02.054953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:02.054953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:02.054953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:02.056093 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:02.056093 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:02.056093 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:02.056093 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:02.056093 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:02.056093 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:02.056093 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:02.056093 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:02.056093 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:02.056093 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:02.056093 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:02.056093 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:02.056093 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:02.056093 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:02.056093 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:02.056093 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:02.056093 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:02.060357 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:02.060357 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:02.060357 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:02.060357 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:03:02.060357 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 613/1237] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:02.062134 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cfa27-a21b-40ff-b269-79d0521a3ed4 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:02.178166 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cfa27-a21b-40ff-b269-79d0521a3ed4 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:02.187803 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:02.211824 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283ed46-9407-4ebb-8d86-62a20973b2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:02.212487 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283ed46-9407-4ebb-8d86-62a20973b2d9 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:02.212773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283ed46-9407-4ebb-8d86-62a20973b2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:02.213084 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283ed46-9407-4ebb-8d86-62a20973b2d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:02.213810 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283ed46-9407-4ebb-8d86-62a20973b2d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:02.214123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283ed46-9407-4ebb-8d86-62a20973b2d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:02.215480 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283ed46-9407-4ebb-8d86-62a20973b2d9 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:02.226993 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 625/1238] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:02.232905 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da914745-2b62-427b-8484-d689d4187f16 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:02.336008 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da914745-2b62-427b-8484-d689d4187f16 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:02.370571 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95beed56-8d3e-433f-bebb-9331307ea1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:02.371392 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95beed56-8d3e-433f-bebb-9331307ea1c9 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:02.371671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95beed56-8d3e-433f-bebb-9331307ea1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:02.371944 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95beed56-8d3e-433f-bebb-9331307ea1c9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:02.374813 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:02.379418 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95beed56-8d3e-433f-bebb-9331307ea1c9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:02.382853 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95beed56-8d3e-433f-bebb-9331307ea1c9 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:02.395683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-95beed56-8d3e-433f-bebb-9331307ea1c9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:03:02.395683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:02.395683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:02.395683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:02.395683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:02.395683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:02.395683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:02.395683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:02.395683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:02.395683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:02.395683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:02.395683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:02.395683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:03:02.395683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:03:02.395683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:03:02.395683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:03:02.396898 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:02.396898 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:02.396898 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:02.396898 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:02.396898 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:02.396898 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:02.396898 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:02.396898 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:02.396898 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:02.396898 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:02.396898 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:02.396898 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:02.396898 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:02.396898 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:02.396898 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:02.396898 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:02.396898 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:02.396898 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:02.398073 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:02.398073 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:02.398073 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:03:02.398073 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:03:02.398073 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:03:02.398073 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:03:02.398073 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:03:02.398073 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:03:02.398073 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:03:02.398073 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:03:02.398073 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 614/1239] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:02.403601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283ed46-9407-4ebb-8d86-62a20973b2d9 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:02.505136 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283ed46-9407-4ebb-8d86-62a20973b2d9 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:02.537464 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6305ba-3d91-461d-8b63-78f2f31ae0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:02.538123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6305ba-3d91-461d-8b63-78f2f31ae0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:02.538404 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6305ba-3d91-461d-8b63-78f2f31ae0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:02.538679 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6305ba-3d91-461d-8b63-78f2f31ae0e3 None admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:02.539501 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6305ba-3d91-461d-8b63-78f2f31ae0e3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:02.539807 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6305ba-3d91-461d-8b63-78f2f31ae0e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:02.541259 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6305ba-3d91-461d-8b63-78f2f31ae0e3 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:02.558230 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 626/1240] 10.222.0.46 () {56 vars in 1143 bytes} [Wed Jun 22 10:03:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:02.564149 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95beed56-8d3e-433f-bebb-9331307ea1c9 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:02.659313 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95beed56-8d3e-433f-bebb-9331307ea1c9 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:02.693543 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978bc60-8166-4045-82e7-4ed11c5fe943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:02.694189 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978bc60-8166-4045-82e7-4ed11c5fe943 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:02.694468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978bc60-8166-4045-82e7-4ed11c5fe943 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:02.694739 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978bc60-8166-4045-82e7-4ed11c5fe943 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:02.753911 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:02.760302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978bc60-8166-4045-82e7-4ed11c5fe943 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:02.761791 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978bc60-8166-4045-82e7-4ed11c5fe943 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:02.857496 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 615/1241] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 10:03:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:03:02.863589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6305ba-3d91-461d-8b63-78f2f31ae0e3 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:02.890616 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:02.961913 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6305ba-3d91-461d-8b63-78f2f31ae0e3 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:02.994282 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855f29b-316a-4184-962f-faa0a37532de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:02.995071 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855f29b-316a-4184-962f-faa0a37532de None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:02.995353 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855f29b-316a-4184-962f-faa0a37532de None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:02.995626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855f29b-316a-4184-962f-faa0a37532de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:03.006367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8855f29b-316a-4184-962f-faa0a37532de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:03.008463 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8855f29b-316a-4184-962f-faa0a37532de None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:03.026059 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-8855f29b-316a-4184-962f-faa0a37532de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:03.026059 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:03.026059 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:03.026059 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:03.026059 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:03.026059 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:03.026059 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:03.026059 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:03.026059 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:03.026059 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:03.026059 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:03.026059 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:03.026059 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:03.026059 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:03.026059 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:03.027159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:03.027159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:03.027159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:03.027159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:03.027159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:03.027159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:03.027159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:03.027159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:03.027159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:03.027159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:03.027159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:03.027159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:03.027159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:03.027159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:03.027159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:03.027159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:03.027159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:03.028143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:03.028143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:03.028143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:03.028143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:03:03.028143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 627/1242] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:03.033065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978bc60-8166-4045-82e7-4ed11c5fe943 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:03.127542 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:03.133839 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978bc60-8166-4045-82e7-4ed11c5fe943 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:03.166662 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6a54a-54a5-4fa2-bc68-f71c86e98369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:03.167322 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6a54a-54a5-4fa2-bc68-f71c86e98369 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:03.167606 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6a54a-54a5-4fa2-bc68-f71c86e98369 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:03.167885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6a54a-54a5-4fa2-bc68-f71c86e98369 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:03.168603 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6a54a-54a5-4fa2-bc68-f71c86e98369 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:03.168941 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6a54a-54a5-4fa2-bc68-f71c86e98369 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:03.170322 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6a54a-54a5-4fa2-bc68-f71c86e98369 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:03.181135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 616/1243] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:03.187007 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855f29b-316a-4184-962f-faa0a37532de None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:03.267255 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:03.296338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855f29b-316a-4184-962f-faa0a37532de None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:03.332273 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fda4a5-2b78-4eea-ad53-d7f4dda5dc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:03.333093 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fda4a5-2b78-4eea-ad53-d7f4dda5dc61 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:03.333379 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fda4a5-2b78-4eea-ad53-d7f4dda5dc61 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:03.333653 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fda4a5-2b78-4eea-ad53-d7f4dda5dc61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:03.340408 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fda4a5-2b78-4eea-ad53-d7f4dda5dc61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:03.341869 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fda4a5-2b78-4eea-ad53-d7f4dda5dc61 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:03.355682 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-25fda4a5-2b78-4eea-ad53-d7f4dda5dc61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:03.355682 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:03.355682 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:03.355682 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:03.355682 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:03.355682 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:03.355682 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:03.355682 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:03.355682 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:03.355682 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:03.355682 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:03.355682 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:03.355682 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:03:03.355682 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:03:03.355682 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:03:03.356867 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:03:03.356867 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:03.356867 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:03.356867 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:03.356867 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:03.356867 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:03.356867 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:03.356867 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:03.356867 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:03.356867 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:03.356867 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:03.356867 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:03.356867 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:03.356867 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:03.356867 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:03.356867 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:03.356867 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:03.357986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:03:03.357986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:03:03.357986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:03:03.357986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:03:03.357986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:03:03.357986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:03:03.357986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:03.357986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:03:03.357986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 628/1244] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:03.362996 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6a54a-54a5-4fa2-bc68-f71c86e98369 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:03.470437 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6a54a-54a5-4fa2-bc68-f71c86e98369 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:03.504319 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e1b11-e97e-48a2-b957-48c1139c1855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:03.505566 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e1b11-e97e-48a2-b957-48c1139c1855 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:03.505850 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e1b11-e97e-48a2-b957-48c1139c1855 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:03.506128 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e1b11-e97e-48a2-b957-48c1139c1855 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:03.506920 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293e1b11-e97e-48a2-b957-48c1139c1855 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:03.507233 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293e1b11-e97e-48a2-b957-48c1139c1855 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:03.508745 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293e1b11-e97e-48a2-b957-48c1139c1855 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:03.522226 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 617/1245] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 10:03:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:03.528444 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fda4a5-2b78-4eea-ad53-d7f4dda5dc61 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:03.626925 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fda4a5-2b78-4eea-ad53-d7f4dda5dc61 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:03.660031 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f8818-f2a2-43ae-bf41-f046d5df24b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:03.660675 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f8818-f2a2-43ae-bf41-f046d5df24b8 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:03.661938 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f8818-f2a2-43ae-bf41-f046d5df24b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:03.662221 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f8818-f2a2-43ae-bf41-f046d5df24b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:03.663060 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f8818-f2a2-43ae-bf41-f046d5df24b8 None admin] RBAC: Adding query filter params (role.id=604a13bdd0fd46e182a9749de3b5232d, scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9, user.id=675892a676054b4f86f9ac12d95f4f5c) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:03.663372 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f8818-f2a2-43ae-bf41-f046d5df24b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:03.664807 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f8818-f2a2-43ae-bf41-f046d5df24b8 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:03.670981 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 629/1246] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 10:03:03 2022] GET /identity/v3/role_assignments?user.id=675892a676054b4f86f9ac12d95f4f5c&scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9&role.id=604a13bdd0fd46e182a9749de3b5232d => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:05.780627 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e89734-5e40-481e-8f9c-89ec45a02c50 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:05.781255 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e89734-5e40-481e-8f9c-89ec45a02c50 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:05.781255 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e89734-5e40-481e-8f9c-89ec45a02c50 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:05.782633 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 618/1247] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:05.787954 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c38f02-1313-4583-a23b-31685f42ea8e None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:05.788388 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c38f02-1313-4583-a23b-31685f42ea8e None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:05.788605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c38f02-1313-4583-a23b-31685f42ea8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:05.793791 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:05.806518 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-09c38f02-1313-4583-a23b-31685f42ea8e None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:05.807701 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-09c38f02-1313-4583-a23b-31685f42ea8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:05.876459 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 630/1248] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:03:05.900442 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e89734-5e40-481e-8f9c-89ec45a02c50 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:05.918719 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:06.001223 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e89734-5e40-481e-8f9c-89ec45a02c50 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:06.034091 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9110ed-c972-4f7d-9617-286431d0d532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:06.036776 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9110ed-c972-4f7d-9617-286431d0d532 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:06.036776 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9110ed-c972-4f7d-9617-286431d0d532 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:06.036776 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9110ed-c972-4f7d-9617-286431d0d532 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:06.046050 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9110ed-c972-4f7d-9617-286431d0d532 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:03:06.053824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-1d9110ed-c972-4f7d-9617-286431d0d532 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:03:06.053824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:06.053824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:06.053824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:06.053824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:06.053824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:06.053824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:06.053824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:06.053824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:06.053824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:06.053824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:06.053824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:06.053824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:03:06.053824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:03:06.053824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:03:06.053824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:03:06.054927 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:03:06.054927 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:03:06.054927 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:03:06.054927 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:03:06.054927 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:06.054927 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:06.054927 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:06.054927 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:06.054927 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:06.054927 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:06.054927 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:06.054927 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:06.054927 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:06.054927 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:06.054927 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:06.054927 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:06.055984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:06.055984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:06.055984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:06.055984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:06.055984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:03:06.055984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:03:06.055984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:03:06.055984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:03:06.055984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:03:06.055984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:03:06.055984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:03:06.055984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:03:06.055984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 619/1249] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 10:03:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:06.061093 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c38f02-1313-4583-a23b-31685f42ea8e None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:06.158950 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c38f02-1313-4583-a23b-31685f42ea8e None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:06.188689 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:06.193574 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0760e76-c811-4a4b-885f-855b89325cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:06.194243 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0760e76-c811-4a4b-885f-855b89325cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:06.194527 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0760e76-c811-4a4b-885f-855b89325cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:06.194807 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0760e76-c811-4a4b-885f-855b89325cb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:06.195561 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0760e76-c811-4a4b-885f-855b89325cb4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:06.195870 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0760e76-c811-4a4b-885f-855b89325cb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:06.197339 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0760e76-c811-4a4b-885f-855b89325cb4 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:06.205229 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 631/1250] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 10:03:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:06.211077 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9110ed-c972-4f7d-9617-286431d0d532 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:06.287484 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:06.310281 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9110ed-c972-4f7d-9617-286431d0d532 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:06.343567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc69dc-9152-4224-8989-f26bf39e092f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:06.344354 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc69dc-9152-4224-8989-f26bf39e092f None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:06.344644 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc69dc-9152-4224-8989-f26bf39e092f None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:06.344954 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc69dc-9152-4224-8989-f26bf39e092f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:06.356389 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc69dc-9152-4224-8989-f26bf39e092f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:06.357874 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc69dc-9152-4224-8989-f26bf39e092f None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:06.375347 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-4ddc69dc-9152-4224-8989-f26bf39e092f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:06.375347 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:06.375347 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:06.375347 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:06.375347 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:06.375347 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:06.375347 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:06.375347 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:06.375347 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:06.375347 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:06.375347 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:06.375347 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:06.375347 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:06.375347 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:06.375347 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:06.376487 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:06.376487 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:06.376487 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:06.376487 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:06.376487 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:06.376487 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:06.376487 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:06.376487 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:06.376487 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:06.376487 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:06.376487 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:06.376487 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:06.376487 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:06.376487 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:06.376487 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:06.376487 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:06.376487 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:06.380456 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:06.380456 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:06.380456 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:06.380456 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:03:06.380456 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 620/1251] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:06.382552 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0760e76-c811-4a4b-885f-855b89325cb4 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:06.481143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0760e76-c811-4a4b-885f-855b89325cb4 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:06.515099 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f63bda-9f31-4722-ac4d-af0dd729a5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:06.516128 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f63bda-9f31-4722-ac4d-af0dd729a5bc None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:06.516505 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f63bda-9f31-4722-ac4d-af0dd729a5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:06.516926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f63bda-9f31-4722-ac4d-af0dd729a5bc None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:06.517708 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f63bda-9f31-4722-ac4d-af0dd729a5bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:06.518057 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f63bda-9f31-4722-ac4d-af0dd729a5bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:06.519591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f63bda-9f31-4722-ac4d-af0dd729a5bc None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:06.532732 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 632/1252] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:06.539180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc69dc-9152-4224-8989-f26bf39e092f None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:06.640841 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc69dc-9152-4224-8989-f26bf39e092f None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:06.667011 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:06.674706 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ef088-9e9a-46d1-9a5b-34baf296d298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:06.675499 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ef088-9e9a-46d1-9a5b-34baf296d298 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:06.675776 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ef088-9e9a-46d1-9a5b-34baf296d298 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:06.676045 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ef088-9e9a-46d1-9a5b-34baf296d298 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:06.684542 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ef088-9e9a-46d1-9a5b-34baf296d298 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:06.686157 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ef088-9e9a-46d1-9a5b-34baf296d298 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:06.700905 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-7d0ef088-9e9a-46d1-9a5b-34baf296d298 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:03:06.700905 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:06.700905 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:06.700905 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:06.700905 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:06.700905 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:06.700905 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:06.700905 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:06.700905 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:06.700905 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:06.700905 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:06.700905 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:06.700905 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:03:06.700905 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:03:06.700905 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:03:06.700905 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:03:06.702019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:06.702019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:06.702019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:06.702019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:06.702019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:06.702019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:06.702019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:06.702019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:06.702019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:06.702019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:06.702019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:06.702019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:06.702019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:06.702019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:06.702019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:06.702019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:06.702019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:06.702019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:06.703250 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:06.703250 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:06.703250 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:03:06.703250 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:03:06.703250 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:03:06.703250 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:03:06.703250 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:03:06.703250 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:03:06.703250 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:03:06.703250 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:03:06.703250 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 621/1253] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:06.708127 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f63bda-9f31-4722-ac4d-af0dd729a5bc None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:06.765225 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:06.806939 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f63bda-9f31-4722-ac4d-af0dd729a5bc None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:06.840536 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c9708-4b62-4049-abc1-5beb0c59210b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:06.841233 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c9708-4b62-4049-abc1-5beb0c59210b None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:06.841516 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c9708-4b62-4049-abc1-5beb0c59210b None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:06.841787 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c9708-4b62-4049-abc1-5beb0c59210b None admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:06.842614 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c9708-4b62-4049-abc1-5beb0c59210b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:06.842937 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c9708-4b62-4049-abc1-5beb0c59210b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:06.844346 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c9708-4b62-4049-abc1-5beb0c59210b None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:06.865328 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 633/1254] 10.222.0.46 () {56 vars in 1143 bytes} [Wed Jun 22 10:03:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:06.871900 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ef088-9e9a-46d1-9a5b-34baf296d298 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:06.969156 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ef088-9e9a-46d1-9a5b-34baf296d298 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:07.001063 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059e1ee-cd56-4bbd-9207-9044a4150aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:07.001708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059e1ee-cd56-4bbd-9207-9044a4150aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:07.001983 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059e1ee-cd56-4bbd-9207-9044a4150aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:07.002255 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059e1ee-cd56-4bbd-9207-9044a4150aa2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:07.057756 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:07.070320 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9059e1ee-cd56-4bbd-9207-9044a4150aa2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:07.071773 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9059e1ee-cd56-4bbd-9207-9044a4150aa2 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:07.169020 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 622/1255] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 10:03:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:03:07.174840 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c9708-4b62-4049-abc1-5beb0c59210b None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:07.272581 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c9708-4b62-4049-abc1-5beb0c59210b None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:07.285211 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:07.306145 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847c0ed-b28b-4157-baa8-d6469aea207e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:07.306959 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847c0ed-b28b-4157-baa8-d6469aea207e None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:07.307237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847c0ed-b28b-4157-baa8-d6469aea207e None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:07.307506 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847c0ed-b28b-4157-baa8-d6469aea207e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:07.318067 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847c0ed-b28b-4157-baa8-d6469aea207e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:07.319439 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847c0ed-b28b-4157-baa8-d6469aea207e None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:07.336892 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-e847c0ed-b28b-4157-baa8-d6469aea207e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:07.336892 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:07.336892 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:07.336892 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:07.336892 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:07.336892 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:07.336892 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:07.336892 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:07.336892 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:07.336892 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:07.336892 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:07.336892 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:07.336892 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:07.336892 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:07.336892 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:07.338124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:07.338124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:07.338124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:07.338124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:07.338124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:07.338124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:07.338124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:07.338124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:07.338124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:07.338124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:07.338124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:07.338124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:07.338124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:07.338124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:07.338124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:07.338124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:07.338124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:07.339253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:07.339253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:07.339253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:07.339253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:03:07.339253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 634/1256] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:07.344040 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059e1ee-cd56-4bbd-9207-9044a4150aa2 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:07.432838 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:07.445215 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059e1ee-cd56-4bbd-9207-9044a4150aa2 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:07.478607 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642af219-2683-47d8-8391-b8dc4455ebff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:07.479261 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642af219-2683-47d8-8391-b8dc4455ebff None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:07.479546 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642af219-2683-47d8-8391-b8dc4455ebff None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:07.479825 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642af219-2683-47d8-8391-b8dc4455ebff None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:07.480619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642af219-2683-47d8-8391-b8dc4455ebff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:07.480958 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642af219-2683-47d8-8391-b8dc4455ebff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:07.482434 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642af219-2683-47d8-8391-b8dc4455ebff None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:07.494327 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 623/1257] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:07.500093 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847c0ed-b28b-4157-baa8-d6469aea207e None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:07.599170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847c0ed-b28b-4157-baa8-d6469aea207e None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:07.632489 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fa9cb-427d-4751-b928-ac26531711eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:07.633313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fa9cb-427d-4751-b928-ac26531711eb None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:07.633592 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fa9cb-427d-4751-b928-ac26531711eb None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:07.633870 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fa9cb-427d-4751-b928-ac26531711eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:07.640395 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fa9cb-427d-4751-b928-ac26531711eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:07.641858 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6fa9cb-427d-4751-b928-ac26531711eb None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:07.655805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-0a6fa9cb-427d-4751-b928-ac26531711eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:07.655805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:07.655805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:07.655805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:07.655805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:07.655805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:07.655805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:07.655805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:07.655805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:07.655805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:07.655805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:07.655805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:07.655805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:03:07.655805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:03:07.655805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:03:07.661504 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:03:07.661504 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:07.661504 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:07.661504 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:07.661504 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:07.661504 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:07.661504 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:07.661504 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:07.661504 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:07.661504 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:07.661504 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:07.661504 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:07.661504 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:07.661504 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:07.661504 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:07.661504 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:07.661504 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:07.662452 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:03:07.662452 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:03:07.662452 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:03:07.662452 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:03:07.662452 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:03:07.662452 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:03:07.662452 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:07.662452 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:03:07.662452 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 635/1258] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:07.663663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642af219-2683-47d8-8391-b8dc4455ebff None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:07.765518 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642af219-2683-47d8-8391-b8dc4455ebff None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:07.798766 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3ed58-e85d-4239-832b-9a555ae2b753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:07.799423 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3ed58-e85d-4239-832b-9a555ae2b753 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:07.799711 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3ed58-e85d-4239-832b-9a555ae2b753 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:07.799986 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3ed58-e85d-4239-832b-9a555ae2b753 None admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:07.800772 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd3ed58-e85d-4239-832b-9a555ae2b753 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:07.801115 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd3ed58-e85d-4239-832b-9a555ae2b753 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:07.803065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd3ed58-e85d-4239-832b-9a555ae2b753 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:07.815220 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 624/1259] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 10:03:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:07.822120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fa9cb-427d-4751-b928-ac26531711eb None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:07.847331 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:07.919603 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6fa9cb-427d-4751-b928-ac26531711eb None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:07.954122 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f0eac-9a2a-4cc6-b420-016a282e641d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:07.954757 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f0eac-9a2a-4cc6-b420-016a282e641d None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:07.955036 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f0eac-9a2a-4cc6-b420-016a282e641d None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:07.955311 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f0eac-9a2a-4cc6-b420-016a282e641d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:07.956131 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f0eac-9a2a-4cc6-b420-016a282e641d None admin] RBAC: Adding query filter params (role.id=106aa464a69a49b09de7de5417083d3c, scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9, user.id=675892a676054b4f86f9ac12d95f4f5c) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:07.956439 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f0eac-9a2a-4cc6-b420-016a282e641d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:07.957912 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f0eac-9a2a-4cc6-b420-016a282e641d None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:07.963193 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 636/1260] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 10:03:07 2022] GET /identity/v3/role_assignments?user.id=675892a676054b4f86f9ac12d95f4f5c&scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9&role.id=106aa464a69a49b09de7de5417083d3c => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:09.968792 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0616321-e965-4470-8619-b0f961f6ed6e None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:09.969335 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0616321-e965-4470-8619-b0f961f6ed6e None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:09.969335 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0616321-e965-4470-8619-b0f961f6ed6e None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:09.970638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 625/1261] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:09.975941 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6481f-b420-454a-a066-ebbcb9993e74 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:09.976478 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6481f-b420-454a-a066-ebbcb9993e74 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:09.976478 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6481f-b420-454a-a066-ebbcb9993e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:09.992786 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-7fd6481f-b420-454a-a066-ebbcb9993e74 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:09.993987 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-7fd6481f-b420-454a-a066-ebbcb9993e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:10.059105 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 637/1262] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:03:10.082609 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0616321-e965-4470-8619-b0f961f6ed6e None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:10.093265 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:10.180922 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0616321-e965-4470-8619-b0f961f6ed6e None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:10.215026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8659d3f-36bd-4450-8fd4-54950bad883b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:10.215812 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8659d3f-36bd-4450-8fd4-54950bad883b None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:10.216089 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8659d3f-36bd-4450-8fd4-54950bad883b None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:10.216360 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8659d3f-36bd-4450-8fd4-54950bad883b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:10.228203 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8659d3f-36bd-4450-8fd4-54950bad883b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:03:10.235770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-c8659d3f-36bd-4450-8fd4-54950bad883b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:03:10.235770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:10.235770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:10.235770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:10.235770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:10.235770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:10.235770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:10.235770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:10.235770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:10.235770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:10.235770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:10.235770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:10.235770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:03:10.235770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:03:10.235770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:03:10.235770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:03:10.236885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:03:10.236885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:03:10.236885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:03:10.236885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:03:10.236885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:10.236885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:10.236885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:10.236885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:10.236885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:10.236885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:10.236885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:10.236885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:10.236885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:10.236885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:10.236885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:10.236885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:10.237781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:10.237781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:10.237781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:10.237781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:10.237781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:03:10.237781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:03:10.237781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:03:10.237781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:03:10.237781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:03:10.237781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:03:10.237781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:03:10.237781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:03:10.237781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 626/1263] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 10:03:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:10.243902 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6481f-b420-454a-a066-ebbcb9993e74 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:10.262739 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:10.340744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd6481f-b420-454a-a066-ebbcb9993e74 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:10.375894 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f805c-e10b-45df-af4f-546f243f65d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:10.376556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f805c-e10b-45df-af4f-546f243f65d3 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:10.376859 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f805c-e10b-45df-af4f-546f243f65d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:10.377139 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f805c-e10b-45df-af4f-546f243f65d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:10.377891 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f805c-e10b-45df-af4f-546f243f65d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:10.378199 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f805c-e10b-45df-af4f-546f243f65d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:10.379557 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f805c-e10b-45df-af4f-546f243f65d3 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:10.388352 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 638/1264] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 10:03:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:10.394287 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8659d3f-36bd-4450-8fd4-54950bad883b None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:10.459776 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:10.493562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8659d3f-36bd-4450-8fd4-54950bad883b None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:10.526657 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7632803-39aa-433d-b8bd-016e5157b45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:10.527444 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7632803-39aa-433d-b8bd-016e5157b45c None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:10.527727 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7632803-39aa-433d-b8bd-016e5157b45c None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:10.528004 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7632803-39aa-433d-b8bd-016e5157b45c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:10.539151 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7632803-39aa-433d-b8bd-016e5157b45c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:10.540604 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7632803-39aa-433d-b8bd-016e5157b45c None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:10.557788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-c7632803-39aa-433d-b8bd-016e5157b45c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:10.557788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:10.557788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:10.557788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:10.557788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:10.557788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:10.557788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:10.557788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:10.557788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:10.557788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:10.557788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:10.557788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:10.557788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:10.557788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:10.557788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:10.558902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:10.558902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:10.558902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:10.558902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:10.558902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:10.558902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:10.558902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:10.558902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:10.558902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:10.558902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:10.558902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:10.558902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:10.558902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:10.558902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:10.558902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:10.558902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:10.558902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:10.560006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:10.560006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:10.560006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:10.560006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:03:10.560006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 627/1265] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:10.565142 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f805c-e10b-45df-af4f-546f243f65d3 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:10.651571 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:10.670598 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f805c-e10b-45df-af4f-546f243f65d3 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:10.705901 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a687ab-2dd9-4ac8-9d0f-bc659950c4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:10.706560 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a687ab-2dd9-4ac8-9d0f-bc659950c4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:10.706846 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a687ab-2dd9-4ac8-9d0f-bc659950c4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:10.707127 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a687ab-2dd9-4ac8-9d0f-bc659950c4d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:10.707849 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a687ab-2dd9-4ac8-9d0f-bc659950c4d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:10.708161 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a687ab-2dd9-4ac8-9d0f-bc659950c4d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:10.709658 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a687ab-2dd9-4ac8-9d0f-bc659950c4d6 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:10.721377 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 639/1266] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:10.727891 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7632803-39aa-433d-b8bd-016e5157b45c None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:10.827685 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7632803-39aa-433d-b8bd-016e5157b45c None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:10.848207 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:10.862729 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec2223-9e88-4051-a3e3-00f2dbce835a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:10.863530 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec2223-9e88-4051-a3e3-00f2dbce835a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:10.863811 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec2223-9e88-4051-a3e3-00f2dbce835a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:10.864083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec2223-9e88-4051-a3e3-00f2dbce835a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:10.871786 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec2223-9e88-4051-a3e3-00f2dbce835a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:10.873363 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec2223-9e88-4051-a3e3-00f2dbce835a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:10.889511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-6bec2223-9e88-4051-a3e3-00f2dbce835a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:03:10.889511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:10.889511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:10.889511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:10.889511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:10.889511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:10.889511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:10.889511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:10.889511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:10.889511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:10.889511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:10.889511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:10.889511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:03:10.889511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:03:10.889511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:03:10.889511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:03:10.890579 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:10.890579 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:10.890579 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:10.890579 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:10.890579 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:10.890579 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:10.890579 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:10.890579 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:10.890579 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:10.890579 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:10.890579 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:10.890579 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:10.890579 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:10.890579 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:10.890579 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:10.890579 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:10.890579 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:10.890579 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:10.891594 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:10.891594 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:10.891594 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:03:10.891594 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:03:10.891594 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:03:10.891594 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:03:10.891594 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:03:10.891594 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:03:10.891594 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:03:10.891594 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:03:10.891594 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 628/1267] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:10.897191 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a687ab-2dd9-4ac8-9d0f-bc659950c4d6 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:10.995470 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a687ab-2dd9-4ac8-9d0f-bc659950c4d6 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:11.028555 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db24ee5-d510-4e48-9caa-e6d6580adabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:11.029263 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db24ee5-d510-4e48-9caa-e6d6580adabb None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:11.029544 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db24ee5-d510-4e48-9caa-e6d6580adabb None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:11.029817 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db24ee5-d510-4e48-9caa-e6d6580adabb None admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:11.030653 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db24ee5-d510-4e48-9caa-e6d6580adabb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:11.030959 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db24ee5-d510-4e48-9caa-e6d6580adabb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:11.032367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db24ee5-d510-4e48-9caa-e6d6580adabb None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:11.043078 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:11.052178 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 640/1268] 10.222.0.46 () {56 vars in 1143 bytes} [Wed Jun 22 10:03:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:11.058556 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec2223-9e88-4051-a3e3-00f2dbce835a None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:11.158083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec2223-9e88-4051-a3e3-00f2dbce835a None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:11.192251 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0ec77-52a7-4695-b4d9-a508d94b6789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:11.193078 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0ec77-52a7-4695-b4d9-a508d94b6789 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:11.193359 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0ec77-52a7-4695-b4d9-a508d94b6789 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:11.193632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0ec77-52a7-4695-b4d9-a508d94b6789 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:11.203871 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0ec77-52a7-4695-b4d9-a508d94b6789 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:11.205346 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0ec77-52a7-4695-b4d9-a508d94b6789 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:11.222990 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-83f0ec77-52a7-4695-b4d9-a508d94b6789 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:11.222990 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:11.222990 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:11.222990 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:11.222990 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:11.222990 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:11.222990 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:11.222990 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:11.222990 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:11.222990 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:11.222990 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:11.222990 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:11.222990 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:11.222990 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:11.222990 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:11.224800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:11.224800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:11.224800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:11.224800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:11.224800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:11.224800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:11.224800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:11.224800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:11.224800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:11.224800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:11.224800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:11.224800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:11.224800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:11.224800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:11.224800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:11.224800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:11.224800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:11.225754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:11.225754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:11.225754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:11.225754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:03:11.225754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 629/1269] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:11.230965 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db24ee5-d510-4e48-9caa-e6d6580adabb None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:11.329627 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db24ee5-d510-4e48-9caa-e6d6580adabb None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:11.365148 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c215569-d488-4412-a685-476a761a69ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:11.365853 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c215569-d488-4412-a685-476a761a69ec None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:11.366124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c215569-d488-4412-a685-476a761a69ec None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:11.366402 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c215569-d488-4412-a685-476a761a69ec None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:11.367652 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c215569-d488-4412-a685-476a761a69ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:11.367652 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c215569-d488-4412-a685-476a761a69ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:11.368878 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c215569-d488-4412-a685-476a761a69ec None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:11.390018 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 641/1270] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:11.396294 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0ec77-52a7-4695-b4d9-a508d94b6789 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:11.427724 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:11.493811 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0ec77-52a7-4695-b4d9-a508d94b6789 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:11.527696 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74f5c1-d2fd-4e25-ada7-e74afc1a5eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:11.528484 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74f5c1-d2fd-4e25-ada7-e74afc1a5eaa None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:11.528766 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74f5c1-d2fd-4e25-ada7-e74afc1a5eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:11.529072 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74f5c1-d2fd-4e25-ada7-e74afc1a5eaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:11.535775 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74f5c1-d2fd-4e25-ada7-e74afc1a5eaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:11.537838 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74f5c1-d2fd-4e25-ada7-e74afc1a5eaa None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:11.551355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-2d74f5c1-d2fd-4e25-ada7-e74afc1a5eaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:11.551355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:11.551355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:11.551355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:11.551355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:11.551355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:11.551355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:11.551355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:11.551355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:11.551355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:11.551355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:11.551355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:11.551355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:03:11.551355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:03:11.551355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:03:11.552394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:03:11.552394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:11.552394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:11.552394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:11.552394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:11.552394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:11.552394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:11.552394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:11.552394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:11.552394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:11.552394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:11.552394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:11.552394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:11.552394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:11.552394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:11.552394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:11.552394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:11.553656 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:03:11.553656 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:03:11.553656 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:03:11.553656 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:03:11.553656 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:03:11.553656 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:03:11.553656 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:11.553656 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:03:11.553656 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 630/1271] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:11.558473 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c215569-d488-4412-a685-476a761a69ec None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:11.615786 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:11.656590 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c215569-d488-4412-a685-476a761a69ec None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:11.692056 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4f02b-101a-415d-a04d-fdecc2688558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:11.693407 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4f02b-101a-415d-a04d-fdecc2688558 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:11.693539 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4f02b-101a-415d-a04d-fdecc2688558 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:11.693759 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4f02b-101a-415d-a04d-fdecc2688558 None admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:11.694557 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4f02b-101a-415d-a04d-fdecc2688558 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:11.694870 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4f02b-101a-415d-a04d-fdecc2688558 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:11.696404 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4f02b-101a-415d-a04d-fdecc2688558 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:11.709429 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 642/1272] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 10:03:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:11.715812 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74f5c1-d2fd-4e25-ada7-e74afc1a5eaa None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:11.807423 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:11.816111 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74f5c1-d2fd-4e25-ada7-e74afc1a5eaa None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:11.849304 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1695651-ef47-4625-9e14-35f7c277f7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:11.850200 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1695651-ef47-4625-9e14-35f7c277f7bb None admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:11.850481 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1695651-ef47-4625-9e14-35f7c277f7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:11.850754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1695651-ef47-4625-9e14-35f7c277f7bb None admin] PATH_INFO: `/v3/projects/a2bb614e4d7747c1a3fff154c8bc18d9/users/675892a676054b4f86f9ac12d95f4f5c/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:11.852763 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1695651-ef47-4625-9e14-35f7c277f7bb None admin] RBAC: Authorizing `identity:create_grant(project_id=a2bb614e4d7747c1a3fff154c8bc18d9, user_id=675892a676054b4f86f9ac12d95f4f5c, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:11.854307 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1695651-ef47-4625-9e14-35f7c277f7bb None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:11.923891 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 631/1273] 10.222.0.46 () {58 vars in 1439 bytes} [Wed Jun 22 10:03:11 2022] PUT /identity/v3/projects/a2bb614e4d7747c1a3fff154c8bc18d9/users/675892a676054b4f86f9ac12d95f4f5c/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:03:13.941238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a27230-72ce-44b3-bff1-39830ab6d63f None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:13.941745 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a27230-72ce-44b3-bff1-39830ab6d63f None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:13.941745 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a27230-72ce-44b3-bff1-39830ab6d63f None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:13.943084 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 643/1274] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:03:13.948839 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d88f2-d833-4be8-ab26-76c017ae5763 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:13.952743 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d88f2-d833-4be8-ab26-76c017ae5763 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:13.952743 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d88f2-d833-4be8-ab26-76c017ae5763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:13.966908 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-af0d88f2-d833-4be8-ab26-76c017ae5763 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:13.968115 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-af0d88f2-d833-4be8-ab26-76c017ae5763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:14.039196 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 632/1275] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:03:14.064119 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a27230-72ce-44b3-bff1-39830ab6d63f None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:14.174904 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a27230-72ce-44b3-bff1-39830ab6d63f None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:14.195258 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:14.212195 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3178d2c-440f-4974-bc4a-6b2364b86cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:14.213013 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3178d2c-440f-4974-bc4a-6b2364b86cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:14.213295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3178d2c-440f-4974-bc4a-6b2364b86cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:14.213568 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3178d2c-440f-4974-bc4a-6b2364b86cc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:14.224511 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3178d2c-440f-4974-bc4a-6b2364b86cc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:03:14.232332 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-f3178d2c-440f-4974-bc4a-6b2364b86cc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:03:14.232332 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:14.232332 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:14.232332 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:14.232332 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:14.232332 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:14.232332 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:14.232332 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:14.232332 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:14.232332 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:14.232332 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:14.232332 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:14.232332 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:03:14.232332 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:03:14.232332 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:03:14.232332 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:03:14.233705 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:03:14.233705 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:03:14.233705 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:03:14.233705 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:03:14.233705 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:14.233705 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:14.233705 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:14.233705 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:14.233705 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:14.233705 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:14.233705 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:14.233705 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:14.233705 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:14.233705 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:14.233705 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:14.233705 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:14.234780 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:14.234780 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:14.234780 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:14.234780 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:14.234780 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:03:14.234780 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:03:14.234780 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:03:14.234780 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:03:14.234780 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:03:14.234780 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:03:14.234780 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:03:14.234780 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:03:14.234780 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 644/1276] 10.222.0.46 () {56 vars in 1096 bytes} [Wed Jun 22 10:03:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:14.240269 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d88f2-d833-4be8-ab26-76c017ae5763 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:14.325660 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:14.343125 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d88f2-d833-4be8-ab26-76c017ae5763 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:14.376127 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55956627-14a9-453a-b8c1-995ccc59b02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:14.376793 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55956627-14a9-453a-b8c1-995ccc59b02a None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:14.377158 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55956627-14a9-453a-b8c1-995ccc59b02a None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:14.377432 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55956627-14a9-453a-b8c1-995ccc59b02a None admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:14.378181 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55956627-14a9-453a-b8c1-995ccc59b02a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:14.378480 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55956627-14a9-453a-b8c1-995ccc59b02a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:14.379908 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55956627-14a9-453a-b8c1-995ccc59b02a None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:14.389413 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 633/1277] 10.222.0.46 () {56 vars in 1099 bytes} [Wed Jun 22 10:03:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:14.395300 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3178d2c-440f-4974-bc4a-6b2364b86cc1 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:14.498855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3178d2c-440f-4974-bc4a-6b2364b86cc1 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:14.531574 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d0795-b70e-4d8b-9f9c-8928c1836f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:14.532364 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d0795-b70e-4d8b-9f9c-8928c1836f52 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:14.532651 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d0795-b70e-4d8b-9f9c-8928c1836f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:14.532962 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d0795-b70e-4d8b-9f9c-8928c1836f52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:14.544066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d0795-b70e-4d8b-9f9c-8928c1836f52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:14.545537 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d0795-b70e-4d8b-9f9c-8928c1836f52 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:14.562894 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-443d0795-b70e-4d8b-9f9c-8928c1836f52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:14.562894 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:14.562894 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:14.562894 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:14.562894 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:14.562894 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:14.562894 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:14.562894 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:14.562894 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:14.562894 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:14.562894 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:14.562894 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:14.562894 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:14.562894 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:14.562894 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:14.564120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:14.564120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:14.564120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:14.564120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:14.564120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:14.564120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:14.564120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:14.564120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:14.564120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:14.564120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:14.564120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:14.564120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:14.564120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:14.564120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:14.564120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:14.564120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:14.564120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:14.565124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:14.565124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:14.565124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:14.565124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:03:14.565124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 645/1278] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:03:14.570275 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55956627-14a9-453a-b8c1-995ccc59b02a None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:14.670830 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55956627-14a9-453a-b8c1-995ccc59b02a None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:14.703574 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff026b2b-984c-4701-844c-d189c61d6816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:14.704234 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff026b2b-984c-4701-844c-d189c61d6816 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:14.704513 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff026b2b-984c-4701-844c-d189c61d6816 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:14.704783 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff026b2b-984c-4701-844c-d189c61d6816 None admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:14.705536 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff026b2b-984c-4701-844c-d189c61d6816 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:14.710059 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff026b2b-984c-4701-844c-d189c61d6816 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:14.710059 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff026b2b-984c-4701-844c-d189c61d6816 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:14.720087 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 634/1279] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:14.726666 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d0795-b70e-4d8b-9f9c-8928c1836f52 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:14.757844 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:14.824502 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d0795-b70e-4d8b-9f9c-8928c1836f52 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:14.858831 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27966cc9-fcd6-4f7b-84e9-c1f2bb21cc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:14.859757 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27966cc9-fcd6-4f7b-84e9-c1f2bb21cc25 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:14.860039 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27966cc9-fcd6-4f7b-84e9-c1f2bb21cc25 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:14.860317 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27966cc9-fcd6-4f7b-84e9-c1f2bb21cc25 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:14.867746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27966cc9-fcd6-4f7b-84e9-c1f2bb21cc25 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:14.869346 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27966cc9-fcd6-4f7b-84e9-c1f2bb21cc25 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:14.884762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-27966cc9-fcd6-4f7b-84e9-c1f2bb21cc25 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:03:14.884762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:14.884762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:14.884762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:14.884762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:14.884762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:14.884762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:14.884762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:14.884762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:14.884762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:14.884762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:14.884762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:14.884762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:03:14.884762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:03:14.884762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:03:14.884762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:03:14.886601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:14.886601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:14.886601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:14.886601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:14.886601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:14.886601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:14.886601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:14.886601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:14.886601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:14.886601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:14.886601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:14.886601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:14.886601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:14.886601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:14.886601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:14.886601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:14.886601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:14.886601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:14.887840 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:14.887840 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:14.887840 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:03:14.887840 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:03:14.887840 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:03:14.887840 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:03:14.887840 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:03:14.887840 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:03:14.887840 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:03:14.887840 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:03:14.887840 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 646/1280] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:14.891995 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff026b2b-984c-4701-844c-d189c61d6816 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:14.897041 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:14.993172 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff026b2b-984c-4701-844c-d189c61d6816 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:15.026345 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734ef75-f1b0-438b-a1a9-2a7ef7f424fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:15.026930 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734ef75-f1b0-438b-a1a9-2a7ef7f424fb None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:15.027210 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734ef75-f1b0-438b-a1a9-2a7ef7f424fb None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:15.027482 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734ef75-f1b0-438b-a1a9-2a7ef7f424fb None admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:15.028314 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734ef75-f1b0-438b-a1a9-2a7ef7f424fb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:15.028621 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734ef75-f1b0-438b-a1a9-2a7ef7f424fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:15.030106 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734ef75-f1b0-438b-a1a9-2a7ef7f424fb None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:15.047422 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 635/1281] 10.222.0.46 () {56 vars in 1143 bytes} [Wed Jun 22 10:03:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:15.053829 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27966cc9-fcd6-4f7b-84e9-c1f2bb21cc25 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:15.141989 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:15.151263 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27966cc9-fcd6-4f7b-84e9-c1f2bb21cc25 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:15.191967 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada9b5f-0b45-4421-ae74-b55463f60857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:15.193118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada9b5f-0b45-4421-ae74-b55463f60857 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:15.193627 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada9b5f-0b45-4421-ae74-b55463f60857 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:15.194141 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada9b5f-0b45-4421-ae74-b55463f60857 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:15.263253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada9b5f-0b45-4421-ae74-b55463f60857 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:15.264685 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada9b5f-0b45-4421-ae74-b55463f60857 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:15.351950 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:15.361746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 647/1282] 10.222.0.46 () {58 vars in 1282 bytes} [Wed Jun 22 10:03:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:03:15.368437 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734ef75-f1b0-438b-a1a9-2a7ef7f424fb None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:15.433222 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:15.470369 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734ef75-f1b0-438b-a1a9-2a7ef7f424fb None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:15.502429 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa7b6b-94dd-4c5f-bdfd-73b7847ae779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:15.503262 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa7b6b-94dd-4c5f-bdfd-73b7847ae779 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:15.503548 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa7b6b-94dd-4c5f-bdfd-73b7847ae779 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:15.503816 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa7b6b-94dd-4c5f-bdfd-73b7847ae779 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:15.515044 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa7b6b-94dd-4c5f-bdfd-73b7847ae779 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:15.516502 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa7b6b-94dd-4c5f-bdfd-73b7847ae779 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:15.533680 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-28fa7b6b-94dd-4c5f-bdfd-73b7847ae779 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:15.533680 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:15.533680 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:15.533680 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:15.533680 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:15.533680 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:15.533680 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:15.533680 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:15.533680 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:15.533680 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:15.533680 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:15.533680 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:15.533680 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:15.533680 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:15.533680 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:15.534992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:15.534992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:15.534992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:15.534992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:15.534992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:15.534992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:15.534992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:15.534992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:15.534992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:15.534992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:15.534992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:15.534992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:15.534992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:15.534992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:15.534992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:15.534992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:15.534992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:15.536277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:15.536277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:15.536277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:15.536277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:03:15.536277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 636/1283] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:15.541594 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada9b5f-0b45-4421-ae74-b55463f60857 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:15.649409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada9b5f-0b45-4421-ae74-b55463f60857 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:15.687478 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d5b47-a06a-4125-ad30-74685cab6964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:15.688407 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d5b47-a06a-4125-ad30-74685cab6964 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:15.688688 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d5b47-a06a-4125-ad30-74685cab6964 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:15.689000 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d5b47-a06a-4125-ad30-74685cab6964 None admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:15.689724 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d5b47-a06a-4125-ad30-74685cab6964 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:15.690031 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d5b47-a06a-4125-ad30-74685cab6964 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:15.691383 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d5b47-a06a-4125-ad30-74685cab6964 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:15.703911 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 648/1284] 10.222.0.46 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:15.710110 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa7b6b-94dd-4c5f-bdfd-73b7847ae779 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:15.807842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa7b6b-94dd-4c5f-bdfd-73b7847ae779 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:15.822063 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:15.841860 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f0eae-24c9-4073-8686-3dd59856c011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:15.842645 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f0eae-24c9-4073-8686-3dd59856c011 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:15.842920 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f0eae-24c9-4073-8686-3dd59856c011 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:15.843191 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f0eae-24c9-4073-8686-3dd59856c011 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:15.849586 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f0eae-24c9-4073-8686-3dd59856c011 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:15.851097 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f0eae-24c9-4073-8686-3dd59856c011 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:15.865915 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application [None req-f58f0eae-24c9-4073-8686-3dd59856c011 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:15.865915 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:15.865915 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:15.865915 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:15.865915 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:15.865915 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:15.865915 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:15.865915 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:15.865915 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:15.865915 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:15.865915 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:15.865915 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:15.865915 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:03:15.865915 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:03:15.865915 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:03:15.867047 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:03:15.867047 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:15.867047 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:15.867047 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:15.867047 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:15.867047 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:15.867047 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:15.867047 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:15.867047 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:15.867047 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:15.867047 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:15.867047 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:15.867047 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:15.867047 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:15.867047 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:15.867047 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:15.867047 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:15.868163 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:03:15.868163 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:03:15.868163 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:03:15.868163 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:03:15.868163 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:03:15.868163 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:03:15.868163 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:15.868163 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: ERROR keystone.server.flask.application Jun 22 10:03:15.868163 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 637/1285] 10.222.0.46 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:15.873060 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d5b47-a06a-4125-ad30-74685cab6964 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:15.925161 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:15.973064 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d5b47-a06a-4125-ad30-74685cab6964 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:16.004530 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee103863-b252-4554-813f-c84d89d31ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:16.005735 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee103863-b252-4554-813f-c84d89d31ebe None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:16.006044 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee103863-b252-4554-813f-c84d89d31ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:16.006318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee103863-b252-4554-813f-c84d89d31ebe None admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:16.007097 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee103863-b252-4554-813f-c84d89d31ebe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:16.007400 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee103863-b252-4554-813f-c84d89d31ebe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:16.008970 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee103863-b252-4554-813f-c84d89d31ebe None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:16.020514 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 649/1286] 10.222.0.46 () {56 vars in 1148 bytes} [Wed Jun 22 10:03:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:16.027237 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f0eae-24c9-4073-8686-3dd59856c011 None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:16.124474 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f0eae-24c9-4073-8686-3dd59856c011 None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:16.158540 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b8c86-ff43-49fc-9afa-b63f58775cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:16.159190 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b8c86-ff43-49fc-9afa-b63f58775cbd None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:16.159473 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b8c86-ff43-49fc-9afa-b63f58775cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:16.159748 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b8c86-ff43-49fc-9afa-b63f58775cbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:16.160629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b8c86-ff43-49fc-9afa-b63f58775cbd None admin] RBAC: Adding query filter params (role.id=106aa464a69a49b09de7de5417083d3c, scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9, user.id=675892a676054b4f86f9ac12d95f4f5c) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:16.160969 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b8c86-ff43-49fc-9afa-b63f58775cbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:16.162400 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b8c86-ff43-49fc-9afa-b63f58775cbd None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:16.168151 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 638/1287] 10.222.0.46 () {56 vars in 1374 bytes} [Wed Jun 22 10:03:16 2022] GET /identity/v3/role_assignments?user.id=675892a676054b4f86f9ac12d95f4f5c&scope.project.id=a2bb614e4d7747c1a3fff154c8bc18d9&role.id=106aa464a69a49b09de7de5417083d3c => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:18.340221 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deefbfb-7291-4564-a55f-91565fe5b7d6 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:18.340904 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deefbfb-7291-4564-a55f-91565fe5b7d6 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:18.340904 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deefbfb-7291-4564-a55f-91565fe5b7d6 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:18.342173 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 650/1288] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:18.347347 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0906ff1-3c5b-4e4f-84e4-e7e15e901971 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:18.347753 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0906ff1-3c5b-4e4f-84e4-e7e15e901971 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:18.347906 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0906ff1-3c5b-4e4f-84e4-e7e15e901971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:18.365934 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-d0906ff1-3c5b-4e4f-84e4-e7e15e901971 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:18.367161 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-d0906ff1-3c5b-4e4f-84e4-e7e15e901971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:18.399928 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:18.440497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 639/1289] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:03:18.464379 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deefbfb-7291-4564-a55f-91565fe5b7d6 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:18.579420 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deefbfb-7291-4564-a55f-91565fe5b7d6 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:18.598089 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:18.617991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a491d-51a4-4e44-a44d-1a6ee920a505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:18.618756 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a491d-51a4-4e44-a44d-1a6ee920a505 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:18.619041 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a491d-51a4-4e44-a44d-1a6ee920a505 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:18.619315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a491d-51a4-4e44-a44d-1a6ee920a505 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:18.619986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a491d-51a4-4e44-a44d-1a6ee920a505 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:18.621430 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a491d-51a4-4e44-a44d-1a6ee920a505 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:18.636100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-857a491d-51a4-4e44-a44d-1a6ee920a505 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 10:03:18.636100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:18.636100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:03:18.636100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:03:18.636100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:03:18.636100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:03:18.636100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:03:18.636100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:18.636100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 10:03:18.636100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:03:18.636100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:03:18.636100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:03:18.636100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:18.636100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:18.636100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:18.636100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:18.636100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:18.637503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:18.637503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:18.637503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:18.637503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:18.637503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:18.637503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:18.637503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:03:18.637503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:03:18.637503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:03:18.637503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:03:18.637503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:18.637503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:18.637503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:18.637503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:18.637503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:18.637503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:18.638445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:18.638445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:18.638445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:18.638445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:18.638445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:18.638445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:18.638445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:18.638445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:18.638445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:18.638445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:18.638445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:03:18.638445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:18.638445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 10:03:18.638445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:03:18.638445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 651/1290] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Jun 22 10:03:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:18.644486 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0906ff1-3c5b-4e4f-84e4-e7e15e901971 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:18.750366 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0906ff1-3c5b-4e4f-84e4-e7e15e901971 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:18.787569 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6967539-2aff-4bc9-9a89-5524fad774fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:18.788241 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6967539-2aff-4bc9-9a89-5524fad774fd None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:18.788527 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6967539-2aff-4bc9-9a89-5524fad774fd None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:18.788808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6967539-2aff-4bc9-9a89-5524fad774fd None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:18.789620 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6967539-2aff-4bc9-9a89-5524fad774fd None admin] RBAC: Adding query filter params (name=placement) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:18.789933 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6967539-2aff-4bc9-9a89-5524fad774fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:18.791306 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6967539-2aff-4bc9-9a89-5524fad774fd None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:18.796887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 640/1291] 10.222.0.46 () {56 vars in 1116 bytes} [Wed Jun 22 10:03:18 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:18.803158 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a491d-51a4-4e44-a44d-1a6ee920a505 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:18.906980 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a491d-51a4-4e44-a44d-1a6ee920a505 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:18.941673 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0fdba-2a7f-48ae-86e4-504d655ef02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:18.942327 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0fdba-2a7f-48ae-86e4-504d655ef02f None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:18.942656 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0fdba-2a7f-48ae-86e4-504d655ef02f None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:18.942961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0fdba-2a7f-48ae-86e4-504d655ef02f None admin] PATH_INFO: `/v3/services` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:18.943664 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0fdba-2a7f-48ae-86e4-504d655ef02f None admin] RBAC: Adding query filter params (type=placement) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:18.944000 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0fdba-2a7f-48ae-86e4-504d655ef02f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:18.945437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0fdba-2a7f-48ae-86e4-504d655ef02f None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:18.950533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 652/1292] 10.222.0.46 () {56 vars in 1116 bytes} [Wed Jun 22 10:03:18 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:20.980801 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d0856-b67c-43ee-9d3f-4dbe82414288 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:20.981349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d0856-b67c-43ee-9d3f-4dbe82414288 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:20.981349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d0856-b67c-43ee-9d3f-4dbe82414288 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:20.982688 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 641/1293] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:20.987997 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc96af-e5de-455e-8900-8cb6f581233d None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:20.988420 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc96af-e5de-455e-8900-8cb6f581233d None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:20.988546 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc96af-e5de-455e-8900-8cb6f581233d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:21.006393 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-4bbc96af-e5de-455e-8900-8cb6f581233d None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:21.007592 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-4bbc96af-e5de-455e-8900-8cb6f581233d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:21.036122 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:21.074204 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 653/1294] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:03:21.097120 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d0856-b67c-43ee-9d3f-4dbe82414288 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:21.129274 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:21.203090 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d0856-b67c-43ee-9d3f-4dbe82414288 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:21.237798 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7556ab-58ce-429c-b446-2d01afa30f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:21.238390 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7556ab-58ce-429c-b446-2d01afa30f9d None admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:21.238676 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7556ab-58ce-429c-b446-2d01afa30f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:21.238956 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7556ab-58ce-429c-b446-2d01afa30f9d None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:21.239731 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7556ab-58ce-429c-b446-2d01afa30f9d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:21.242068 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7556ab-58ce-429c-b446-2d01afa30f9d None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:21.339847 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 642/1295] 10.222.0.46 () {60 vars in 1141 bytes} [Wed Jun 22 10:03:21 2022] POST /identity/v3/services => generated 246 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:03:23.405642 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12973264-ddb3-4c97-8b08-6489ac6e1c81 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:23.406173 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12973264-ddb3-4c97-8b08-6489ac6e1c81 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:23.406173 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12973264-ddb3-4c97-8b08-6489ac6e1c81 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:23.407665 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 654/1296] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:23.412970 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fef47-1e25-4593-9839-25502e4a4e32 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:23.413419 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fef47-1e25-4593-9839-25502e4a4e32 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:23.413536 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fef47-1e25-4593-9839-25502e4a4e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:23.430961 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-5e5fef47-1e25-4593-9839-25502e4a4e32 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:23.432165 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-5e5fef47-1e25-4593-9839-25502e4a4e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:23.509748 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 643/1297] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:23 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:03:23.533105 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12973264-ddb3-4c97-8b08-6489ac6e1c81 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:23.633164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12973264-ddb3-4c97-8b08-6489ac6e1c81 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:23.667005 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86200458-03a1-475d-a5e6-9c903ecf9f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:23.667810 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86200458-03a1-475d-a5e6-9c903ecf9f53 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:23.668092 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86200458-03a1-475d-a5e6-9c903ecf9f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:23.668364 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86200458-03a1-475d-a5e6-9c903ecf9f53 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:23.669049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86200458-03a1-475d-a5e6-9c903ecf9f53 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:23.670437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86200458-03a1-475d-a5e6-9c903ecf9f53 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:23.683523 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-86200458-03a1-475d-a5e6-9c903ecf9f53 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 10:03:23.683523 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:23.683523 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:03:23.683523 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:03:23.683523 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:03:23.683523 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:03:23.683523 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:03:23.683523 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:23.683523 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 10:03:23.683523 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:03:23.683523 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:03:23.683523 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:03:23.683523 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:23.683523 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:23.683523 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:23.683523 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:23.683523 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:23.684746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:23.684746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:23.684746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:23.684746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:23.684746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:23.684746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:23.684746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:03:23.684746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:03:23.684746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:03:23.684746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:03:23.684746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:23.684746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:23.684746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:23.684746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:23.684746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:23.684746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:23.685758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:23.685758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:23.685758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:23.685758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:23.685758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:23.685758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:23.685758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:23.685758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:23.685758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:23.685758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:23.685758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:03:23.685758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:23.685758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 10:03:23.685758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:03:23.685758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 655/1298] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Jun 22 10:03:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:23.691273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5fef47-1e25-4593-9839-25502e4a4e32 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:23.710058 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:23.788466 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5fef47-1e25-4593-9839-25502e4a4e32 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:23.827490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab834ed-e1c1-4228-ace4-70bd4d31d6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:23.828173 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab834ed-e1c1-4228-ace4-70bd4d31d6bf None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:23.828459 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab834ed-e1c1-4228-ace4-70bd4d31d6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:23.828738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab834ed-e1c1-4228-ace4-70bd4d31d6bf None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:23.829536 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab834ed-e1c1-4228-ace4-70bd4d31d6bf None admin] RBAC: Adding query filter params (name=placement) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:23.829815 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab834ed-e1c1-4228-ace4-70bd4d31d6bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:23.831227 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab834ed-e1c1-4228-ace4-70bd4d31d6bf None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:23.843023 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 644/1299] 10.222.0.46 () {56 vars in 1116 bytes} [Wed Jun 22 10:03:23 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:23.848111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86200458-03a1-475d-a5e6-9c903ecf9f53 None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:23.880082 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:23.948421 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86200458-03a1-475d-a5e6-9c903ecf9f53 None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:23.981744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87071fc-c3cc-4a9f-a8f1-eded1c39ef30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:23.982403 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87071fc-c3cc-4a9f-a8f1-eded1c39ef30 None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:23.982746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87071fc-c3cc-4a9f-a8f1-eded1c39ef30 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:23.983013 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87071fc-c3cc-4a9f-a8f1-eded1c39ef30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:23.983849 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87071fc-c3cc-4a9f-a8f1-eded1c39ef30 None admin] RBAC: Adding query filter params (interface=public, service_id=23bff8c01655404183ced795ab629e34, region_id=RegionOne) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:23.984164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87071fc-c3cc-4a9f-a8f1-eded1c39ef30 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:23.985588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87071fc-c3cc-4a9f-a8f1-eded1c39ef30 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:23.991539 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 656/1300] 10.222.0.46 () {56 vars in 1251 bytes} [Wed Jun 22 10:03:23 2022] GET /identity/v3/endpoints?service_id=23bff8c01655404183ced795ab629e34&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:23.997123 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab834ed-e1c1-4228-ace4-70bd4d31d6bf None admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:24.078083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:24.095625 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab834ed-e1c1-4228-ace4-70bd4d31d6bf None admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:24.129747 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85255f07-fc6c-4be7-8995-60a197ec74f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:24.130405 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85255f07-fc6c-4be7-8995-60a197ec74f3 None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:24.130712 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85255f07-fc6c-4be7-8995-60a197ec74f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:24.130988 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85255f07-fc6c-4be7-8995-60a197ec74f3 None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:24.131695 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85255f07-fc6c-4be7-8995-60a197ec74f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:24.133089 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85255f07-fc6c-4be7-8995-60a197ec74f3 None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:24.139890 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 645/1301] 10.222.0.46 () {56 vars in 1087 bytes} [Wed Jun 22 10:03:23 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:03:26.189594 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa0618-38fc-4252-a57d-b8021af0db7c None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:26.190124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa0618-38fc-4252-a57d-b8021af0db7c None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:26.190244 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa0618-38fc-4252-a57d-b8021af0db7c None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:26.191610 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 657/1302] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:26.199919 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bff43e-c8d4-41b6-9fd8-1cee93724b22 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:26.199919 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bff43e-c8d4-41b6-9fd8-1cee93724b22 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:26.199919 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bff43e-c8d4-41b6-9fd8-1cee93724b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:26.215569 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-73bff43e-c8d4-41b6-9fd8-1cee93724b22 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:26.216780 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-73bff43e-c8d4-41b6-9fd8-1cee93724b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:26.288300 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 646/1303] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:26 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:03:26.311855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa0618-38fc-4252-a57d-b8021af0db7c None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:26.407938 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:26.414883 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa0618-38fc-4252-a57d-b8021af0db7c None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:26.447704 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf9eb4-5831-4101-becb-d1c0b618c37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:26.448426 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf9eb4-5831-4101-becb-d1c0b618c37b None admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:26.448714 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf9eb4-5831-4101-becb-d1c0b618c37b None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:26.449033 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf9eb4-5831-4101-becb-d1c0b618c37b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:26.449687 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf9eb4-5831-4101-becb-d1c0b618c37b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:26.451052 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf9eb4-5831-4101-becb-d1c0b618c37b None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:26.463390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application [None req-e2cf9eb4-5831-4101-becb-d1c0b618c37b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 10:03:26.463390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:26.463390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:03:26.463390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:03:26.463390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:03:26.463390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:03:26.463390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:03:26.463390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:26.463390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 10:03:26.463390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:03:26.463390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:03:26.463390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:03:26.463390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:26.463390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:26.463390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:26.463390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:26.463390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:26.464421 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:26.464421 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:26.464421 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:26.464421 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:26.464421 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:26.464421 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:26.464421 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:03:26.464421 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:03:26.464421 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:03:26.464421 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:03:26.464421 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:26.464421 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:26.464421 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:26.464421 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:26.464421 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:26.464421 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:26.465372 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:26.465372 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:26.465372 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:26.465372 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:26.465372 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:26.465372 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:26.465372 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:26.465372 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:26.465372 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:26.465372 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:26.465372 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:03:26.465372 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:26.465372 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 10:03:26.465372 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: ERROR keystone.server.flask.application Jun 22 10:03:26.465372 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 658/1304] 10.222.0.46 () {56 vars in 1117 bytes} [Wed Jun 22 10:03:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:26.470705 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bff43e-c8d4-41b6-9fd8-1cee93724b22 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:26.547630 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:26.570542 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bff43e-c8d4-41b6-9fd8-1cee93724b22 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:26.604491 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a550c40-1e01-410e-8b8b-495c5dc93a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:26.605212 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a550c40-1e01-410e-8b8b-495c5dc93a1f None admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:26.605496 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a550c40-1e01-410e-8b8b-495c5dc93a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:26.605771 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a550c40-1e01-410e-8b8b-495c5dc93a1f None admin] PATH_INFO: `/v3/services` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:26.606467 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a550c40-1e01-410e-8b8b-495c5dc93a1f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:26.606770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a550c40-1e01-410e-8b8b-495c5dc93a1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:26.608166 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a550c40-1e01-410e-8b8b-495c5dc93a1f None admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:26.613611 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 647/1305] 10.222.0.46 () {56 vars in 1116 bytes} [Wed Jun 22 10:03:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:26.619306 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf9eb4-5831-4101-becb-d1c0b618c37b None admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:26.719773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf9eb4-5831-4101-becb-d1c0b618c37b None admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:26.752464 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8cbf3c-fa52-470f-b8ec-3823560badd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:26.753825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cbf3c-fa52-470f-b8ec-3823560badd5 None admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:26.753825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cbf3c-fa52-470f-b8ec-3823560badd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:26.753825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cbf3c-fa52-470f-b8ec-3823560badd5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:26.754434 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8cbf3c-fa52-470f-b8ec-3823560badd5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:26.759264 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8cbf3c-fa52-470f-b8ec-3823560badd5 None admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:26.831377 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 659/1306] 10.222.0.46 () {60 vars in 1144 bytes} [Wed Jun 22 10:03:26 2022] POST /identity/v3/endpoints => generated 331 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:03:36.610228 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=30 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:36.826697 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:58.152764 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b306c-ef29-4136-852f-9213a762c01f None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:58.153348 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b306c-ef29-4136-852f-9213a762c01f None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:58.153348 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b306c-ef29-4136-852f-9213a762c01f None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:58.160466 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5d972-6352-4c4b-bad7-c7349ec80958 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:58.161010 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5d972-6352-4c4b-bad7-c7349ec80958 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:58.161111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5d972-6352-4c4b-bad7-c7349ec80958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:58.164423 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 648/1307] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:09:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:58.261105 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-21f5d972-6352-4c4b-bad7-c7349ec80958 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:58.262318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-21f5d972-6352-4c4b-bad7-c7349ec80958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:58.398108 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 660/1308] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:09:58.452675 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e07dae-20b9-4d3e-9b75-05362552d020 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:58.453070 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e07dae-20b9-4d3e-9b75-05362552d020 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:58.453412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e07dae-20b9-4d3e-9b75-05362552d020 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:58.455437 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 649/1309] 10.222.0.46 () {54 vars in 964 bytes} [Wed Jun 22 10:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:58.462005 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823074d-6c47-4dbe-9061-28358985fa0a None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:58.463233 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823074d-6c47-4dbe-9061-28358985fa0a None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:58.463233 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823074d-6c47-4dbe-9061-28358985fa0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:58.573465 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-d823074d-6c47-4dbe-9061-28358985fa0a None None] MFA Rules not processed for user `0bddc02875304e8c92ac367c8095efee`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:58.575192 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-d823074d-6c47-4dbe-9061-28358985fa0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:58.603371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:58.679657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 661/1310] 10.222.0.46 () {58 vars in 1061 bytes} [Wed Jun 22 10:09:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:09:58.689695 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e07dae-20b9-4d3e-9b75-05362552d020 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:58.691676 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-d4e07dae-20b9-4d3e-9b75-05362552d020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:58.859324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e07dae-20b9-4d3e-9b75-05362552d020 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:58.938444 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0f235-6b46-4a3e-a4d3-1a2f562cc7af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:58.939090 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0f235-6b46-4a3e-a4d3-1a2f562cc7af service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:58.939377 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0f235-6b46-4a3e-a4d3-1a2f562cc7af service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:58.939658 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0f235-6b46-4a3e-a4d3-1a2f562cc7af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:58.941456 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-edb0f235-6b46-4a3e-a4d3-1a2f562cc7af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:59.010644 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:59.073239 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0f235-6b46-4a3e-a4d3-1a2f562cc7af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:59.075235 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0f235-6b46-4a3e-a4d3-1a2f562cc7af service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:59.097839 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 650/1311] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:09:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:10:01.562301 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8074a31-1926-4055-ab6e-57ee373b3ee5 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:01.562854 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8074a31-1926-4055-ab6e-57ee373b3ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:01.562854 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8074a31-1926-4055-ab6e-57ee373b3ee5 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:01.564292 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 662/1312] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:01.570894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209cedd-be10-4afd-8473-16c02d310d24 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:01.571415 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209cedd-be10-4afd-8473-16c02d310d24 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:01.571510 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209cedd-be10-4afd-8473-16c02d310d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:01.646631 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-2209cedd-be10-4afd-8473-16c02d310d24 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:01.648473 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-2209cedd-be10-4afd-8473-16c02d310d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:01.743910 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 651/1313] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:10:01.782886 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8074a31-1926-4055-ab6e-57ee373b3ee5 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:01.784529 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-a8074a31-1926-4055-ab6e-57ee373b3ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:01.895686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8074a31-1926-4055-ab6e-57ee373b3ee5 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:01.987348 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:01.990229 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353cd94-7d86-4aab-97b9-fd044d925a28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:01.991453 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353cd94-7d86-4aab-97b9-fd044d925a28 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:01.991711 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353cd94-7d86-4aab-97b9-fd044d925a28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:01.991988 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353cd94-7d86-4aab-97b9-fd044d925a28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:01.993723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-d353cd94-7d86-4aab-97b9-fd044d925a28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:02.114682 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353cd94-7d86-4aab-97b9-fd044d925a28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:02.116646 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353cd94-7d86-4aab-97b9-fd044d925a28 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:02.134747 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 663/1314] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:10:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:10:04.749928 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575a37d-d0b0-4b45-92a4-f2aac5163f76 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:04.750449 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575a37d-d0b0-4b45-92a4-f2aac5163f76 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:04.750542 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575a37d-d0b0-4b45-92a4-f2aac5163f76 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:04.751868 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 652/1315] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:04.757567 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfde848-e1ca-4770-b94b-c87ac74e5d2f None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:04.757987 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfde848-e1ca-4770-b94b-c87ac74e5d2f None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:04.758134 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfde848-e1ca-4770-b94b-c87ac74e5d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:04.821934 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-fbfde848-e1ca-4770-b94b-c87ac74e5d2f None None] MFA Rules not processed for user `d3bcf2a71eef4b3fa6f7b6c18edc4d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:04.823160 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-fbfde848-e1ca-4770-b94b-c87ac74e5d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:04.874132 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:04.919582 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 664/1316] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:10:04 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:10:04.959653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575a37d-d0b0-4b45-92a4-f2aac5163f76 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:04.961295 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-5575a37d-d0b0-4b45-92a4-f2aac5163f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:04.971130 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:05.066655 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575a37d-d0b0-4b45-92a4-f2aac5163f76 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:05.142258 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25855824-f438-4616-abe8-28dbdf1c6585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:05.142948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25855824-f438-4616-abe8-28dbdf1c6585 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:05.143277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25855824-f438-4616-abe8-28dbdf1c6585 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:05.143552 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25855824-f438-4616-abe8-28dbdf1c6585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:05.145289 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-25855824-f438-4616-abe8-28dbdf1c6585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:05.205581 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:05.250777 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25855824-f438-4616-abe8-28dbdf1c6585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:05.252325 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25855824-f438-4616-abe8-28dbdf1c6585 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:05.270211 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 653/1317] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:10:04 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:10:08.111951 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ac698-e54f-496a-908e-4b53519da6ba None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:08.112487 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ac698-e54f-496a-908e-4b53519da6ba None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:08.112487 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ac698-e54f-496a-908e-4b53519da6ba None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:08.113918 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 665/1318] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:08.119821 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c396a1-d819-4699-8f9b-a28c6544480f None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:08.120225 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c396a1-d819-4699-8f9b-a28c6544480f None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:08.120379 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c396a1-d819-4699-8f9b-a28c6544480f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:08.183482 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-a2c396a1-d819-4699-8f9b-a28c6544480f None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:08.184689 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-a2c396a1-d819-4699-8f9b-a28c6544480f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:08.278492 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 654/1319] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:10:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:10:08.333357 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae23759-dea6-45c4-b29c-5dec4b5585f8 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:08.333646 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae23759-dea6-45c4-b29c-5dec4b5585f8 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:08.333926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae23759-dea6-45c4-b29c-5dec4b5585f8 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:08.335343 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 666/1320] 10.222.0.46 () {54 vars in 964 bytes} [Wed Jun 22 10:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:08.341292 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956c723-bdea-4f54-b435-c44bc2189bd8 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:08.341591 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956c723-bdea-4f54-b435-c44bc2189bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:08.341876 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956c723-bdea-4f54-b435-c44bc2189bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:08.362840 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:08.417279 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-9956c723-bdea-4f54-b435-c44bc2189bd8 None None] MFA Rules not processed for user `0bddc02875304e8c92ac367c8095efee`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:08.418485 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-9956c723-bdea-4f54-b435-c44bc2189bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:08.493422 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 655/1321] 10.222.0.46 () {58 vars in 1061 bytes} [Wed Jun 22 10:10:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:10:08.502721 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae23759-dea6-45c4-b29c-5dec4b5585f8 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:08.504282 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-cae23759-dea6-45c4-b29c-5dec4b5585f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:08.607390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae23759-dea6-45c4-b29c-5dec4b5585f8 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:08.682121 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d442cff-6ac3-4173-9b09-778b1811d1ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:08.682780 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d442cff-6ac3-4173-9b09-778b1811d1ce service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:08.683061 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d442cff-6ac3-4173-9b09-778b1811d1ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:08.683334 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d442cff-6ac3-4173-9b09-778b1811d1ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:08.685067 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-2d442cff-6ac3-4173-9b09-778b1811d1ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:08.692155 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:08.791226 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d442cff-6ac3-4173-9b09-778b1811d1ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:08.792657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d442cff-6ac3-4173-9b09-778b1811d1ce service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:08.810480 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 667/1322] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:10:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:10:12.298078 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d8356-669e-42d0-9f72-4945cfb40dae None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:12.298757 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d8356-669e-42d0-9f72-4945cfb40dae None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:12.298757 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d8356-669e-42d0-9f72-4945cfb40dae None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:12.300235 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 656/1323] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:10:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:12.306300 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8e67b-b732-45a6-a5f1-0b62216dbe2e None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:12.307200 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8e67b-b732-45a6-a5f1-0b62216dbe2e None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:12.307200 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8e67b-b732-45a6-a5f1-0b62216dbe2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:12.375014 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-f9a8e67b-b732-45a6-a5f1-0b62216dbe2e None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:12.376219 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-f9a8e67b-b732-45a6-a5f1-0b62216dbe2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:12.435826 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:12.475231 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 668/1324] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:10:12.511937 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d8356-669e-42d0-9f72-4945cfb40dae None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:12.513508 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-a32d8356-669e-42d0-9f72-4945cfb40dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:12.626580 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d8356-669e-42d0-9f72-4945cfb40dae None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:12.640359 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:12.713334 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbbead-6054-4960-8e07-0e90adfd1973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:12.713863 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbbead-6054-4960-8e07-0e90adfd1973 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:12.714144 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbbead-6054-4960-8e07-0e90adfd1973 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:12.714420 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbbead-6054-4960-8e07-0e90adfd1973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:12.716084 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-3fdbbead-6054-4960-8e07-0e90adfd1973 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:12.832571 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbbead-6054-4960-8e07-0e90adfd1973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:12.834045 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbbead-6054-4960-8e07-0e90adfd1973 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:12.852585 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 657/1325] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:10:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:10:14.976156 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef98eb-b1a5-4e5c-9f05-1c7b14d48fe1 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:14.976679 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef98eb-b1a5-4e5c-9f05-1c7b14d48fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:14.976679 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef98eb-b1a5-4e5c-9f05-1c7b14d48fe1 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:14.978139 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 669/1326] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:14.983447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48921ca4-7cb3-4837-8e58-ce1f5754e478 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:14.983970 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48921ca4-7cb3-4837-8e58-ce1f5754e478 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:14.984108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48921ca4-7cb3-4837-8e58-ce1f5754e478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:15.034155 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:15.056101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-48921ca4-7cb3-4837-8e58-ce1f5754e478 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:15.056101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-48921ca4-7cb3-4837-8e58-ce1f5754e478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:15.160353 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 658/1327] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:10:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:10:15.196092 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef98eb-b1a5-4e5c-9f05-1c7b14d48fe1 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:15.197674 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-3eef98eb-b1a5-4e5c-9f05-1c7b14d48fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:15.303316 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef98eb-b1a5-4e5c-9f05-1c7b14d48fe1 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:15.380754 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78ca9d-2af1-4a0c-bde8-6c1fcae82116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:15.381437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78ca9d-2af1-4a0c-bde8-6c1fcae82116 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:15.381726 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78ca9d-2af1-4a0c-bde8-6c1fcae82116 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:15.382057 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78ca9d-2af1-4a0c-bde8-6c1fcae82116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:15.384330 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-4d78ca9d-2af1-4a0c-bde8-6c1fcae82116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:15.401808 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:15.500895 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78ca9d-2af1-4a0c-bde8-6c1fcae82116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:15.502357 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78ca9d-2af1-4a0c-bde8-6c1fcae82116 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:15.521090 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 670/1328] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:10:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:10:17.666313 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a882c-c940-45ba-87ca-dc7f14a9e3b2 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:17.666828 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a882c-c940-45ba-87ca-dc7f14a9e3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:17.666908 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a882c-c940-45ba-87ca-dc7f14a9e3b2 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:17.668718 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 659/1329] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:10:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:17.674308 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ae452-db88-497b-9635-12cdb2c8f006 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:17.674750 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ae452-db88-497b-9635-12cdb2c8f006 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:17.674919 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ae452-db88-497b-9635-12cdb2c8f006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:17.742572 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-890ae452-db88-497b-9635-12cdb2c8f006 None None] MFA Rules not processed for user `d3bcf2a71eef4b3fa6f7b6c18edc4d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:17.743775 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-890ae452-db88-497b-9635-12cdb2c8f006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:17.808953 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:17.842816 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 671/1330] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:10:17 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:10:17.881902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a882c-c940-45ba-87ca-dc7f14a9e3b2 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:17.883463 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-bf0a882c-c940-45ba-87ca-dc7f14a9e3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:17.998272 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a882c-c940-45ba-87ca-dc7f14a9e3b2 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:18.018809 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:18.076417 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22545dba-408a-48d7-979f-5b4a0ac0c2ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:18.077013 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22545dba-408a-48d7-979f-5b4a0ac0c2ac service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:18.077294 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22545dba-408a-48d7-979f-5b4a0ac0c2ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:18.077568 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22545dba-408a-48d7-979f-5b4a0ac0c2ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:18.079221 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-22545dba-408a-48d7-979f-5b4a0ac0c2ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:18.190688 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22545dba-408a-48d7-979f-5b4a0ac0c2ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:18.192129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22545dba-408a-48d7-979f-5b4a0ac0c2ac service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:18.211246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 660/1331] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:10:17 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:10:20.714014 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70705980-f828-4ab8-b6c9-602ecfd2c01f None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:20.714532 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70705980-f828-4ab8-b6c9-602ecfd2c01f None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:20.714649 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70705980-f828-4ab8-b6c9-602ecfd2c01f None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:20.715951 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 672/1332] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:20.721226 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7652ba-8fbb-4705-b05e-027a5a3182c0 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:20.721632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7652ba-8fbb-4705-b05e-027a5a3182c0 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:20.721785 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7652ba-8fbb-4705-b05e-027a5a3182c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:20.783249 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:20.786082 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-7f7652ba-8fbb-4705-b05e-027a5a3182c0 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:20.787299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-7f7652ba-8fbb-4705-b05e-027a5a3182c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:20.883046 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 661/1333] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:10:20.918695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70705980-f828-4ab8-b6c9-602ecfd2c01f None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:20.920158 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-70705980-f828-4ab8-b6c9-602ecfd2c01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:21.021823 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70705980-f828-4ab8-b6c9-602ecfd2c01f None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:21.097220 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195a124-7d91-49cf-ad6f-ffffbedc7d6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:21.097867 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195a124-7d91-49cf-ad6f-ffffbedc7d6d service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:21.098145 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195a124-7d91-49cf-ad6f-ffffbedc7d6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:21.098417 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195a124-7d91-49cf-ad6f-ffffbedc7d6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:21.100048 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-7195a124-7d91-49cf-ad6f-ffffbedc7d6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:21.127664 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:21.209888 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195a124-7d91-49cf-ad6f-ffffbedc7d6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:21.211252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195a124-7d91-49cf-ad6f-ffffbedc7d6d service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:21.229731 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 673/1334] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:10:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:10:23.345576 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c3584-fecf-493a-af33-3b8a59c1ce0d None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:23.346113 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c3584-fecf-493a-af33-3b8a59c1ce0d None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:23.346113 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c3584-fecf-493a-af33-3b8a59c1ce0d None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:23.347552 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 662/1335] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:23.353491 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15e88a-28fe-48d8-b53a-052f2a0a3b26 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:23.353926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15e88a-28fe-48d8-b53a-052f2a0a3b26 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:23.354062 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15e88a-28fe-48d8-b53a-052f2a0a3b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:23.421250 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-6c15e88a-28fe-48d8-b53a-052f2a0a3b26 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:23.422489 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-6c15e88a-28fe-48d8-b53a-052f2a0a3b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:23.496705 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:23.518838 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 674/1336] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:10:23.559549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c3584-fecf-493a-af33-3b8a59c1ce0d None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:23.561101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-157c3584-fecf-493a-af33-3b8a59c1ce0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:23.663380 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c3584-fecf-493a-af33-3b8a59c1ce0d None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:23.693070 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:23.748836 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff7f92-984b-4de5-a3ad-3ddc5d73ea93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:23.749495 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff7f92-984b-4de5-a3ad-3ddc5d73ea93 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:23.749775 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff7f92-984b-4de5-a3ad-3ddc5d73ea93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:23.750048 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff7f92-984b-4de5-a3ad-3ddc5d73ea93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:23.751676 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-faff7f92-984b-4de5-a3ad-3ddc5d73ea93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:23.866974 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff7f92-984b-4de5-a3ad-3ddc5d73ea93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:23.868427 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff7f92-984b-4de5-a3ad-3ddc5d73ea93 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:23.886632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 663/1337] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:10:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:10:26.558438 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91821ad6-b7af-4b78-9790-99dea36983e4 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:26.558986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91821ad6-b7af-4b78-9790-99dea36983e4 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:26.558986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91821ad6-b7af-4b78-9790-99dea36983e4 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:26.560393 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 675/1338] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:26.565701 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc490c-c41e-4e22-a63b-bcc45e51ba06 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:26.566108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc490c-c41e-4e22-a63b-bcc45e51ba06 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:26.566197 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc490c-c41e-4e22-a63b-bcc45e51ba06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:26.628886 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-88bc490c-c41e-4e22-a63b-bcc45e51ba06 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:26.630106 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-88bc490c-c41e-4e22-a63b-bcc45e51ba06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:26.638213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:26.726720 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 664/1339] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:10:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:10:26.761692 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91821ad6-b7af-4b78-9790-99dea36983e4 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:26.763248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-91821ad6-b7af-4b78-9790-99dea36983e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:26.864423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91821ad6-b7af-4b78-9790-99dea36983e4 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:26.936991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bab2b-a5e9-4a13-aded-5d82b0ebae7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:26.937630 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bab2b-a5e9-4a13-aded-5d82b0ebae7d service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:26.937913 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bab2b-a5e9-4a13-aded-5d82b0ebae7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:26.938184 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bab2b-a5e9-4a13-aded-5d82b0ebae7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:26.939821 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-0f6bab2b-a5e9-4a13-aded-5d82b0ebae7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:26.974656 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:27.046976 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6bab2b-a5e9-4a13-aded-5d82b0ebae7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:27.048414 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6bab2b-a5e9-4a13-aded-5d82b0ebae7d service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:27.067624 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 676/1340] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:10:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:10:31.545535 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8199b0a-6664-4f8f-ad92-361005265616 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:31.546111 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8199b0a-6664-4f8f-ad92-361005265616 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:31.546210 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8199b0a-6664-4f8f-ad92-361005265616 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:31.547534 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 665/1341] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:31.553207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bc86b-8c7f-4d31-bc98-debb3cc76d83 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:31.554280 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bc86b-8c7f-4d31-bc98-debb3cc76d83 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:31.554383 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bc86b-8c7f-4d31-bc98-debb3cc76d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:31.631950 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-545bc86b-8c7f-4d31-bc98-debb3cc76d83 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:31.633280 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-545bc86b-8c7f-4d31-bc98-debb3cc76d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:31.730958 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:31.743443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 677/1342] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:10:31.782789 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8199b0a-6664-4f8f-ad92-361005265616 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:31.785057 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-b8199b0a-6664-4f8f-ad92-361005265616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:31.885155 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8199b0a-6664-4f8f-ad92-361005265616 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:31.889230 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab1523-c7cb-44ee-bc37-129b4eaefd36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:31.889559 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab1523-c7cb-44ee-bc37-129b4eaefd36 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:31.889844 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab1523-c7cb-44ee-bc37-129b4eaefd36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:31.890121 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab1523-c7cb-44ee-bc37-129b4eaefd36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:31.900508 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab1523-c7cb-44ee-bc37-129b4eaefd36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:31.901992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab1523-c7cb-44ee-bc37-129b4eaefd36 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:31.911715 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 666/1343] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:10:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:10:34.925340 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d262481-04cc-4caf-9afa-ad49b5a83508 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:34.925870 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d262481-04cc-4caf-9afa-ad49b5a83508 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:34.925870 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d262481-04cc-4caf-9afa-ad49b5a83508 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:34.927236 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 678/1344] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:34.935072 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fd2ec-b9fd-4ec5-bcf0-63a854822361 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:34.935608 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fd2ec-b9fd-4ec5-bcf0-63a854822361 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:34.935608 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fd2ec-b9fd-4ec5-bcf0-63a854822361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:34.971963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-541fd2ec-b9fd-4ec5-bcf0-63a854822361 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:34.973244 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-541fd2ec-b9fd-4ec5-bcf0-63a854822361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:35.009034 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:35.067489 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 667/1345] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:10:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:10:35.109234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d262481-04cc-4caf-9afa-ad49b5a83508 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:35.120447 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d262481-04cc-4caf-9afa-ad49b5a83508 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:35.124094 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fde155-6bb5-40ce-bf75-4038e674aac7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:35.124756 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fde155-6bb5-40ce-bf75-4038e674aac7 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:35.125077 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fde155-6bb5-40ce-bf75-4038e674aac7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:35.125359 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fde155-6bb5-40ce-bf75-4038e674aac7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:35.137972 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fde155-6bb5-40ce-bf75-4038e674aac7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:35.139411 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fde155-6bb5-40ce-bf75-4038e674aac7 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:35.151459 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 679/1346] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:10:35 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:10:39.612582 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509bb28-05d1-428c-9487-6251319d63b4 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:39.613165 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509bb28-05d1-428c-9487-6251319d63b4 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:39.613165 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509bb28-05d1-428c-9487-6251319d63b4 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:39.614562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 668/1347] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:39.619868 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a39dc-d04f-42ba-abb1-5e154442f8b8 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:39.620266 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a39dc-d04f-42ba-abb1-5e154442f8b8 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:39.620429 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a39dc-d04f-42ba-abb1-5e154442f8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:39.638437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-cf6a39dc-d04f-42ba-abb1-5e154442f8b8 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:39.639575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-cf6a39dc-d04f-42ba-abb1-5e154442f8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:39.648383 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 680/1348] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:10:39.686531 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509bb28-05d1-428c-9487-6251319d63b4 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:39.698052 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509bb28-05d1-428c-9487-6251319d63b4 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:39.701654 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55e870-1a71-42c0-9fc1-68b317d9b385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:39.702302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55e870-1a71-42c0-9fc1-68b317d9b385 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:39.702588 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55e870-1a71-42c0-9fc1-68b317d9b385 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:39.702889 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55e870-1a71-42c0-9fc1-68b317d9b385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:39.712842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55e870-1a71-42c0-9fc1-68b317d9b385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:39.714294 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55e870-1a71-42c0-9fc1-68b317d9b385 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:39.724141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 669/1349] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:10:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:10:44.769028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce80dc-b038-4596-b0e5-cc10829c7fd8 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:44.769515 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce80dc-b038-4596-b0e5-cc10829c7fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:44.769598 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce80dc-b038-4596-b0e5-cc10829c7fd8 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:44.772210 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 681/1350] 10.222.0.46 () {54 vars in 921 bytes} [Wed Jun 22 10:10:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:44.777399 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b86603-7090-4099-ab84-4a75e6d51e48 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:44.780175 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b86603-7090-4099-ab84-4a75e6d51e48 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:44.780175 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b86603-7090-4099-ab84-4a75e6d51e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:44.908145 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-49b86603-7090-4099-ab84-4a75e6d51e48 None None] MFA Rules not processed for user `675892a676054b4f86f9ac12d95f4f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:44.909537 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-49b86603-7090-4099-ab84-4a75e6d51e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:44.999349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 670/1351] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Jun 22 10:10:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:10:49.248777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fcace-0907-40da-afcc-50d8a88b3449 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:49.249337 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fcace-0907-40da-afcc-50d8a88b3449 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:49.249337 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fcace-0907-40da-afcc-50d8a88b3449 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:49.251024 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 682/1352] 10.222.0.46 () {54 vars in 921 bytes} [Wed Jun 22 10:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:49.256348 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7769af-7339-4a5b-9a66-735adcdcb357 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:49.257380 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7769af-7339-4a5b-9a66-735adcdcb357 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:49.257707 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7769af-7339-4a5b-9a66-735adcdcb357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:49.276535 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-5b7769af-7339-4a5b-9a66-735adcdcb357 None None] MFA Rules not processed for user `675892a676054b4f86f9ac12d95f4f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:49.277781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-5b7769af-7339-4a5b-9a66-735adcdcb357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:49.286895 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 671/1353] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Jun 22 10:10:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:10:49.633074 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=13 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:50.755846 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757acca6-9e69-4ebd-bfe5-ec1319c57a5a None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:50.756481 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757acca6-9e69-4ebd-bfe5-ec1319c57a5a None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:50.756589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757acca6-9e69-4ebd-bfe5-ec1319c57a5a None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:50.758369 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 683/1354] 10.222.0.46 () {54 vars in 921 bytes} [Wed Jun 22 10:10:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:50.763567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dca66-6f32-4da9-abc7-900a3f718279 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:50.764190 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dca66-6f32-4da9-abc7-900a3f718279 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:50.764190 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dca66-6f32-4da9-abc7-900a3f718279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:50.782641 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-618dca66-6f32-4da9-abc7-900a3f718279 None None] MFA Rules not processed for user `675892a676054b4f86f9ac12d95f4f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:50.783930 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-618dca66-6f32-4da9-abc7-900a3f718279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:50.792813 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 672/1355] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Jun 22 10:10:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:10:54.658725 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b97e3-d419-44e6-a3a0-0c795e1ec566 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:54.659220 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b97e3-d419-44e6-a3a0-0c795e1ec566 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:54.659220 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b97e3-d419-44e6-a3a0-0c795e1ec566 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:54.660575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 684/1356] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:54.668989 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1988b-571a-4c27-99d2-88baa2fc5549 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:54.669394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1988b-571a-4c27-99d2-88baa2fc5549 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:54.669552 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1988b-571a-4c27-99d2-88baa2fc5549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:54.697670 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-94c1988b-571a-4c27-99d2-88baa2fc5549 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:54.698486 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-94c1988b-571a-4c27-99d2-88baa2fc5549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:54.707256 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 673/1357] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:10:54.764178 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafc337-cb35-4011-b7be-6099f76d0936 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:54.764458 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafc337-cb35-4011-b7be-6099f76d0936 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:54.764939 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafc337-cb35-4011-b7be-6099f76d0936 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:54.766317 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 685/1358] 10.222.0.46 () {54 vars in 961 bytes} [Wed Jun 22 10:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:54.778354 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace492d-7cf8-4f32-9b5c-24d2e8500402 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:54.778928 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace492d-7cf8-4f32-9b5c-24d2e8500402 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:54.779394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace492d-7cf8-4f32-9b5c-24d2e8500402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:54.827357 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:54.836126 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-cace492d-7cf8-4f32-9b5c-24d2e8500402 None None] MFA Rules not processed for user `4ed9a00723ab4af2b633ab7614d178a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:54.837452 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-cace492d-7cf8-4f32-9b5c-24d2e8500402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:54.923755 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 674/1359] 10.222.0.46 () {58 vars in 1058 bytes} [Wed Jun 22 10:10:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:10:54.932530 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bafc337-cb35-4011-b7be-6099f76d0936 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:54.949009 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bafc337-cb35-4011-b7be-6099f76d0936 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:54.954777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8556e-4fac-4ea5-acab-0364536c63c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:54.955478 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8556e-4fac-4ea5-acab-0364536c63c7 service nova] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:54.955766 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8556e-4fac-4ea5-acab-0364536c63c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:54.956041 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8556e-4fac-4ea5-acab-0364536c63c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:54.966697 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8556e-4fac-4ea5-acab-0364536c63c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:54.968537 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8556e-4fac-4ea5-acab-0364536c63c7 service nova] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:54.979940 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 686/1360] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:10:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:10:57.274879 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c4e28-1606-41f9-80b8-d062ccf80e20 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:57.275414 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c4e28-1606-41f9-80b8-d062ccf80e20 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:57.275414 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c4e28-1606-41f9-80b8-d062ccf80e20 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:57.282624 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b275ec-071e-41e6-97f4-2f09c7e3077f None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:57.283493 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b275ec-071e-41e6-97f4-2f09c7e3077f None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:57.283937 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b275ec-071e-41e6-97f4-2f09c7e3077f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:57.285156 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 675/1361] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:57.306951 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-89b275ec-071e-41e6-97f4-2f09c7e3077f None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:57.308704 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-89b275ec-071e-41e6-97f4-2f09c7e3077f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:57.317002 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 687/1362] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:10:57.363297 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c4e28-1606-41f9-80b8-d062ccf80e20 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:57.379070 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c4e28-1606-41f9-80b8-d062ccf80e20 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:57.385437 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac026360-256d-4511-b045-b2994bd6b591 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:57.386092 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac026360-256d-4511-b045-b2994bd6b591 service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:57.386376 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac026360-256d-4511-b045-b2994bd6b591 service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:57.386658 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac026360-256d-4511-b045-b2994bd6b591 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:57.395917 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac026360-256d-4511-b045-b2994bd6b591 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:57.397568 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac026360-256d-4511-b045-b2994bd6b591 service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:57.407876 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 676/1363] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:10:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:10:59.940529 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296604f7-d99a-4cd9-9f88-d3e7bab98864 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:59.941124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296604f7-d99a-4cd9-9f88-d3e7bab98864 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:59.941124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296604f7-d99a-4cd9-9f88-d3e7bab98864 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:59.943151 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 688/1364] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:10:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:59.948988 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707368d-47cd-4433-87be-765549a3ea01 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:59.949493 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707368d-47cd-4433-87be-765549a3ea01 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:59.949493 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707368d-47cd-4433-87be-765549a3ea01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:59.971779 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-7707368d-47cd-4433-87be-765549a3ea01 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:59.973019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-7707368d-47cd-4433-87be-765549a3ea01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:59.982182 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 677/1365] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:11:00.028202 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bf8e9-ba28-42d0-af49-228a9688d1d5 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:00.028493 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bf8e9-ba28-42d0-af49-228a9688d1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:00.028773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bf8e9-ba28-42d0-af49-228a9688d1d5 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:00.030375 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 689/1366] 10.222.0.46 () {54 vars in 961 bytes} [Wed Jun 22 10:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:00.037119 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33c691-50c7-4f0f-99e8-02ed9ff8b76b None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:00.037514 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33c691-50c7-4f0f-99e8-02ed9ff8b76b None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:00.037859 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33c691-50c7-4f0f-99e8-02ed9ff8b76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:00.056936 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-1d33c691-50c7-4f0f-99e8-02ed9ff8b76b None None] MFA Rules not processed for user `4ed9a00723ab4af2b633ab7614d178a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:00.058126 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-1d33c691-50c7-4f0f-99e8-02ed9ff8b76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:00.067685 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 678/1367] 10.222.0.46 () {58 vars in 1058 bytes} [Wed Jun 22 10:11:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:11:00.075243 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bf8e9-ba28-42d0-af49-228a9688d1d5 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:00.089649 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bf8e9-ba28-42d0-af49-228a9688d1d5 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:00.095144 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53618ab4-f38b-4eff-ba4e-ed0914b4fc19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:00.095762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53618ab4-f38b-4eff-ba4e-ed0914b4fc19 service nova] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:00.096047 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53618ab4-f38b-4eff-ba4e-ed0914b4fc19 service nova] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:00.096323 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53618ab4-f38b-4eff-ba4e-ed0914b4fc19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:00.104770 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53618ab4-f38b-4eff-ba4e-ed0914b4fc19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:00.106366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53618ab4-f38b-4eff-ba4e-ed0914b4fc19 service nova] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:00.116130 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 690/1368] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:11:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:11:02.513238 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5100c06-9dfd-4295-9c03-9710acebae4a None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:02.513743 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5100c06-9dfd-4295-9c03-9710acebae4a None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:02.513743 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5100c06-9dfd-4295-9c03-9710acebae4a None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:02.515087 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 679/1369] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:02.522010 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb3e6a-fece-40a4-bfbb-5bf0f7f0b934 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:02.522484 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb3e6a-fece-40a4-bfbb-5bf0f7f0b934 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:02.522590 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb3e6a-fece-40a4-bfbb-5bf0f7f0b934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:02.540219 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-c7fb3e6a-fece-40a4-bfbb-5bf0f7f0b934 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:02.541452 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-c7fb3e6a-fece-40a4-bfbb-5bf0f7f0b934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:02.549748 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 691/1370] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:11:02.595339 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5100c06-9dfd-4295-9c03-9710acebae4a None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:02.612463 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5100c06-9dfd-4295-9c03-9710acebae4a None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:02.618546 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6a899-8261-4ea1-9924-c92507bd9c21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:02.619189 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6a899-8261-4ea1-9924-c92507bd9c21 service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:02.619470 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6a899-8261-4ea1-9924-c92507bd9c21 service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:02.619744 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6a899-8261-4ea1-9924-c92507bd9c21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:02.628632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6a899-8261-4ea1-9924-c92507bd9c21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:02.630912 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6a899-8261-4ea1-9924-c92507bd9c21 service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:02.641831 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 680/1371] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:11:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:11:03.037302 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc59189-82f5-45c9-a352-c68ca5d5efcf None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:03.037592 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc59189-82f5-45c9-a352-c68ca5d5efcf None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:03.037874 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc59189-82f5-45c9-a352-c68ca5d5efcf None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:03.039384 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 692/1372] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:03.044916 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd0c27-71b6-4f3e-88e4-c48153d4d860 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:03.045219 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd0c27-71b6-4f3e-88e4-c48153d4d860 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:03.045486 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd0c27-71b6-4f3e-88e4-c48153d4d860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:03.065746 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-61fd0c27-71b6-4f3e-88e4-c48153d4d860 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:03.067498 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-61fd0c27-71b6-4f3e-88e4-c48153d4d860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:03.075993 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 681/1373] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:11:03.420473 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81b3f6-68ef-46cc-9467-b7216cf46e61 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:03.420473 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81b3f6-68ef-46cc-9467-b7216cf46e61 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:03.420473 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81b3f6-68ef-46cc-9467-b7216cf46e61 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:03.423546 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 693/1374] 10.222.0.46 () {54 vars in 963 bytes} [Wed Jun 22 10:11:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:03.428629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf896ea9-8cb8-4bc5-8001-a4ed0f13a344 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:03.429081 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf896ea9-8cb8-4bc5-8001-a4ed0f13a344 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:03.430534 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf896ea9-8cb8-4bc5-8001-a4ed0f13a344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:03.485824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-bf896ea9-8cb8-4bc5-8001-a4ed0f13a344 None None] MFA Rules not processed for user `6eea844b342b418895d08eef368bbd24`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:03.487213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-bf896ea9-8cb8-4bc5-8001-a4ed0f13a344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:03.558770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 682/1375] 10.222.0.46 () {58 vars in 1060 bytes} [Wed Jun 22 10:11:03 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:11:03.567958 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81b3f6-68ef-46cc-9467-b7216cf46e61 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:03.579041 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81b3f6-68ef-46cc-9467-b7216cf46e61 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:03.582661 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783dcc42-745f-492d-8524-3e4d7df764ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:03.583415 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dcc42-745f-492d-8524-3e4d7df764ee service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:03.583803 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dcc42-745f-492d-8524-3e4d7df764ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:03.584287 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dcc42-745f-492d-8524-3e4d7df764ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:03.594084 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783dcc42-745f-492d-8524-3e4d7df764ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:03.595922 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783dcc42-745f-492d-8524-3e4d7df764ee service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:03.608464 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 694/1376] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:11:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:11:05.024531 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db4b76-f15f-4ca2-ab6a-64cfb7a6d2a9 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:05.025071 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db4b76-f15f-4ca2-ab6a-64cfb7a6d2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:05.025071 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db4b76-f15f-4ca2-ab6a-64cfb7a6d2a9 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:05.026425 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 683/1377] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:05.031810 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2232e-850d-4db4-9b7e-aaec27ba3a08 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:05.032256 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2232e-850d-4db4-9b7e-aaec27ba3a08 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:05.032362 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2232e-850d-4db4-9b7e-aaec27ba3a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:05.050472 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-38b2232e-850d-4db4-9b7e-aaec27ba3a08 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:05.051684 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-38b2232e-850d-4db4-9b7e-aaec27ba3a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:05.060234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 695/1378] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:11:05.104266 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db4b76-f15f-4ca2-ab6a-64cfb7a6d2a9 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:05.120673 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db4b76-f15f-4ca2-ab6a-64cfb7a6d2a9 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:05.127030 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021705e-7762-48e4-b211-5fde3fb8682d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:05.127821 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021705e-7762-48e4-b211-5fde3fb8682d service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:05.128163 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021705e-7762-48e4-b211-5fde3fb8682d service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:05.128545 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021705e-7762-48e4-b211-5fde3fb8682d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:05.138127 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021705e-7762-48e4-b211-5fde3fb8682d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:05.140318 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021705e-7762-48e4-b211-5fde3fb8682d service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:05.144529 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:11:05.152446 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 684/1379] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:11:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:11:07.372113 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb423b4-5781-4571-9365-ee5c84ea43cb None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:07.372655 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb423b4-5781-4571-9365-ee5c84ea43cb None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:07.372655 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb423b4-5781-4571-9365-ee5c84ea43cb None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:07.374087 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 696/1380] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:07.379996 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa345230-dcd2-4594-9ce7-b92e1b218e3b None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:07.380436 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa345230-dcd2-4594-9ce7-b92e1b218e3b None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:07.380566 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa345230-dcd2-4594-9ce7-b92e1b218e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:07.398450 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-fa345230-dcd2-4594-9ce7-b92e1b218e3b None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:07.399661 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-fa345230-dcd2-4594-9ce7-b92e1b218e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:07.409468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 685/1381] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:11:07.461770 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb423b4-5781-4571-9365-ee5c84ea43cb None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:07.477196 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb423b4-5781-4571-9365-ee5c84ea43cb None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:07.482834 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d651f8-30e5-4414-ab01-9f9a668879af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:07.483478 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d651f8-30e5-4414-ab01-9f9a668879af service nova] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:07.483766 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d651f8-30e5-4414-ab01-9f9a668879af service nova] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:07.484048 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d651f8-30e5-4414-ab01-9f9a668879af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:07.493322 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d651f8-30e5-4414-ab01-9f9a668879af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:07.495567 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d651f8-30e5-4414-ab01-9f9a668879af service nova] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:07.514446 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 697/1382] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:11:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:11:09.802757 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4e9a1-e1cd-4932-aac3-66a9fe8c88e4 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:09.803570 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4e9a1-e1cd-4932-aac3-66a9fe8c88e4 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:09.803570 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4e9a1-e1cd-4932-aac3-66a9fe8c88e4 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:09.804957 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 686/1383] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:11:09.810264 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468620aa-7fa0-4f1d-a6b2-cb5bbcae532e None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:09.811086 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468620aa-7fa0-4f1d-a6b2-cb5bbcae532e None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:09.811376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468620aa-7fa0-4f1d-a6b2-cb5bbcae532e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:09.829324 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-468620aa-7fa0-4f1d-a6b2-cb5bbcae532e None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:09.830531 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-468620aa-7fa0-4f1d-a6b2-cb5bbcae532e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:09.840434 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 698/1384] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:11:09.881740 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4e9a1-e1cd-4932-aac3-66a9fe8c88e4 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:09.899363 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4e9a1-e1cd-4932-aac3-66a9fe8c88e4 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:09.906008 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fa621-382f-4bab-ad3e-1121ef840742 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:09.906727 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fa621-382f-4bab-ad3e-1121ef840742 service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:09.907079 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fa621-382f-4bab-ad3e-1121ef840742 service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:09.907528 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fa621-382f-4bab-ad3e-1121ef840742 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:09.918953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fa621-382f-4bab-ad3e-1121ef840742 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:09.920703 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fa621-382f-4bab-ad3e-1121ef840742 service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:09.932075 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 687/1385] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:11:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:11:12.113317 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281acaa-b28e-4e8d-9cd5-fa25e4fa9c5f None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:12.113856 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281acaa-b28e-4e8d-9cd5-fa25e4fa9c5f None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:12.113856 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281acaa-b28e-4e8d-9cd5-fa25e4fa9c5f None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:12.115359 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 699/1386] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:12.121399 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14052019-35f7-49f1-96fb-fc9fc5d28414 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:12.121863 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14052019-35f7-49f1-96fb-fc9fc5d28414 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:12.121980 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14052019-35f7-49f1-96fb-fc9fc5d28414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:12.140802 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-14052019-35f7-49f1-96fb-fc9fc5d28414 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:12.142076 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-14052019-35f7-49f1-96fb-fc9fc5d28414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:12.150982 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 688/1387] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:11:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:11:12.197919 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281acaa-b28e-4e8d-9cd5-fa25e4fa9c5f None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:12.213726 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281acaa-b28e-4e8d-9cd5-fa25e4fa9c5f None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:12.219706 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130adf1-849f-4713-ab32-333a19270f1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:12.220381 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130adf1-849f-4713-ab32-333a19270f1a service nova] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:12.220704 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130adf1-849f-4713-ab32-333a19270f1a service nova] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:12.221022 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130adf1-849f-4713-ab32-333a19270f1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:12.231019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130adf1-849f-4713-ab32-333a19270f1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:12.233099 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130adf1-849f-4713-ab32-333a19270f1a service nova] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:12.245643 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 700/1388] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:11:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:11:14.600480 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20895f7a-7350-4b3b-ac6f-4b766433272e None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:14.601182 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20895f7a-7350-4b3b-ac6f-4b766433272e None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:14.601182 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20895f7a-7350-4b3b-ac6f-4b766433272e None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:14.602558 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 689/1389] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:11:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:14.608650 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc3fb4-2220-47e4-9e25-225553fbaac6 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:14.609141 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc3fb4-2220-47e4-9e25-225553fbaac6 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:14.609396 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc3fb4-2220-47e4-9e25-225553fbaac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:14.629803 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-1dfc3fb4-2220-47e4-9e25-225553fbaac6 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:14.630978 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-1dfc3fb4-2220-47e4-9e25-225553fbaac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:14.638963 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 701/1390] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:11:14.688030 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20895f7a-7350-4b3b-ac6f-4b766433272e None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:14.703094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20895f7a-7350-4b3b-ac6f-4b766433272e None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:14.709402 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b33ac-8f9f-4945-bb48-ee5075442d7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:14.710086 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b33ac-8f9f-4945-bb48-ee5075442d7c service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:14.710374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b33ac-8f9f-4945-bb48-ee5075442d7c service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:14.710652 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b33ac-8f9f-4945-bb48-ee5075442d7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:14.719490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b33ac-8f9f-4945-bb48-ee5075442d7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:14.721134 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b33ac-8f9f-4945-bb48-ee5075442d7c service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:14.731667 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 690/1391] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:11:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:11:17.016465 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d9182-0162-4226-b07e-86df987a1a70 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:17.017017 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d9182-0162-4226-b07e-86df987a1a70 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:17.017017 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d9182-0162-4226-b07e-86df987a1a70 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:17.018436 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 702/1392] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:17.024422 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adfb4d-430e-4a1f-9166-9b083676d26f None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:17.024911 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adfb4d-430e-4a1f-9166-9b083676d26f None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:17.025036 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adfb4d-430e-4a1f-9166-9b083676d26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:17.042550 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-13adfb4d-430e-4a1f-9166-9b083676d26f None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:17.043756 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-13adfb4d-430e-4a1f-9166-9b083676d26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:17.051806 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 691/1393] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:11:17.100299 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d9182-0162-4226-b07e-86df987a1a70 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:17.115845 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d9182-0162-4226-b07e-86df987a1a70 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:17.121338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede46231-17fa-4670-8767-f17730ec8e4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:17.121989 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede46231-17fa-4670-8767-f17730ec8e4a service nova] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:17.122272 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede46231-17fa-4670-8767-f17730ec8e4a service nova] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:17.122560 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede46231-17fa-4670-8767-f17730ec8e4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:17.132059 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede46231-17fa-4670-8767-f17730ec8e4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:17.133675 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede46231-17fa-4670-8767-f17730ec8e4a service nova] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:17.143518 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 703/1394] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:11:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:11:19.454276 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d67373-8e31-4305-ab03-de91288131cc None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:19.454814 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d67373-8e31-4305-ab03-de91288131cc None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:19.454814 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d67373-8e31-4305-ab03-de91288131cc None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:19.456520 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 692/1395] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:19.462225 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01376310-2c42-4f23-8849-bf111aa0bc19 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:19.462724 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01376310-2c42-4f23-8849-bf111aa0bc19 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:19.463001 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01376310-2c42-4f23-8849-bf111aa0bc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:19.480861 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-01376310-2c42-4f23-8849-bf111aa0bc19 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:19.482064 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-01376310-2c42-4f23-8849-bf111aa0bc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:19.490675 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 704/1396] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:11:19.535696 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d67373-8e31-4305-ab03-de91288131cc None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:19.549854 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d67373-8e31-4305-ab03-de91288131cc None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:19.555982 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078541b-20d9-45fa-91ee-e0c9b6d9c1cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:19.556618 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078541b-20d9-45fa-91ee-e0c9b6d9c1cf service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:19.556927 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078541b-20d9-45fa-91ee-e0c9b6d9c1cf service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:19.557202 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078541b-20d9-45fa-91ee-e0c9b6d9c1cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:19.559580 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5de98c-af8b-4216-a6b8-55e1539519f0 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:19.559869 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5de98c-af8b-4216-a6b8-55e1539519f0 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:19.560172 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5de98c-af8b-4216-a6b8-55e1539519f0 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:19.561577 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 705/1397] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:19.565654 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2078541b-20d9-45fa-91ee-e0c9b6d9c1cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:19.567399 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808e6d3-adfb-42bd-9957-06a13fd1203c None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:19.567690 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808e6d3-adfb-42bd-9957-06a13fd1203c None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:19.567876 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2078541b-20d9-45fa-91ee-e0c9b6d9c1cf service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:19.567990 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5808e6d3-adfb-42bd-9957-06a13fd1203c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:19.577564 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 693/1398] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:11:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:11:19.586693 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-5808e6d3-adfb-42bd-9957-06a13fd1203c None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:19.588015 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-5808e6d3-adfb-42bd-9957-06a13fd1203c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:19.595911 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 706/1399] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:11:19.652610 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3204342-a157-440b-bdc3-5c677fa25889 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:19.652926 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3204342-a157-440b-bdc3-5c677fa25889 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:19.653206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3204342-a157-440b-bdc3-5c677fa25889 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:19.654579 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 694/1400] 10.222.0.46 () {54 vars in 962 bytes} [Wed Jun 22 10:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:19.663533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b9cb4-6d13-443e-a69b-2adfe303f9a9 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:19.663533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b9cb4-6d13-443e-a69b-2adfe303f9a9 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:19.663533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b9cb4-6d13-443e-a69b-2adfe303f9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:19.700556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=68 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:11:19.715741 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-d67b9cb4-6d13-443e-a69b-2adfe303f9a9 None None] MFA Rules not processed for user `4a4fbf9b051940bd82547a700796d118`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:19.716889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-d67b9cb4-6d13-443e-a69b-2adfe303f9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:19.797316 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 707/1401] 10.222.0.46 () {58 vars in 1059 bytes} [Wed Jun 22 10:11:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:11:19.809473 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3204342-a157-440b-bdc3-5c677fa25889 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:19.822541 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3204342-a157-440b-bdc3-5c677fa25889 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:19.826566 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e595ff-7541-41f4-853d-00475bd50877 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4fbf9b051940bd82547a700796d118', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:19.827220 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e595ff-7541-41f4-853d-00475bd50877 service glance] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:19.827549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e595ff-7541-41f4-853d-00475bd50877 service glance] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:19.827781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e595ff-7541-41f4-853d-00475bd50877 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:19.874277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e595ff-7541-41f4-853d-00475bd50877 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:19.874277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e595ff-7541-41f4-853d-00475bd50877 service glance] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:19.874277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 695/1402] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:11:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:11:20.719916 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed17bc8-9cf0-40e4-9ab6-7c91e75fde4d None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:20.720429 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed17bc8-9cf0-40e4-9ab6-7c91e75fde4d None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:20.720529 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed17bc8-9cf0-40e4-9ab6-7c91e75fde4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:20.771320 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-3ed17bc8-9cf0-40e4-9ab6-7c91e75fde4d None None] MFA Rules not processed for user `7b4d3b1fe8064cc592d89e7bab91bace`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:20.772571 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-3ed17bc8-9cf0-40e4-9ab6-7c91e75fde4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:20.836789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 708/1403] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Jun 22 10:11:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:11:20.879569 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e746c-aacc-45b9-b978-15d9504a3dc5 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:20.880044 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e746c-aacc-45b9-b978-15d9504a3dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:20.880200 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e746c-aacc-45b9-b978-15d9504a3dc5 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:20.881718 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 696/1404] 10.222.0.46 () {54 vars in 942 bytes} [Wed Jun 22 10:11:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:20.888487 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447b444-2496-4c61-8681-2ee1452e75e2 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:20.888852 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447b444-2496-4c61-8681-2ee1452e75e2 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:20.889148 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447b444-2496-4c61-8681-2ee1452e75e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:20.938411 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-8447b444-2496-4c61-8681-2ee1452e75e2 None None] MFA Rules not processed for user `9c724063ce51470ca09c5c5ab231fd9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:20.939625 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-8447b444-2496-4c61-8681-2ee1452e75e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:20.989128 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:11:21.016086 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 709/1405] 10.222.0.46 () {58 vars in 1039 bytes} [Wed Jun 22 10:11:20 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:11:21.025946 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e746c-aacc-45b9-b978-15d9504a3dc5 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:21.039341 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e746c-aacc-45b9-b978-15d9504a3dc5 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:21.044412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5573a-8c0d-4a4a-91fd-fb785aec96fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c724063ce51470ca09c5c5ab231fd9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:21.045363 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5573a-8c0d-4a4a-91fd-fb785aec96fd service swift] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:21.045710 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5573a-8c0d-4a4a-91fd-fb785aec96fd service swift] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:21.046049 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5573a-8c0d-4a4a-91fd-fb785aec96fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:21.055728 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5573a-8c0d-4a4a-91fd-fb785aec96fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:21.057401 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5573a-8c0d-4a4a-91fd-fb785aec96fd service swift] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:21.066062 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 697/1406] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 22 10:11:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 10:11:21.904590 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b268176-4e9b-44f6-a2df-9846401c2719 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:21.905160 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b268176-4e9b-44f6-a2df-9846401c2719 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:21.905260 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b268176-4e9b-44f6-a2df-9846401c2719 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:21.906609 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 710/1407] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:21.913206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fbcf4-cbcd-4c4f-ae3e-911c0489190e None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:21.914118 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fbcf4-cbcd-4c4f-ae3e-911c0489190e None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:21.914449 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fbcf4-cbcd-4c4f-ae3e-911c0489190e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:21.933230 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-922fbcf4-cbcd-4c4f-ae3e-911c0489190e None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:21.934718 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-922fbcf4-cbcd-4c4f-ae3e-911c0489190e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:21.944872 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 698/1408] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:11:21.989638 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b268176-4e9b-44f6-a2df-9846401c2719 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:22.004849 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b268176-4e9b-44f6-a2df-9846401c2719 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:22.011774 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824d93f-1c02-47d7-b0a2-9c9462e8b133 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:22.012454 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824d93f-1c02-47d7-b0a2-9c9462e8b133 service nova] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:22.012739 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824d93f-1c02-47d7-b0a2-9c9462e8b133 service nova] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:22.013065 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824d93f-1c02-47d7-b0a2-9c9462e8b133 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:22.022447 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824d93f-1c02-47d7-b0a2-9c9462e8b133 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:22.023999 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824d93f-1c02-47d7-b0a2-9c9462e8b133 service nova] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:22.036160 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 711/1409] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:11:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:11:31.927195 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=43 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:11:32.030613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=17 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:11:45.086382 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc3bbf-1a95-409a-8423-3c16108e91a2 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:45.087000 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc3bbf-1a95-409a-8423-3c16108e91a2 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:45.087000 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc3bbf-1a95-409a-8423-3c16108e91a2 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:45.088317 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 699/1410] 10.222.0.46 () {54 vars in 918 bytes} [Wed Jun 22 10:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:45.093581 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ae198-b2e0-44b6-9cf1-9a484dd241b9 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:45.094038 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ae198-b2e0-44b6-9cf1-9a484dd241b9 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:45.094135 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ae198-b2e0-44b6-9cf1-9a484dd241b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:45.111590 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-9a9ae198-b2e0-44b6-9cf1-9a484dd241b9 None None] MFA Rules not processed for user `675892a676054b4f86f9ac12d95f4f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:45.112804 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-9a9ae198-b2e0-44b6-9cf1-9a484dd241b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:45.121354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 712/1411] 10.222.0.46 () {58 vars in 1015 bytes} [Wed Jun 22 10:11:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:11:45.136015 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3c92b-9d9a-47f1-a113-80e7d1170e7a None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:45.136327 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3c92b-9d9a-47f1-a113-80e7d1170e7a None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:45.136587 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3c92b-9d9a-47f1-a113-80e7d1170e7a None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:45.137977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 700/1412] 10.222.0.46 () {54 vars in 918 bytes} [Wed Jun 22 10:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:45.142802 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378846a-ea26-41c0-bd4e-c4f012d8ff73 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:45.143088 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378846a-ea26-41c0-bd4e-c4f012d8ff73 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:45.143396 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378846a-ea26-41c0-bd4e-c4f012d8ff73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:45.161842 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-d378846a-ea26-41c0-bd4e-c4f012d8ff73 None None] MFA Rules not processed for user `4ed9a00723ab4af2b633ab7614d178a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:45.163053 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-d378846a-ea26-41c0-bd4e-c4f012d8ff73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:45.172242 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 713/1413] 10.222.0.46 () {58 vars in 1015 bytes} [Wed Jun 22 10:11:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:11:47.676968 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7be511-efe9-443b-ad81-9c52368d5328 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:47.677407 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7be511-efe9-443b-ad81-9c52368d5328 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:47.677502 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7be511-efe9-443b-ad81-9c52368d5328 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:47.678902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:11:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:47.684338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced369f-fb49-44fe-b99b-3b5edd10d37d None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:47.684790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced369f-fb49-44fe-b99b-3b5edd10d37d None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:47.684937 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced369f-fb49-44fe-b99b-3b5edd10d37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:47.702960 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-9ced369f-fb49-44fe-b99b-3b5edd10d37d None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:47.704068 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-9ced369f-fb49-44fe-b99b-3b5edd10d37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:47.712684 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:11:47.755712 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7be511-efe9-443b-ad81-9c52368d5328 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:47.770832 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7be511-efe9-443b-ad81-9c52368d5328 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:47.776294 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b519906-9c5a-4581-89cd-48b424931e39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:47.776937 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b519906-9c5a-4581-89cd-48b424931e39 service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:47.777315 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b519906-9c5a-4581-89cd-48b424931e39 service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:47.777485 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b519906-9c5a-4581-89cd-48b424931e39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:47.786445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b519906-9c5a-4581-89cd-48b424931e39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:47.788195 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b519906-9c5a-4581-89cd-48b424931e39 service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:47.797896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 702/1416] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:11:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:11:48.724189 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d983d-7249-42aa-a291-bd1e02013302 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:48.724746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d983d-7249-42aa-a291-bd1e02013302 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:48.724746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d983d-7249-42aa-a291-bd1e02013302 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:48.726216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:48.731310 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6612db-c431-4cf6-8369-1a1abe3f85e2 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:48.731772 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6612db-c431-4cf6-8369-1a1abe3f85e2 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:48.731868 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6612db-c431-4cf6-8369-1a1abe3f85e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:48.750118 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-8b6612db-c431-4cf6-8369-1a1abe3f85e2 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:48.751322 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-8b6612db-c431-4cf6-8369-1a1abe3f85e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:48.759262 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:11:48.924056 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d983d-7249-42aa-a291-bd1e02013302 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:48.939008 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d983d-7249-42aa-a291-bd1e02013302 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:48.945718 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679da8d-03c7-485b-9615-496842dfb1b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:48.946767 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679da8d-03c7-485b-9615-496842dfb1b6 service nova] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:48.947121 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679da8d-03c7-485b-9615-496842dfb1b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:48.947402 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679da8d-03c7-485b-9615-496842dfb1b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:48.956788 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679da8d-03c7-485b-9615-496842dfb1b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:48.959016 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679da8d-03c7-485b-9615-496842dfb1b6 service nova] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:48.968938 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 716/1419] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:11:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:11:49.851347 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab014d-5738-45b7-bd39-3706ee07c1ed None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:49.851912 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab014d-5738-45b7-bd39-3706ee07c1ed None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:49.851912 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab014d-5738-45b7-bd39-3706ee07c1ed None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:49.853353 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:11:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:49.858504 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0711e-abe9-4ccd-839e-8a958fd070f4 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:49.859058 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0711e-abe9-4ccd-839e-8a958fd070f4 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:49.859168 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0711e-abe9-4ccd-839e-8a958fd070f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:49.877046 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-0bb0711e-abe9-4ccd-839e-8a958fd070f4 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:49.878302 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-0bb0711e-abe9-4ccd-839e-8a958fd070f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:49.887259 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:11:50.047970 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab014d-5738-45b7-bd39-3706ee07c1ed None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:50.062279 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab014d-5738-45b7-bd39-3706ee07c1ed None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:50.067889 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab7767-2089-445e-bcb7-31f6a08c6a4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:50.068529 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab7767-2089-445e-bcb7-31f6a08c6a4d service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:50.068812 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab7767-2089-445e-bcb7-31f6a08c6a4d service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:50.069139 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab7767-2089-445e-bcb7-31f6a08c6a4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:50.077524 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab7767-2089-445e-bcb7-31f6a08c6a4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:50.079116 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab7767-2089-445e-bcb7-31f6a08c6a4d service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:50.089259 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 705/1422] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:11:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:11:50.960578 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d516c-2787-4ac7-8a5c-3fb60c97385d None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:50.961151 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d516c-2787-4ac7-8a5c-3fb60c97385d None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:50.961151 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d516c-2787-4ac7-8a5c-3fb60c97385d None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:50.962600 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:50.967746 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b39a9-07b8-4a40-8dcc-6cafcbcf4c60 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:50.968211 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b39a9-07b8-4a40-8dcc-6cafcbcf4c60 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:50.968339 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b39a9-07b8-4a40-8dcc-6cafcbcf4c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:50.994375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-1c6b39a9-07b8-4a40-8dcc-6cafcbcf4c60 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:50.996468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-1c6b39a9-07b8-4a40-8dcc-6cafcbcf4c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:51.005841 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:11:51.157401 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d516c-2787-4ac7-8a5c-3fb60c97385d None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:51.172215 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d516c-2787-4ac7-8a5c-3fb60c97385d None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:51.179776 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d78c92-c0ca-4189-9d49-83995bbf0dc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:51.180422 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d78c92-c0ca-4189-9d49-83995bbf0dc9 service nova] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:51.180734 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d78c92-c0ca-4189-9d49-83995bbf0dc9 service nova] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:51.181042 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d78c92-c0ca-4189-9d49-83995bbf0dc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:51.189435 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d78c92-c0ca-4189-9d49-83995bbf0dc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:51.191040 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d78c92-c0ca-4189-9d49-83995bbf0dc9 service nova] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:51.200373 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 719/1425] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:11:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:11:52.069858 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07ad1b-c807-4f0d-951b-f780a815b557 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:52.070407 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07ad1b-c807-4f0d-951b-f780a815b557 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:52.070407 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07ad1b-c807-4f0d-951b-f780a815b557 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:52.071831 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:52.076769 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500ae6a-9dd2-4ce1-9285-b9787a834765 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:52.077201 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500ae6a-9dd2-4ce1-9285-b9787a834765 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:52.077345 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500ae6a-9dd2-4ce1-9285-b9787a834765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:52.095589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-5500ae6a-9dd2-4ce1-9285-b9787a834765 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:52.096784 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-5500ae6a-9dd2-4ce1-9285-b9787a834765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:52.104616 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:11:52.255137 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07ad1b-c807-4f0d-951b-f780a815b557 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:52.269376 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07ad1b-c807-4f0d-951b-f780a815b557 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:52.275363 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37fe68-c6ef-4323-ac39-0b284bcbf7da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:52.275363 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37fe68-c6ef-4323-ac39-0b284bcbf7da service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:52.275600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37fe68-c6ef-4323-ac39-0b284bcbf7da service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:52.275840 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37fe68-c6ef-4323-ac39-0b284bcbf7da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:52.283978 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37fe68-c6ef-4323-ac39-0b284bcbf7da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:52.285602 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37fe68-c6ef-4323-ac39-0b284bcbf7da service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:52.296264 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 708/1428] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:11:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:11:53.160163 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2924cd-f1cc-4392-b79d-58aa5c9e4c5e None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:53.160703 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2924cd-f1cc-4392-b79d-58aa5c9e4c5e None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:53.160703 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2924cd-f1cc-4392-b79d-58aa5c9e4c5e None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:53.162116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:11:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:53.167253 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f311e2-fc7a-45cc-9c5b-1ef451564efe None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:53.167673 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f311e2-fc7a-45cc-9c5b-1ef451564efe None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:53.167838 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f311e2-fc7a-45cc-9c5b-1ef451564efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:53.186274 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-47f311e2-fc7a-45cc-9c5b-1ef451564efe None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:53.187488 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-47f311e2-fc7a-45cc-9c5b-1ef451564efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:53.196060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:11:53.351513 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2924cd-f1cc-4392-b79d-58aa5c9e4c5e None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:53.365815 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2924cd-f1cc-4392-b79d-58aa5c9e4c5e None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:53.371334 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32c994-c05c-4b12-af8c-0ffdd2d4efb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:53.371984 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32c994-c05c-4b12-af8c-0ffdd2d4efb8 service nova] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:53.372273 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32c994-c05c-4b12-af8c-0ffdd2d4efb8 service nova] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:53.372584 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32c994-c05c-4b12-af8c-0ffdd2d4efb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:53.381752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b32c994-c05c-4b12-af8c-0ffdd2d4efb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:53.383324 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b32c994-c05c-4b12-af8c-0ffdd2d4efb8 service nova] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:53.393042 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 722/1431] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:11:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:11:54.259781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c18d0-b24a-4f4f-b78a-3c8f283dec89 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:54.260349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c18d0-b24a-4f4f-b78a-3c8f283dec89 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:54.260349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c18d0-b24a-4f4f-b78a-3c8f283dec89 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:54.261775 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:54.266923 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae71cb-2582-4f65-9d12-f115e41a6da0 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:54.267332 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae71cb-2582-4f65-9d12-f115e41a6da0 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:54.267480 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae71cb-2582-4f65-9d12-f115e41a6da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:54.285783 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-7fae71cb-2582-4f65-9d12-f115e41a6da0 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:54.286983 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-7fae71cb-2582-4f65-9d12-f115e41a6da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:54.294772 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:11:54.447965 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c18d0-b24a-4f4f-b78a-3c8f283dec89 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:54.462942 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c18d0-b24a-4f4f-b78a-3c8f283dec89 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:54.468418 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f5e4e-6203-4cc0-bc16-146ddeecdc3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:54.469095 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f5e4e-6203-4cc0-bc16-146ddeecdc3f service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:54.469376 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f5e4e-6203-4cc0-bc16-146ddeecdc3f service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:54.469650 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f5e4e-6203-4cc0-bc16-146ddeecdc3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:54.478959 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f5e4e-6203-4cc0-bc16-146ddeecdc3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:54.480553 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f5e4e-6203-4cc0-bc16-146ddeecdc3f service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:54.490414 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 711/1434] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:11:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:11:55.367868 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa7238-cad5-4a8c-b155-3843368aa18b None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:55.368424 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa7238-cad5-4a8c-b155-3843368aa18b None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:55.368424 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa7238-cad5-4a8c-b155-3843368aa18b None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:55.369749 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:55.375082 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092fa67-39af-4784-a6c5-e54957ee6496 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:55.375518 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092fa67-39af-4784-a6c5-e54957ee6496 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:55.375633 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092fa67-39af-4784-a6c5-e54957ee6496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:55.394915 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-c092fa67-39af-4784-a6c5-e54957ee6496 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:55.396174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-c092fa67-39af-4784-a6c5-e54957ee6496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:55.404144 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:11:55.553580 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa7238-cad5-4a8c-b155-3843368aa18b None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:55.568315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa7238-cad5-4a8c-b155-3843368aa18b None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:55.573709 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c41d60-5635-4cd3-b1c5-f7a5f04bb444 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:55.574344 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c41d60-5635-4cd3-b1c5-f7a5f04bb444 service nova] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:55.574627 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c41d60-5635-4cd3-b1c5-f7a5f04bb444 service nova] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:55.574904 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c41d60-5635-4cd3-b1c5-f7a5f04bb444 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:55.584141 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c41d60-5635-4cd3-b1c5-f7a5f04bb444 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:55.585771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c41d60-5635-4cd3-b1c5-f7a5f04bb444 service nova] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:55.598140 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 725/1437] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:11:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:11:56.467372 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6605d4-53a0-4c32-ac72-4cedeca5adb2 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:56.467947 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6605d4-53a0-4c32-ac72-4cedeca5adb2 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:56.467947 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6605d4-53a0-4c32-ac72-4cedeca5adb2 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:56.469376 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:56.475311 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996eb3b6-9cc1-429f-bca3-1981fa52eff7 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:56.475758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996eb3b6-9cc1-429f-bca3-1981fa52eff7 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:56.475862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996eb3b6-9cc1-429f-bca3-1981fa52eff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:56.493507 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-996eb3b6-9cc1-429f-bca3-1981fa52eff7 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:56.494707 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-996eb3b6-9cc1-429f-bca3-1981fa52eff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:56.503122 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:11:56.654299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6605d4-53a0-4c32-ac72-4cedeca5adb2 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:56.668854 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6605d4-53a0-4c32-ac72-4cedeca5adb2 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:56.675023 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5415308-ca37-4b3d-ab36-73d628cdf3d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:56.675678 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5415308-ca37-4b3d-ab36-73d628cdf3d5 service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:56.675958 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5415308-ca37-4b3d-ab36-73d628cdf3d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:56.676237 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5415308-ca37-4b3d-ab36-73d628cdf3d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:56.685169 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5415308-ca37-4b3d-ab36-73d628cdf3d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:56.686801 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5415308-ca37-4b3d-ab36-73d628cdf3d5 service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:56.697127 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 714/1440] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:11:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:11:58.644920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63677b-a8ce-40c8-9c83-b95abe2a50cc None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:58.645443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63677b-a8ce-40c8-9c83-b95abe2a50cc None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:58.645443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63677b-a8ce-40c8-9c83-b95abe2a50cc None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:58.646839 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:11:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:58.652349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226da31-5d3f-4976-961b-723b0fa1eb68 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:58.652795 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226da31-5d3f-4976-961b-723b0fa1eb68 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:58.652922 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226da31-5d3f-4976-961b-723b0fa1eb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:58.670939 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-8226da31-5d3f-4976-961b-723b0fa1eb68 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:58.672200 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-8226da31-5d3f-4976-961b-723b0fa1eb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:58.682106 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:11:58.722013 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63677b-a8ce-40c8-9c83-b95abe2a50cc None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:58.732724 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63677b-a8ce-40c8-9c83-b95abe2a50cc None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:58.736439 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1250ae4-4d92-488d-b442-2eef68b0899b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:58.737118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1250ae4-4d92-488d-b442-2eef68b0899b service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:58.737403 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1250ae4-4d92-488d-b442-2eef68b0899b service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:58.737709 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1250ae4-4d92-488d-b442-2eef68b0899b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:58.747040 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1250ae4-4d92-488d-b442-2eef68b0899b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:58.748507 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1250ae4-4d92-488d-b442-2eef68b0899b service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:58.759251 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 728/1443] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:11:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:12:00.944630 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b247b-8ec8-41a3-ae68-715ae8234840 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:00.945230 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b247b-8ec8-41a3-ae68-715ae8234840 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:00.945230 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b247b-8ec8-41a3-ae68-715ae8234840 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:00.946543 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:12:00.951888 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3ea5f-ceb2-49f1-b742-0509e394dfc4 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:00.952445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3ea5f-ceb2-49f1-b742-0509e394dfc4 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:00.952445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3ea5f-ceb2-49f1-b742-0509e394dfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:00.970382 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-e9b3ea5f-ceb2-49f1-b742-0509e394dfc4 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:12:00.971606 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-e9b3ea5f-ceb2-49f1-b742-0509e394dfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:00.979339 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:12:01.017257 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b247b-8ec8-41a3-ae68-715ae8234840 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:12:01.028360 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b247b-8ec8-41a3-ae68-715ae8234840 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:12:01.031816 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b786876-9bb1-434c-8c1a-e8b0ccc41ee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:12:01.032446 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b786876-9bb1-434c-8c1a-e8b0ccc41ee1 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:01.032725 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b786876-9bb1-434c-8c1a-e8b0ccc41ee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:01.033029 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b786876-9bb1-434c-8c1a-e8b0ccc41ee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:01.042141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b786876-9bb1-434c-8c1a-e8b0ccc41ee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:12:01.043586 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b786876-9bb1-434c-8c1a-e8b0ccc41ee1 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:12:01.054313 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 717/1446] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:12:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:12:03.486621 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa68e8f-903c-46ad-a522-886fda325319 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:03.487193 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa68e8f-903c-46ad-a522-886fda325319 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:03.487193 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa68e8f-903c-46ad-a522-886fda325319 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:03.488564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:12:03.493808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae4dd9-d592-4d63-8ca1-fc4ba3931426 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:03.494218 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae4dd9-d592-4d63-8ca1-fc4ba3931426 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:03.494366 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae4dd9-d592-4d63-8ca1-fc4ba3931426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:03.511806 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-00ae4dd9-d592-4d63-8ca1-fc4ba3931426 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:12:03.513028 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-00ae4dd9-d592-4d63-8ca1-fc4ba3931426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:03.521323 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:12:03.559863 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa68e8f-903c-46ad-a522-886fda325319 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:12:03.570478 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa68e8f-903c-46ad-a522-886fda325319 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:12:03.573989 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d52538-cd95-418a-82e6-a988daed64d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:12:03.574623 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d52538-cd95-418a-82e6-a988daed64d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:03.574909 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d52538-cd95-418a-82e6-a988daed64d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:03.575185 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d52538-cd95-418a-82e6-a988daed64d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:03.584496 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d52538-cd95-418a-82e6-a988daed64d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:12:03.585947 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d52538-cd95-418a-82e6-a988daed64d4 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:12:03.595205 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 731/1449] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:12:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:12:05.766132 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398badb-2ad3-4614-bb42-f84153b8317e None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:05.766829 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398badb-2ad3-4614-bb42-f84153b8317e None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:05.766829 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398badb-2ad3-4614-bb42-f84153b8317e None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:05.768290 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:12:05.773738 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23b255-e130-4bc5-91a6-5e0172afab9e None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:05.774212 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23b255-e130-4bc5-91a6-5e0172afab9e None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:05.774319 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23b255-e130-4bc5-91a6-5e0172afab9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:05.792081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-0a23b255-e130-4bc5-91a6-5e0172afab9e None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:12:05.793326 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-0a23b255-e130-4bc5-91a6-5e0172afab9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:05.802186 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:12:05.841387 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398badb-2ad3-4614-bb42-f84153b8317e None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:12:05.843105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-e398badb-2ad3-4614-bb42-f84153b8317e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:05.856057 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398badb-2ad3-4614-bb42-f84153b8317e None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:12:05.859684 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86b253-49ff-4abd-a568-7a9f61da0143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:12:05.860326 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86b253-49ff-4abd-a568-7a9f61da0143 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:05.860613 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86b253-49ff-4abd-a568-7a9f61da0143 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:05.861420 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86b253-49ff-4abd-a568-7a9f61da0143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:05.870633 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86b253-49ff-4abd-a568-7a9f61da0143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:12:05.872066 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86b253-49ff-4abd-a568-7a9f61da0143 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:12:05.882228 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 720/1452] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:12:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:12:08.043645 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ac263-f92a-4e15-bd2f-8e4e78ba2dee None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:08.044182 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ac263-f92a-4e15-bd2f-8e4e78ba2dee None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:08.044182 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ac263-f92a-4e15-bd2f-8e4e78ba2dee None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:08.045618 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:12:08.051507 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f3de9-8900-4f70-9e7a-ec639484e6e6 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:08.052127 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f3de9-8900-4f70-9e7a-ec639484e6e6 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:08.052127 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f3de9-8900-4f70-9e7a-ec639484e6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:08.072474 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-411f3de9-8900-4f70-9e7a-ec639484e6e6 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:12:08.073707 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-411f3de9-8900-4f70-9e7a-ec639484e6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:08.082375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:12:08.120793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ac263-f92a-4e15-bd2f-8e4e78ba2dee None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:12:08.131832 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ac263-f92a-4e15-bd2f-8e4e78ba2dee None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:12:08.135357 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d7615-2c2f-4c72-9444-b12403f2d719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:12:08.135989 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d7615-2c2f-4c72-9444-b12403f2d719 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:08.136269 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d7615-2c2f-4c72-9444-b12403f2d719 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:08.136545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d7615-2c2f-4c72-9444-b12403f2d719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:08.145957 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d7615-2c2f-4c72-9444-b12403f2d719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:12:08.147368 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d7615-2c2f-4c72-9444-b12403f2d719 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:12:08.156704 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 734/1455] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:12:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:12:10.282125 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf24ab2-14ff-409f-8622-78fb4742b12f None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:10.283303 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf24ab2-14ff-409f-8622-78fb4742b12f None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:10.283303 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf24ab2-14ff-409f-8622-78fb4742b12f None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:10.284595 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:12:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:12:10.289820 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e7659-8d6f-4813-b2df-0978143599e2 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:10.290293 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e7659-8d6f-4813-b2df-0978143599e2 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:10.290400 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e7659-8d6f-4813-b2df-0978143599e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:10.308030 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-d45e7659-8d6f-4813-b2df-0978143599e2 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:12:10.309251 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-d45e7659-8d6f-4813-b2df-0978143599e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:10.316943 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:12:10.354728 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf24ab2-14ff-409f-8622-78fb4742b12f None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:12:10.365457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf24ab2-14ff-409f-8622-78fb4742b12f None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:12:10.368956 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979aa67-3100-4fde-8f0e-336b746cbe9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:12:10.369590 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979aa67-3100-4fde-8f0e-336b746cbe9e service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:10.369868 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979aa67-3100-4fde-8f0e-336b746cbe9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:10.370139 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979aa67-3100-4fde-8f0e-336b746cbe9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:10.379212 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979aa67-3100-4fde-8f0e-336b746cbe9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:12:10.380625 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979aa67-3100-4fde-8f0e-336b746cbe9e service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:12:10.394172 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 723/1458] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:12:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:12:12.486428 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc40b04-9ad7-4da2-bb1b-645191afb3ca None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:12.487017 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc40b04-9ad7-4da2-bb1b-645191afb3ca None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:12.487017 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc40b04-9ad7-4da2-bb1b-645191afb3ca None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:12.488359 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:12:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:12:12.493615 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e28f0e-a682-45a6-9ac5-968ea5da8aae None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:12.494034 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e28f0e-a682-45a6-9ac5-968ea5da8aae None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:12.494173 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e28f0e-a682-45a6-9ac5-968ea5da8aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:12.500140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=70 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:12:12.512643 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-37e28f0e-a682-45a6-9ac5-968ea5da8aae None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:12:12.518205 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-37e28f0e-a682-45a6-9ac5-968ea5da8aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:12.522163 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:12:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:12:12.559568 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc40b04-9ad7-4da2-bb1b-645191afb3ca None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:12:12.565521 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=73 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:12:12.571005 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc40b04-9ad7-4da2-bb1b-645191afb3ca None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:12:12.575350 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039278e-d3e9-4c11-afad-b10588a6d950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:12:12.575350 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039278e-d3e9-4c11-afad-b10588a6d950 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:12.575731 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039278e-d3e9-4c11-afad-b10588a6d950 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:12.575860 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039278e-d3e9-4c11-afad-b10588a6d950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:12.584953 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9039278e-d3e9-4c11-afad-b10588a6d950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:12:12.586378 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9039278e-d3e9-4c11-afad-b10588a6d950 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:12:12.596582 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 737/1461] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:12:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:12:14.712641 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea78a4-c53c-44cd-bbb2-adb26574fded None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:14.713270 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea78a4-c53c-44cd-bbb2-adb26574fded None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:14.713392 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea78a4-c53c-44cd-bbb2-adb26574fded None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:14.714672 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:12:14.720764 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735ef79-b05b-4902-896d-11fbc38966b6 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:14.721207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735ef79-b05b-4902-896d-11fbc38966b6 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:14.721384 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735ef79-b05b-4902-896d-11fbc38966b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:14.738826 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-7735ef79-b05b-4902-896d-11fbc38966b6 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:12:14.740062 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-7735ef79-b05b-4902-896d-11fbc38966b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:14.748212 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:12:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:12:14.786939 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea78a4-c53c-44cd-bbb2-adb26574fded None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:12:14.799315 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea78a4-c53c-44cd-bbb2-adb26574fded None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:12:14.803319 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eea671-6d3c-49c9-967d-412be158ff73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:12:14.804141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eea671-6d3c-49c9-967d-412be158ff73 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:14.804462 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eea671-6d3c-49c9-967d-412be158ff73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:14.804741 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eea671-6d3c-49c9-967d-412be158ff73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:14.815001 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eea671-6d3c-49c9-967d-412be158ff73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:12:14.816437 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eea671-6d3c-49c9-967d-412be158ff73 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:12:14.826047 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 726/1464] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:12:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:12:16.899943 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a3f8e-e1ef-4a8d-8a9d-865a5270f7ca None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:16.900494 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a3f8e-e1ef-4a8d-8a9d-865a5270f7ca None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:16.900494 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a3f8e-e1ef-4a8d-8a9d-865a5270f7ca None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:16.901948 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:12:16.907268 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3457b9-60f7-43a4-8387-dba31b7ab172 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:16.907689 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3457b9-60f7-43a4-8387-dba31b7ab172 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:16.907831 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3457b9-60f7-43a4-8387-dba31b7ab172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:16.926234 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-5a3457b9-60f7-43a4-8387-dba31b7ab172 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:12:16.927368 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-5a3457b9-60f7-43a4-8387-dba31b7ab172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:16.935210 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:12:16.971837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a3f8e-e1ef-4a8d-8a9d-865a5270f7ca None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:12:16.982865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a3f8e-e1ef-4a8d-8a9d-865a5270f7ca None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:12:16.987029 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301a944-5cc1-47e4-b23e-319040088f39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:12:16.987677 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301a944-5cc1-47e4-b23e-319040088f39 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:16.987970 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301a944-5cc1-47e4-b23e-319040088f39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:16.988270 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301a944-5cc1-47e4-b23e-319040088f39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:16.997322 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301a944-5cc1-47e4-b23e-319040088f39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:12:16.998747 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301a944-5cc1-47e4-b23e-319040088f39 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:12:17.008624 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 740/1467] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:12:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:12:19.052281 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a87dc7-4c86-41bf-b5b3-ec6a5b5d1109 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:19.052875 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a87dc7-4c86-41bf-b5b3-ec6a5b5d1109 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:19.052875 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a87dc7-4c86-41bf-b5b3-ec6a5b5d1109 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:19.054279 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:12:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:12:19.059550 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7f220-a20b-4b7d-8f22-37facc2965b0 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:19.059977 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7f220-a20b-4b7d-8f22-37facc2965b0 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:19.060109 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7f220-a20b-4b7d-8f22-37facc2965b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:19.077361 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-9fd7f220-a20b-4b7d-8f22-37facc2965b0 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:12:19.079106 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-9fd7f220-a20b-4b7d-8f22-37facc2965b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:19.087108 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:12:19.127838 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a87dc7-4c86-41bf-b5b3-ec6a5b5d1109 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:12:19.138530 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a87dc7-4c86-41bf-b5b3-ec6a5b5d1109 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:12:19.142560 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd866b7-cabb-4778-a7fe-76a85a446657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:12:19.143206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd866b7-cabb-4778-a7fe-76a85a446657 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:19.143491 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd866b7-cabb-4778-a7fe-76a85a446657 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:19.143769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd866b7-cabb-4778-a7fe-76a85a446657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:19.152645 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd866b7-cabb-4778-a7fe-76a85a446657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:12:19.154125 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd866b7-cabb-4778-a7fe-76a85a446657 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:12:19.164220 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 729/1470] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:12:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:12:29.072324 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=17 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:12:29.159914 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=17 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:12:39.154124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890c09d-d6e4-4184-a1e3-f9047ce495a3 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:39.154752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890c09d-d6e4-4184-a1e3-f9047ce495a3 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:39.154752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890c09d-d6e4-4184-a1e3-f9047ce495a3 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:39.156573 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 742/1471] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:12:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:12:39.163016 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8460baa-4b9f-4b18-82b7-5bb9a030432d None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:39.163555 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8460baa-4b9f-4b18-82b7-5bb9a030432d None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:39.163555 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8460baa-4b9f-4b18-82b7-5bb9a030432d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:39.185659 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-c8460baa-4b9f-4b18-82b7-5bb9a030432d None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:12:39.186953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-c8460baa-4b9f-4b18-82b7-5bb9a030432d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:39.198381 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 730/1472] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:12:39.249283 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa5930-0f5b-4ac1-b255-1253d2682871 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:39.249567 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa5930-0f5b-4ac1-b255-1253d2682871 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:39.249843 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa5930-0f5b-4ac1-b255-1253d2682871 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:39.251275 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 743/1473] 10.222.0.46 () {54 vars in 962 bytes} [Wed Jun 22 10:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:12:39.259697 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73a168-d746-45f2-8456-dff133a1d225 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:39.259986 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73a168-d746-45f2-8456-dff133a1d225 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:39.260259 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73a168-d746-45f2-8456-dff133a1d225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:39.278923 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-8f73a168-d746-45f2-8456-dff133a1d225 None None] MFA Rules not processed for user `4a4fbf9b051940bd82547a700796d118`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:12:39.280644 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-8f73a168-d746-45f2-8456-dff133a1d225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:39.290366 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 731/1474] 10.222.0.46 () {58 vars in 1059 bytes} [Wed Jun 22 10:12:39 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:12:39.299628 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa5930-0f5b-4ac1-b255-1253d2682871 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:12:39.310340 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa5930-0f5b-4ac1-b255-1253d2682871 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:12:39.315337 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ba343-a420-4ab0-8ab5-bc047d2b60c2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4fbf9b051940bd82547a700796d118', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:12:39.315982 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ba343-a420-4ab0-8ab5-bc047d2b60c2 service glance] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:39.316268 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ba343-a420-4ab0-8ab5-bc047d2b60c2 service glance] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:39.316550 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ba343-a420-4ab0-8ab5-bc047d2b60c2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:39.329008 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ba343-a420-4ab0-8ab5-bc047d2b60c2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:12:39.330430 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ba343-a420-4ab0-8ab5-bc047d2b60c2 service glance] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:12:39.341736 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 744/1475] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:12:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:12:41.482496 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df128ea-7d28-4183-9ab3-f332d3657d18 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:41.483686 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df128ea-7d28-4183-9ab3-f332d3657d18 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:41.483686 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df128ea-7d28-4183-9ab3-f332d3657d18 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:41.485038 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 732/1476] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:12:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:12:41.490230 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c2178-c96c-44d3-97f2-284fcc053f24 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:41.490632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c2178-c96c-44d3-97f2-284fcc053f24 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:41.490793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c2178-c96c-44d3-97f2-284fcc053f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:41.507967 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-394c2178-c96c-44d3-97f2-284fcc053f24 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:12:41.509201 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-394c2178-c96c-44d3-97f2-284fcc053f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:41.517029 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 745/1477] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:12:41.540599 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df128ea-7d28-4183-9ab3-f332d3657d18 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:12:41.553797 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df128ea-7d28-4183-9ab3-f332d3657d18 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:12:41.558351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be68437-32bf-4329-8c71-9aa5ddbb35b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:12:41.558992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be68437-32bf-4329-8c71-9aa5ddbb35b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:41.559273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be68437-32bf-4329-8c71-9aa5ddbb35b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:41.559548 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be68437-32bf-4329-8c71-9aa5ddbb35b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:41.560300 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be68437-32bf-4329-8c71-9aa5ddbb35b3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:12:41.562127 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: WARNING py.warnings [None req-3be68437-32bf-4329-8c71-9aa5ddbb35b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:12:41.562127 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: warnings.warn(msg) Jun 22 10:12:41.562127 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: Jun 22 10:12:41.563272 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be68437-32bf-4329-8c71-9aa5ddbb35b3 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:12:41.583049 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 733/1478] 10.222.0.46 () {56 vars in 1108 bytes} [Wed Jun 22 10:12:41 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:12:43.672308 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2dfc3-57b1-4439-8a0a-68efbb24424c None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:43.672723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2dfc3-57b1-4439-8a0a-68efbb24424c None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:43.672891 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2dfc3-57b1-4439-8a0a-68efbb24424c None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:43.674284 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 746/1479] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:12:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:12:43.679651 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4cd1b-1d39-42a3-8b18-9a9abb5bb2e5 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:43.680077 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4cd1b-1d39-42a3-8b18-9a9abb5bb2e5 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:43.680212 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4cd1b-1d39-42a3-8b18-9a9abb5bb2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:43.697981 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-f8b4cd1b-1d39-42a3-8b18-9a9abb5bb2e5 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:12:43.699190 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-f8b4cd1b-1d39-42a3-8b18-9a9abb5bb2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:43.707180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 734/1480] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:12:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:12:43.750568 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2dfc3-57b1-4439-8a0a-68efbb24424c None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:12:43.765309 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2dfc3-57b1-4439-8a0a-68efbb24424c None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:12:43.770636 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9aa75-16b7-4b21-a06b-b346e0b5845c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:12:43.771278 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9aa75-16b7-4b21-a06b-b346e0b5845c service nova] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:43.771562 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9aa75-16b7-4b21-a06b-b346e0b5845c service nova] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:43.771840 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9aa75-16b7-4b21-a06b-b346e0b5845c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:43.781024 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9aa75-16b7-4b21-a06b-b346e0b5845c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:12:43.782714 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9aa75-16b7-4b21-a06b-b346e0b5845c service nova] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:12:43.792682 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 747/1481] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:12:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:12:46.026461 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce289b9-4b10-45ec-85d9-05d9f50b97be None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:46.026987 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce289b9-4b10-45ec-85d9-05d9f50b97be None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:46.026987 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce289b9-4b10-45ec-85d9-05d9f50b97be None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:46.028353 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 735/1482] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:12:46.034090 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8f58e-04f9-495f-8d02-b9772c7097a2 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:46.034607 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8f58e-04f9-495f-8d02-b9772c7097a2 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:46.034703 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8f58e-04f9-495f-8d02-b9772c7097a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:46.052732 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-0cc8f58e-04f9-495f-8d02-b9772c7097a2 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:12:46.053961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-0cc8f58e-04f9-495f-8d02-b9772c7097a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:46.061741 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 748/1483] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:12:46.098571 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce289b9-4b10-45ec-85d9-05d9f50b97be None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:12:46.109747 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce289b9-4b10-45ec-85d9-05d9f50b97be None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:12:46.113297 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575688cf-42b9-486c-bf92-17f03f67d6b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:12:46.113937 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575688cf-42b9-486c-bf92-17f03f67d6b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:46.114222 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575688cf-42b9-486c-bf92-17f03f67d6b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:46.114503 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575688cf-42b9-486c-bf92-17f03f67d6b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:46.123492 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575688cf-42b9-486c-bf92-17f03f67d6b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:12:46.124971 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575688cf-42b9-486c-bf92-17f03f67d6b0 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:12:46.134411 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 736/1484] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:12:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:12:48.221431 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e3265-5b88-4aae-9170-aa66001ca115 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:48.221971 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e3265-5b88-4aae-9170-aa66001ca115 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:48.221971 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e3265-5b88-4aae-9170-aa66001ca115 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:48.226847 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 749/1485] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:12:48.228700 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a6b76-66d5-4f61-960a-a8d24d7e648c None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:48.229244 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a6b76-66d5-4f61-960a-a8d24d7e648c None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:48.229354 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a6b76-66d5-4f61-960a-a8d24d7e648c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:48.246726 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-a61a6b76-66d5-4f61-960a-a8d24d7e648c None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:12:48.248449 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-a61a6b76-66d5-4f61-960a-a8d24d7e648c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:48.256415 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 737/1486] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:12:48.294671 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e3265-5b88-4aae-9170-aa66001ca115 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:12:48.306267 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e3265-5b88-4aae-9170-aa66001ca115 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:12:48.309858 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b023ba3-899e-4b0e-bb34-08ec1e891def service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:12:48.310514 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b023ba3-899e-4b0e-bb34-08ec1e891def service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:48.310801 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b023ba3-899e-4b0e-bb34-08ec1e891def service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:48.311081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b023ba3-899e-4b0e-bb34-08ec1e891def service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:48.319993 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b023ba3-899e-4b0e-bb34-08ec1e891def service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:12:48.321440 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b023ba3-899e-4b0e-bb34-08ec1e891def service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:12:48.331250 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 750/1487] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:12:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:12:50.480251 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c57ad5-906c-44ca-bcad-4f6f14082249 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:50.480887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c57ad5-906c-44ca-bcad-4f6f14082249 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:50.480887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c57ad5-906c-44ca-bcad-4f6f14082249 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:50.482261 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 738/1488] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:12:50.487358 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7b80c-2e79-48da-9c4b-ed13801c6885 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:50.487769 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7b80c-2e79-48da-9c4b-ed13801c6885 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:50.487923 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7b80c-2e79-48da-9c4b-ed13801c6885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:50.506424 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-8de7b80c-2e79-48da-9c4b-ed13801c6885 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:12:50.507648 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-8de7b80c-2e79-48da-9c4b-ed13801c6885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:50.516274 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 751/1489] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:12:50.556804 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c57ad5-906c-44ca-bcad-4f6f14082249 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:12:50.568221 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c57ad5-906c-44ca-bcad-4f6f14082249 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:12:50.571809 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efecaae-cc7e-4867-ac6d-7426b5812aaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:12:50.572437 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efecaae-cc7e-4867-ac6d-7426b5812aaf service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:50.572718 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efecaae-cc7e-4867-ac6d-7426b5812aaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:50.573026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efecaae-cc7e-4867-ac6d-7426b5812aaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:50.581798 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efecaae-cc7e-4867-ac6d-7426b5812aaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:12:50.583237 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efecaae-cc7e-4867-ac6d-7426b5812aaf service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:12:50.593090 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 739/1490] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:12:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:12:53.254957 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271011ab-f399-437b-8c25-e99fe241e0f0 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:53.255503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271011ab-f399-437b-8c25-e99fe241e0f0 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:53.255503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271011ab-f399-437b-8c25-e99fe241e0f0 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:53.256907 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 752/1491] 10.222.0.46 () {54 vars in 926 bytes} [Wed Jun 22 10:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:12:53.262237 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dcafb-f534-4f71-b6e3-cd7198afdfd3 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:53.262676 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dcafb-f534-4f71-b6e3-cd7198afdfd3 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:53.262803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dcafb-f534-4f71-b6e3-cd7198afdfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:53.281194 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-627dcafb-f534-4f71-b6e3-cd7198afdfd3 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:12:53.282406 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-627dcafb-f534-4f71-b6e3-cd7198afdfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:53.290313 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 740/1492] 10.222.0.46 () {58 vars in 1023 bytes} [Wed Jun 22 10:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:12:53.329448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271011ab-f399-437b-8c25-e99fe241e0f0 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:12:53.340316 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271011ab-f399-437b-8c25-e99fe241e0f0 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:12:53.344401 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463590f8-efe7-4d9a-9be4-1bbb4c485d6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:12:53.345082 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463590f8-efe7-4d9a-9be4-1bbb4c485d6f service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:53.345371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463590f8-efe7-4d9a-9be4-1bbb4c485d6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:53.345652 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463590f8-efe7-4d9a-9be4-1bbb4c485d6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:53.354554 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463590f8-efe7-4d9a-9be4-1bbb4c485d6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:12:53.355971 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463590f8-efe7-4d9a-9be4-1bbb4c485d6f service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:12:53.366348 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 753/1493] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:12:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:13:03.275488 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=33 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:13:03.363127 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=33 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:14:34.246722 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e68e1-6fe3-4227-8caa-0b95c2daaa17 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:34.247338 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e68e1-6fe3-4227-8caa-0b95c2daaa17 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:34.247338 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e68e1-6fe3-4227-8caa-0b95c2daaa17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:34.265519 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-bd2e68e1-6fe3-4227-8caa-0b95c2daaa17 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:14:34.266722 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-bd2e68e1-6fe3-4227-8caa-0b95c2daaa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:34.275105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 741/1494] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:14:34.284499 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4df99-2fcb-494d-be3a-412bcc8c8035 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:34.285049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4df99-2fcb-494d-be3a-412bcc8c8035 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:34.285155 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4df99-2fcb-494d-be3a-412bcc8c8035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:34.303510 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-fcf4df99-2fcb-494d-be3a-412bcc8c8035 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:14:34.304701 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-fcf4df99-2fcb-494d-be3a-412bcc8c8035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:34.312395 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 754/1495] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:14:34.317061 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e68e1-6fe3-4227-8caa-0b95c2daaa17 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:14:34.327267 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e68e1-6fe3-4227-8caa-0b95c2daaa17 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:14:34.331787 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7609e-7946-41fc-8f34-fc25732b63e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:14:34.332438 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7609e-7946-41fc-8f34-fc25732b63e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:34.332724 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7609e-7946-41fc-8f34-fc25732b63e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:34.333103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7609e-7946-41fc-8f34-fc25732b63e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:34.334332 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7609e-7946-41fc-8f34-fc25732b63e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:14:34.334642 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7609e-7946-41fc-8f34-fc25732b63e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:14:34.335663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: WARNING py.warnings [None req-ada7609e-7946-41fc-8f34-fc25732b63e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:14:34.335663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: warnings.warn(msg) Jun 22 10:14:34.335663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: Jun 22 10:14:34.336549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7609e-7946-41fc-8f34-fc25732b63e7 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:14:34.348186 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 742/1496] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:14:34.356634 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4df99-2fcb-494d-be3a-412bcc8c8035 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:14:34.366406 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4df99-2fcb-494d-be3a-412bcc8c8035 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:14:34.370958 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e0959-4c64-4f88-8981-6698fecd15d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:14:34.371614 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e0959-4c64-4f88-8981-6698fecd15d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:34.371891 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e0959-4c64-4f88-8981-6698fecd15d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:34.372164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e0959-4c64-4f88-8981-6698fecd15d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:34.372882 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e0959-4c64-4f88-8981-6698fecd15d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:14:34.374644 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: WARNING py.warnings [None req-cf2e0959-4c64-4f88-8981-6698fecd15d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:14:34.374644 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: warnings.warn(msg) Jun 22 10:14:34.374644 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: Jun 22 10:14:34.375823 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e0959-4c64-4f88-8981-6698fecd15d0 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:14:34.580366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 755/1497] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:14:34 2022] POST /identity/v3/projects => generated 377 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:14:34.585219 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7609e-7946-41fc-8f34-fc25732b63e7 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:14:34.595212 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7609e-7946-41fc-8f34-fc25732b63e7 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:14:34.651273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a27480-1a72-4e02-9684-facf888d0fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:14:34.651949 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a27480-1a72-4e02-9684-facf888d0fec admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:34.652226 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a27480-1a72-4e02-9684-facf888d0fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:34.652511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a27480-1a72-4e02-9684-facf888d0fec admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:34.653232 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a27480-1a72-4e02-9684-facf888d0fec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:14:34.654253 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: WARNING py.warnings [None req-91a27480-1a72-4e02-9684-facf888d0fec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:14:34.654253 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: warnings.warn(msg) Jun 22 10:14:34.654253 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: Jun 22 10:14:34.655480 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a27480-1a72-4e02-9684-facf888d0fec admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:14:34.756794 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 743/1498] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:14:34 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:14:34.761121 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e0959-4c64-4f88-8981-6698fecd15d0 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:14:34.771948 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e0959-4c64-4f88-8981-6698fecd15d0 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:14:34.776498 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0207ed-07fc-4030-a23f-6a8b1c091271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:14:34.777238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0207ed-07fc-4030-a23f-6a8b1c091271 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:34.777525 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0207ed-07fc-4030-a23f-6a8b1c091271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:34.777864 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0207ed-07fc-4030-a23f-6a8b1c091271 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:34.778563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0207ed-07fc-4030-a23f-6a8b1c091271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:14:34.779579 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: WARNING py.warnings [None req-ae0207ed-07fc-4030-a23f-6a8b1c091271 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:14:34.779579 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: warnings.warn(msg) Jun 22 10:14:34.779579 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: Jun 22 10:14:34.780460 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0207ed-07fc-4030-a23f-6a8b1c091271 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:14:34.794085 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 756/1499] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:14:34.798197 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a27480-1a72-4e02-9684-facf888d0fec admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:14:34.808113 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a27480-1a72-4e02-9684-facf888d0fec admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:14:34.812904 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9699b-6374-45a9-8dc2-5c861be4beef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:14:34.813562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9699b-6374-45a9-8dc2-5c861be4beef admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:34.813851 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9699b-6374-45a9-8dc2-5c861be4beef admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:34.814128 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9699b-6374-45a9-8dc2-5c861be4beef admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:34.814857 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9699b-6374-45a9-8dc2-5c861be4beef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:14:34.815868 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: WARNING py.warnings [None req-edd9699b-6374-45a9-8dc2-5c861be4beef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:14:34.815868 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: warnings.warn(msg) Jun 22 10:14:34.815868 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: Jun 22 10:14:34.816762 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9699b-6374-45a9-8dc2-5c861be4beef admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:14:34.830601 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 744/1500] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:14:34.835858 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0207ed-07fc-4030-a23f-6a8b1c091271 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:14:34.845821 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0207ed-07fc-4030-a23f-6a8b1c091271 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:14:34.850321 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274668d-e2c4-4991-98c0-c141aca55455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:14:34.851196 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274668d-e2c4-4991-98c0-c141aca55455 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:34.851479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274668d-e2c4-4991-98c0-c141aca55455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:34.851825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274668d-e2c4-4991-98c0-c141aca55455 admin admin] PATH_INFO: `/v3/projects/dd166261afe14c628df24e387e32eb0b/users/de2acb05df92420fb3e689a73c4cd75b/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:34.866400 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274668d-e2c4-4991-98c0-c141aca55455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd166261afe14c628df24e387e32eb0b, user_id=de2acb05df92420fb3e689a73c4cd75b, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:14:34.867434 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: WARNING py.warnings [None req-d274668d-e2c4-4991-98c0-c141aca55455 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:14:34.867434 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: warnings.warn(msg) Jun 22 10:14:34.867434 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: Jun 22 10:14:34.869401 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274668d-e2c4-4991-98c0-c141aca55455 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:14:34.939450 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 757/1501] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:14:34 2022] PUT /identity/v3/projects/dd166261afe14c628df24e387e32eb0b/users/de2acb05df92420fb3e689a73c4cd75b/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:14:34.951182 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33fe05-16f0-4720-9b81-e1deaf31cc69 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:34.951479 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33fe05-16f0-4720-9b81-e1deaf31cc69 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:34.951760 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33fe05-16f0-4720-9b81-e1deaf31cc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:34.980167 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-5e33fe05-16f0-4720-9b81-e1deaf31cc69 None None] MFA Rules not processed for user `de2acb05df92420fb3e689a73c4cd75b`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:14:34.981934 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-5e33fe05-16f0-4720-9b81-e1deaf31cc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:35.044423 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 745/1502] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:14:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:14:35.057587 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692ee3e-6e70-4396-91bc-37e3931e5e88 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:35.057870 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692ee3e-6e70-4396-91bc-37e3931e5e88 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:35.058141 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692ee3e-6e70-4396-91bc-37e3931e5e88 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:35.059516 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 758/1503] 10.222.0.46 () {54 vars in 963 bytes} [Wed Jun 22 10:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:14:35.064700 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118910d-5289-4726-918f-cb925280ffdf None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:35.065038 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118910d-5289-4726-918f-cb925280ffdf None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:35.065314 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118910d-5289-4726-918f-cb925280ffdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:35.083841 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-9118910d-5289-4726-918f-cb925280ffdf None None] MFA Rules not processed for user `6eea844b342b418895d08eef368bbd24`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:14:35.084995 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-9118910d-5289-4726-918f-cb925280ffdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:35.126471 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:14:35.134815 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 746/1504] 10.222.0.46 () {58 vars in 1060 bytes} [Wed Jun 22 10:14:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:14:35.142644 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692ee3e-6e70-4396-91bc-37e3931e5e88 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:14:35.154058 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692ee3e-6e70-4396-91bc-37e3931e5e88 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:14:35.157676 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7f5b1-a3e4-41e0-a058-97776523fd97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:14:35.158314 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7f5b1-a3e4-41e0-a058-97776523fd97 service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:35.158593 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7f5b1-a3e4-41e0-a058-97776523fd97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:35.158870 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7f5b1-a3e4-41e0-a058-97776523fd97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:35.167731 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7f5b1-a3e4-41e0-a058-97776523fd97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:14:35.169234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7f5b1-a3e4-41e0-a058-97776523fd97 service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:14:35.178902 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 759/1505] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:14:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:14:35.221478 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30251646-2fb3-4689-a794-213cbf8e6e41 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:35.221762 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30251646-2fb3-4689-a794-213cbf8e6e41 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:35.222043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30251646-2fb3-4689-a794-213cbf8e6e41 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:35.223316 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 747/1506] 10.222.0.46 () {52 vars in 829 bytes} [Wed Jun 22 10:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:14:35.226927 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7f5b1-a3e4-41e0-a058-97776523fd97 service cinder] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:14:35.288887 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7f5b1-a3e4-41e0-a058-97776523fd97 service cinder] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:14:35.293558 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100f102-36cd-47ed-b2fb-dac1cb01f89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:14:35.294425 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100f102-36cd-47ed-b2fb-dac1cb01f89b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:35.294711 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100f102-36cd-47ed-b2fb-dac1cb01f89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:35.294992 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100f102-36cd-47ed-b2fb-dac1cb01f89b admin admin] PATH_INFO: `/v3/users/de2acb05df92420fb3e689a73c4cd75b` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:35.296201 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100f102-36cd-47ed-b2fb-dac1cb01f89b admin admin] RBAC: Authorizing `identity:delete_user(user_id=de2acb05df92420fb3e689a73c4cd75b)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:14:35.297253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: WARNING py.warnings [None req-5100f102-36cd-47ed-b2fb-dac1cb01f89b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:14:35.297253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: warnings.warn(msg) Jun 22 10:14:35.297253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: Jun 22 10:14:35.298452 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100f102-36cd-47ed-b2fb-dac1cb01f89b admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:14:35.465097 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-5100f102-36cd-47ed-b2fb-dac1cb01f89b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de2acb05df92420fb3e689a73c4cd75b'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:14:35.465672 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-5100f102-36cd-47ed-b2fb-dac1cb01f89b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de2acb05df92420fb3e689a73c4cd75b'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:14:35.521287 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-5100f102-36cd-47ed-b2fb-dac1cb01f89b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de2acb05df92420fb3e689a73c4cd75b'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:14:35.540661 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-5100f102-36cd-47ed-b2fb-dac1cb01f89b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de2acb05df92420fb3e689a73c4cd75b'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:14:35.549490 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:14:35.554272 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-5100f102-36cd-47ed-b2fb-dac1cb01f89b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de2acb05df92420fb3e689a73c4cd75b'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:14:35.560736 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 760/1507] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:14:35 2022] DELETE /identity/v3/users/de2acb05df92420fb3e689a73c4cd75b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:14:35.565380 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471662e-c905-4ae1-a2b5-6c8730cf2ef3 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:35.565889 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471662e-c905-4ae1-a2b5-6c8730cf2ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:35.566019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471662e-c905-4ae1-a2b5-6c8730cf2ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:35.583334 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-2471662e-c905-4ae1-a2b5-6c8730cf2ef3 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:14:35.584522 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-2471662e-c905-4ae1-a2b5-6c8730cf2ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:35.642566 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 748/1508] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:14:35.653179 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100f102-36cd-47ed-b2fb-dac1cb01f89b admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:14:35.654645 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-5100f102-36cd-47ed-b2fb-dac1cb01f89b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:35.712373 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100f102-36cd-47ed-b2fb-dac1cb01f89b admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:14:35.716210 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a81697-a1f9-41e4-94b7-4a2da6cb235c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:14:35.716806 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a81697-a1f9-41e4-94b7-4a2da6cb235c service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:35.717130 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a81697-a1f9-41e4-94b7-4a2da6cb235c service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:35.717411 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a81697-a1f9-41e4-94b7-4a2da6cb235c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:35.728464 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a81697-a1f9-41e4-94b7-4a2da6cb235c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:14:35.729951 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a81697-a1f9-41e4-94b7-4a2da6cb235c service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:14:35.740103 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 761/1509] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:14:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:14:36.272399 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471662e-c905-4ae1-a2b5-6c8730cf2ef3 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:14:36.273963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-2471662e-c905-4ae1-a2b5-6c8730cf2ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:36.285837 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471662e-c905-4ae1-a2b5-6c8730cf2ef3 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:14:36.293974 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40b20f-7353-48c8-978f-7e68f55e5f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:14:36.293974 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40b20f-7353-48c8-978f-7e68f55e5f6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:36.293974 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40b20f-7353-48c8-978f-7e68f55e5f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:36.293974 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40b20f-7353-48c8-978f-7e68f55e5f6a admin admin] PATH_INFO: `/v3/projects/dd166261afe14c628df24e387e32eb0b` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:36.294346 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40b20f-7353-48c8-978f-7e68f55e5f6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd166261afe14c628df24e387e32eb0b)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:14:36.295076 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: WARNING py.warnings [None req-ff40b20f-7353-48c8-978f-7e68f55e5f6a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:14:36.295076 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: warnings.warn(msg) Jun 22 10:14:36.295076 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: Jun 22 10:14:36.296370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40b20f-7353-48c8-978f-7e68f55e5f6a admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:14:36.423805 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-ff40b20f-7353-48c8-978f-7e68f55e5f6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd166261afe14c628df24e387e32eb0b', 'request_id': 'req-ff40b20f-7353-48c8-978f-7e68f55e5f6a'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:14:36.437526 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-ff40b20f-7353-48c8-978f-7e68f55e5f6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd166261afe14c628df24e387e32eb0b', 'request_id': 'req-ff40b20f-7353-48c8-978f-7e68f55e5f6a'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:14:36.538231 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-ff40b20f-7353-48c8-978f-7e68f55e5f6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd166261afe14c628df24e387e32eb0b', 'request_id': 'req-ff40b20f-7353-48c8-978f-7e68f55e5f6a'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:14:36.550099 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-ff40b20f-7353-48c8-978f-7e68f55e5f6a admin admin] The token cache is being invalidate because project dd166261afe14c628df24e387e32eb0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:14:36.550390 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-ff40b20f-7353-48c8-978f-7e68f55e5f6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:14:36.551153 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-ff40b20f-7353-48c8-978f-7e68f55e5f6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:14:36.553313 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 749/1510] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:14:36 2022] DELETE /identity/v3/projects/dd166261afe14c628df24e387e32eb0b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:14:45.767229 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=29 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:14:46.546899 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:17.783873 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de9504-6cdc-4228-bb10-256c4c940db1 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:17.784469 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de9504-6cdc-4228-bb10-256c4c940db1 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:17.784469 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de9504-6cdc-4228-bb10-256c4c940db1 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:17.785829 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 762/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:16:17.791435 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377486e2-4be9-4f7a-9cf8-17b77a7f188c None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:17.791930 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377486e2-4be9-4f7a-9cf8-17b77a7f188c None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:17.792085 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377486e2-4be9-4f7a-9cf8-17b77a7f188c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:17.820305 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-377486e2-4be9-4f7a-9cf8-17b77a7f188c None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:17.821544 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-377486e2-4be9-4f7a-9cf8-17b77a7f188c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:17.879225 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 750/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:18.039865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de9504-6cdc-4228-bb10-256c4c940db1 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:18.041620 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-10de9504-6cdc-4228-bb10-256c4c940db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:18.115736 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de9504-6cdc-4228-bb10-256c4c940db1 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:18.121196 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a2522-9a71-4673-893b-97d0e50fc1e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:18.121845 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a2522-9a71-4673-893b-97d0e50fc1e7 service nova] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:18.122130 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a2522-9a71-4673-893b-97d0e50fc1e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:18.122407 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a2522-9a71-4673-893b-97d0e50fc1e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:18.131018 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a2522-9a71-4673-893b-97d0e50fc1e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:18.132610 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a2522-9a71-4673-893b-97d0e50fc1e7 service nova] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:18.141932 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 763/1513] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:16:18.976396 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b815f-3944-413e-b6b0-960727352327 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:18.976970 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b815f-3944-413e-b6b0-960727352327 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:18.976970 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b815f-3944-413e-b6b0-960727352327 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:18.978377 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 751/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:16:18.983787 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025d6b6-0bf8-433d-9804-cd04cf9ba9bf None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:18.984260 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025d6b6-0bf8-433d-9804-cd04cf9ba9bf None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:18.984397 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025d6b6-0bf8-433d-9804-cd04cf9ba9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:19.002257 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-b025d6b6-0bf8-433d-9804-cd04cf9ba9bf None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:19.003595 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-b025d6b6-0bf8-433d-9804-cd04cf9ba9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:19.012081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 764/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:16:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:19.165151 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b815f-3944-413e-b6b0-960727352327 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:19.179986 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b815f-3944-413e-b6b0-960727352327 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:19.185721 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebcb4b3-b9cb-4cf5-9aee-4d92dd464f8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:19.186357 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebcb4b3-b9cb-4cf5-9aee-4d92dd464f8c service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:19.186637 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebcb4b3-b9cb-4cf5-9aee-4d92dd464f8c service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:19.186912 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebcb4b3-b9cb-4cf5-9aee-4d92dd464f8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:19.195753 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebcb4b3-b9cb-4cf5-9aee-4d92dd464f8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:19.197441 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebcb4b3-b9cb-4cf5-9aee-4d92dd464f8c service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:19.206743 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 752/1516] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:16:20.859438 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01cf52-b0e1-442e-9a9d-17df56071b9a None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:20.860021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01cf52-b0e1-442e-9a9d-17df56071b9a None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:20.860021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01cf52-b0e1-442e-9a9d-17df56071b9a None None] PATH_INFO: `/v3` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:20.861328 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 765/1517] 10.222.0.62 () {54 vars in 925 bytes} [Wed Jun 22 10:16:20 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:16:20.867529 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e8a06-5442-4923-a0e5-73d194d67b66 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:20.867998 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e8a06-5442-4923-a0e5-73d194d67b66 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:20.868165 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e8a06-5442-4923-a0e5-73d194d67b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:20.892120 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-aa0e8a06-5442-4923-a0e5-73d194d67b66 None None] MFA Rules not processed for user `675892a676054b4f86f9ac12d95f4f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:20.893397 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-aa0e8a06-5442-4923-a0e5-73d194d67b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:20.961727 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 753/1518] 10.222.0.62 () {58 vars in 1015 bytes} [Wed Jun 22 10:16:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:25.001034 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510553d-321d-425a-b487-ac64870f282c None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:25.001578 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510553d-321d-425a-b487-ac64870f282c None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:25.001674 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510553d-321d-425a-b487-ac64870f282c None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:25.002979 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 766/1519] 10.222.0.46 () {54 vars in 960 bytes} [Wed Jun 22 10:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:16:25.008526 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f796db-2f3d-4b5c-aef4-b06aeb25d45b None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:25.009808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f796db-2f3d-4b5c-aef4-b06aeb25d45b None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:25.009808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f796db-2f3d-4b5c-aef4-b06aeb25d45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:25.027952 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-f8f796db-2f3d-4b5c-aef4-b06aeb25d45b None None] MFA Rules not processed for user `675892a676054b4f86f9ac12d95f4f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:25.029205 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-f8f796db-2f3d-4b5c-aef4-b06aeb25d45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:25.037937 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 754/1520] 10.222.0.46 () {58 vars in 1057 bytes} [Wed Jun 22 10:16:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:25.045648 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510553d-321d-425a-b487-ac64870f282c None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:25.058835 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510553d-321d-425a-b487-ac64870f282c None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:25.063813 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548a51d-461a-43b9-9c48-f784fd9be4fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '675892a676054b4f86f9ac12d95f4f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:25.064444 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548a51d-461a-43b9-9c48-f784fd9be4fb service placement] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:25.064732 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548a51d-461a-43b9-9c48-f784fd9be4fb service placement] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:25.065046 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548a51d-461a-43b9-9c48-f784fd9be4fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:25.073702 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548a51d-461a-43b9-9c48-f784fd9be4fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:25.075296 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548a51d-461a-43b9-9c48-f784fd9be4fb service placement] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:25.085574 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 767/1521] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:16:30.468405 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d1487-9ed9-41e8-9870-f85702e738e4 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:30.468982 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d1487-9ed9-41e8-9870-f85702e738e4 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:30.468982 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d1487-9ed9-41e8-9870-f85702e738e4 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:30.470363 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:16:30.475455 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a18c2-0ae8-4f9c-983d-67833642e5a4 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:30.475854 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a18c2-0ae8-4f9c-983d-67833642e5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:30.476049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a18c2-0ae8-4f9c-983d-67833642e5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:30.494425 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-f86a18c2-0ae8-4f9c-983d-67833642e5a4 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:30.495624 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-f86a18c2-0ae8-4f9c-983d-67833642e5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:30.503720 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:30.661358 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d1487-9ed9-41e8-9870-f85702e738e4 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:30.676000 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d1487-9ed9-41e8-9870-f85702e738e4 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:30.682391 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17697220-566c-46fb-b114-8a9b074473d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:30.683051 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17697220-566c-46fb-b114-8a9b074473d9 service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:30.683343 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17697220-566c-46fb-b114-8a9b074473d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:30.683622 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17697220-566c-46fb-b114-8a9b074473d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:30.694293 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17697220-566c-46fb-b114-8a9b074473d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:30.695355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17697220-566c-46fb-b114-8a9b074473d9 service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:30.705662 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 756/1524] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:16:31.521250 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf8578-e380-47d9-b5d1-e7a21f33725d None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:31.521827 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf8578-e380-47d9-b5d1-e7a21f33725d None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:31.521827 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf8578-e380-47d9-b5d1-e7a21f33725d None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:31.523226 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 769/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:16:31.527911 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3059e1e-8c24-4012-a475-42c158905aaa None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:31.528348 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3059e1e-8c24-4012-a475-42c158905aaa None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:31.528480 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3059e1e-8c24-4012-a475-42c158905aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:31.547173 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-a3059e1e-8c24-4012-a475-42c158905aaa None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:31.548360 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-a3059e1e-8c24-4012-a475-42c158905aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:31.557104 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 757/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:31.709331 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf8578-e380-47d9-b5d1-e7a21f33725d None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:31.723730 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf8578-e380-47d9-b5d1-e7a21f33725d None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:31.729797 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463abd4c-d1c7-4a9c-8d4b-5237bc96a462 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:31.730458 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463abd4c-d1c7-4a9c-8d4b-5237bc96a462 service nova] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:31.730749 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463abd4c-d1c7-4a9c-8d4b-5237bc96a462 service nova] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:31.731025 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463abd4c-d1c7-4a9c-8d4b-5237bc96a462 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:31.739133 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463abd4c-d1c7-4a9c-8d4b-5237bc96a462 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:31.741330 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463abd4c-d1c7-4a9c-8d4b-5237bc96a462 service nova] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:31.750729 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 770/1527] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:16:36.135430 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd593ec-6de3-40a7-8190-a7248c69cda5 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:36.136288 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd593ec-6de3-40a7-8190-a7248c69cda5 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:36.136468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd593ec-6de3-40a7-8190-a7248c69cda5 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:36.138025 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:16:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:16:36.143499 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792a880-dec8-48c6-ab14-ebb969c3ad4f None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:36.143930 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792a880-dec8-48c6-ab14-ebb969c3ad4f None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:36.144049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792a880-dec8-48c6-ab14-ebb969c3ad4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:36.164883 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-1792a880-dec8-48c6-ab14-ebb969c3ad4f None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:36.166114 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-1792a880-dec8-48c6-ab14-ebb969c3ad4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:36.174061 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:36.210959 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd593ec-6de3-40a7-8190-a7248c69cda5 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:36.212668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-dbd593ec-6de3-40a7-8190-a7248c69cda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:36.269997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd593ec-6de3-40a7-8190-a7248c69cda5 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:36.274115 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa07b4-6d03-44a7-8537-78db78e23c29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:36.274811 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa07b4-6d03-44a7-8537-78db78e23c29 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:36.275096 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa07b4-6d03-44a7-8537-78db78e23c29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:36.275372 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa07b4-6d03-44a7-8537-78db78e23c29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:36.285311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa07b4-6d03-44a7-8537-78db78e23c29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:36.286785 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa07b4-6d03-44a7-8537-78db78e23c29 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:36.292001 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:36.296843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 759/1530] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:16:38.347333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abae1a6-d8ff-45c8-8590-a8a30b1a298e None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:38.347904 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abae1a6-d8ff-45c8-8590-a8a30b1a298e None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:38.347904 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abae1a6-d8ff-45c8-8590-a8a30b1a298e None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:38.349313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:16:38.358560 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f06b8d-0f3c-4a76-8264-0bb6d54c389c None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:38.359105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f06b8d-0f3c-4a76-8264-0bb6d54c389c None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:38.359105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f06b8d-0f3c-4a76-8264-0bb6d54c389c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:38.377623 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-d2f06b8d-0f3c-4a76-8264-0bb6d54c389c None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:38.378847 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-d2f06b8d-0f3c-4a76-8264-0bb6d54c389c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:38.387336 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:38.423081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abae1a6-d8ff-45c8-8590-a8a30b1a298e None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:38.434692 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abae1a6-d8ff-45c8-8590-a8a30b1a298e None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:38.438189 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f7273-c081-4d67-a002-fb5605b83296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:38.438830 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f7273-c081-4d67-a002-fb5605b83296 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:38.439114 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f7273-c081-4d67-a002-fb5605b83296 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:38.439392 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f7273-c081-4d67-a002-fb5605b83296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:38.449011 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f7273-c081-4d67-a002-fb5605b83296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:38.450438 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f7273-c081-4d67-a002-fb5605b83296 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:38.459858 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 773/1533] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:16:42.230356 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc3e2e-de63-409e-a60a-11cf24404020 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:42.230956 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc3e2e-de63-409e-a60a-11cf24404020 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:42.230956 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc3e2e-de63-409e-a60a-11cf24404020 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:42.232298 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:16:42.237789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf9f5e-cd65-4cae-94c1-a342b4710f8d None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:42.238351 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf9f5e-cd65-4cae-94c1-a342b4710f8d None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:42.238351 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf9f5e-cd65-4cae-94c1-a342b4710f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:42.256787 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-2abf9f5e-cd65-4cae-94c1-a342b4710f8d None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:42.258056 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-2abf9f5e-cd65-4cae-94c1-a342b4710f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:42.267202 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:42.573664 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc3e2e-de63-409e-a60a-11cf24404020 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:42.575353 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-cfcc3e2e-de63-409e-a60a-11cf24404020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:42.632577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc3e2e-de63-409e-a60a-11cf24404020 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:42.636145 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de0293-84b1-4867-8969-845f1c3f548a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:42.636797 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de0293-84b1-4867-8969-845f1c3f548a service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:42.637112 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de0293-84b1-4867-8969-845f1c3f548a service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:42.637398 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de0293-84b1-4867-8969-845f1c3f548a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:42.646378 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de0293-84b1-4867-8969-845f1c3f548a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:42.648337 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de0293-84b1-4867-8969-845f1c3f548a service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:42.658128 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 762/1536] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:16:44.723623 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555064c7-4a8a-49f6-a299-863fa82a6fe1 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:44.724210 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555064c7-4a8a-49f6-a299-863fa82a6fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:44.724210 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555064c7-4a8a-49f6-a299-863fa82a6fe1 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:44.726098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:16:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:16:44.731259 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8c366-f200-4221-b680-1d0be6af9a2c None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:44.731706 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8c366-f200-4221-b680-1d0be6af9a2c None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:44.731812 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8c366-f200-4221-b680-1d0be6af9a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:44.750609 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-3eb8c366-f200-4221-b680-1d0be6af9a2c None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:44.753138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-3eb8c366-f200-4221-b680-1d0be6af9a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:44.761301 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:45.068986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555064c7-4a8a-49f6-a299-863fa82a6fe1 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:45.071376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-555064c7-4a8a-49f6-a299-863fa82a6fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:45.084430 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555064c7-4a8a-49f6-a299-863fa82a6fe1 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:45.088029 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543b1a6-0ebe-4af0-b9fe-2a8f4fcbb0a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:45.088785 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543b1a6-0ebe-4af0-b9fe-2a8f4fcbb0a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:45.089058 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543b1a6-0ebe-4af0-b9fe-2a8f4fcbb0a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:45.089315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543b1a6-0ebe-4af0-b9fe-2a8f4fcbb0a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:45.098909 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543b1a6-0ebe-4af0-b9fe-2a8f4fcbb0a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:45.100955 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543b1a6-0ebe-4af0-b9fe-2a8f4fcbb0a5 service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:45.110476 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 776/1539] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:16:54.745192 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=32 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:55.106170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=70 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:14.303174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48474833-026a-40af-b909-6797026d2f16 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:14.305442 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48474833-026a-40af-b909-6797026d2f16 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:14.305442 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48474833-026a-40af-b909-6797026d2f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:14.330011 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-48474833-026a-40af-b909-6797026d2f16 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:14.330729 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea61ea-564c-4366-b693-c8adefaeb450 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:14.331316 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea61ea-564c-4366-b693-c8adefaeb450 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:14.331316 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea61ea-564c-4366-b693-c8adefaeb450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:14.331478 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-48474833-026a-40af-b909-6797026d2f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:14.341665 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 764/1540] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:14.343754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18c0e6-4286-408d-be6c-f3bb02c63479 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:14.344043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18c0e6-4286-408d-be6c-f3bb02c63479 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:14.344318 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18c0e6-4286-408d-be6c-f3bb02c63479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:14.360276 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-deea61ea-564c-4366-b693-c8adefaeb450 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:14.361565 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-deea61ea-564c-4366-b693-c8adefaeb450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:14.371129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-db18c0e6-4286-408d-be6c-f3bb02c63479 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:14.372379 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-db18c0e6-4286-408d-be6c-f3bb02c63479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:14.378736 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 777/1541] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:18:14.380277 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e54a7-6faf-40ca-916b-7de83579aa40 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:14.380526 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e54a7-6faf-40ca-916b-7de83579aa40 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:14.380783 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e54a7-6faf-40ca-916b-7de83579aa40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:14.392220 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 765/1542] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:14.393671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf320f-7f34-4b58-a03c-ac35fa1d7761 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:14.393962 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf320f-7f34-4b58-a03c-ac35fa1d7761 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:14.394240 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf320f-7f34-4b58-a03c-ac35fa1d7761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:14.410064 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-298e54a7-6faf-40ca-916b-7de83579aa40 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:14.411509 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-298e54a7-6faf-40ca-916b-7de83579aa40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:14.428494 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-80bf320f-7f34-4b58-a03c-ac35fa1d7761 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:14.429755 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-80bf320f-7f34-4b58-a03c-ac35fa1d7761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:14.433141 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 778/1543] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:14.434288 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffb775-4a66-4386-bb39-e22edf52698b None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:14.434577 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffb775-4a66-4386-bb39-e22edf52698b None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:14.434856 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffb775-4a66-4386-bb39-e22edf52698b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:14.452960 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 766/1544] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:14.453874 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf320f-7f34-4b58-a03c-ac35fa1d7761 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:14.468560 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf320f-7f34-4b58-a03c-ac35fa1d7761 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:14.470201 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-33ffb775-4a66-4386-bb39-e22edf52698b None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:14.471481 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-33ffb775-4a66-4386-bb39-e22edf52698b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:14.479575 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b32f5-6032-43bb-9efa-b431e3b24e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:14.480262 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b32f5-6032-43bb-9efa-b431e3b24e32 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:14.480546 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b32f5-6032-43bb-9efa-b431e3b24e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:14.480960 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b32f5-6032-43bb-9efa-b431e3b24e32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:14.481705 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b32f5-6032-43bb-9efa-b431e3b24e32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:18:14.482125 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b32f5-6032-43bb-9efa-b431e3b24e32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:14.483924 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b32f5-6032-43bb-9efa-b431e3b24e32 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:14.487866 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 779/1545] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:14.488762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ffb775-4a66-4386-bb39-e22edf52698b None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:14.502690 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 767/1546] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:18:14.503341 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b32f5-6032-43bb-9efa-b431e3b24e32 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:14.505518 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ffb775-4a66-4386-bb39-e22edf52698b None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:14.517521 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a533f88-8456-4cf0-8384-d39f7620d8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:14.518616 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a533f88-8456-4cf0-8384-d39f7620d8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:14.519127 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a533f88-8456-4cf0-8384-d39f7620d8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:14.519629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a533f88-8456-4cf0-8384-d39f7620d8a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:14.519842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b32f5-6032-43bb-9efa-b431e3b24e32 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:14.521254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a533f88-8456-4cf0-8384-d39f7620d8a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:18:14.522086 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a533f88-8456-4cf0-8384-d39f7620d8a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:14.523577 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: WARNING py.warnings [None req-9a533f88-8456-4cf0-8384-d39f7620d8a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:18:14.523577 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: warnings.warn(msg) Jun 22 10:18:14.523577 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: Jun 22 10:18:14.524953 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a533f88-8456-4cf0-8384-d39f7620d8a8 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:14.540405 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65131b2c-6107-453d-ab46-0045a3c8e50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:14.544366 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65131b2c-6107-453d-ab46-0045a3c8e50b admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:14.544366 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65131b2c-6107-453d-ab46-0045a3c8e50b admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:14.544366 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65131b2c-6107-453d-ab46-0045a3c8e50b admin admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:14.544366 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65131b2c-6107-453d-ab46-0045a3c8e50b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:18:14.544366 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65131b2c-6107-453d-ab46-0045a3c8e50b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:14.544366 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65131b2c-6107-453d-ab46-0045a3c8e50b admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:14.555785 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 780/1547] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:18:14.557064 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a533f88-8456-4cf0-8384-d39f7620d8a8 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:14.568862 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 768/1548] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:18:14.569955 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a533f88-8456-4cf0-8384-d39f7620d8a8 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:14.572865 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212425b5-aed4-4d3e-ba27-8314875058c0 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:14.572865 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212425b5-aed4-4d3e-ba27-8314875058c0 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:14.572865 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212425b5-aed4-4d3e-ba27-8314875058c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:14.604701 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a705c-f82e-4828-8b5c-f57595826aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:14.604701 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a705c-f82e-4828-8b5c-f57595826aca admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:14.604701 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a705c-f82e-4828-8b5c-f57595826aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:14.604701 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a705c-f82e-4828-8b5c-f57595826aca admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:14.605068 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a705c-f82e-4828-8b5c-f57595826aca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:14.605068 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a705c-f82e-4828-8b5c-f57595826aca admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:14.621548 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-212425b5-aed4-4d3e-ba27-8314875058c0 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:14.622789 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-212425b5-aed4-4d3e-ba27-8314875058c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:14.639943 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 769/1549] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:18:14.641412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212425b5-aed4-4d3e-ba27-8314875058c0 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:14.664871 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212425b5-aed4-4d3e-ba27-8314875058c0 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:14.672866 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82fa2f-ca5d-4878-9c54-bdeb21489885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:14.672866 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82fa2f-ca5d-4878-9c54-bdeb21489885 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:14.672866 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82fa2f-ca5d-4878-9c54-bdeb21489885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:14.672866 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82fa2f-ca5d-4878-9c54-bdeb21489885 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:14.677485 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82fa2f-ca5d-4878-9c54-bdeb21489885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:14.678609 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: WARNING py.warnings [None req-dd82fa2f-ca5d-4878-9c54-bdeb21489885 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:18:14.678609 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: warnings.warn(msg) Jun 22 10:18:14.678609 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: Jun 22 10:18:14.680068 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82fa2f-ca5d-4878-9c54-bdeb21489885 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:14.711101 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 781/1550] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:18:14 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:14.715013 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a705c-f82e-4828-8b5c-f57595826aca admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:14.746723 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 770/1551] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:18:14 2022] POST /identity/v3/projects => generated 391 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:14.749823 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccf338-98cf-4413-a38e-9e11d4fe12cc None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:14.749823 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccf338-98cf-4413-a38e-9e11d4fe12cc None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:14.750896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccf338-98cf-4413-a38e-9e11d4fe12cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:14.773293 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-26ccf338-98cf-4413-a38e-9e11d4fe12cc None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:14.774742 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-26ccf338-98cf-4413-a38e-9e11d4fe12cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:14.793367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a705c-f82e-4828-8b5c-f57595826aca admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:14.836948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 771/1552] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:14.838664 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b678f-d252-4113-97da-e5e3c772e5c2 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:14.839138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b678f-d252-4113-97da-e5e3c772e5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:14.839585 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b678f-d252-4113-97da-e5e3c772e5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:14.851906 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c1d7b-237b-40f3-b543-f2a449d813ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:14.852546 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c1d7b-237b-40f3-b543-f2a449d813ac admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:14.852840 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c1d7b-237b-40f3-b543-f2a449d813ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:14.853151 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c1d7b-237b-40f3-b543-f2a449d813ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:14.853850 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c1d7b-237b-40f3-b543-f2a449d813ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:14.855813 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c1d7b-237b-40f3-b543-f2a449d813ac admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:14.858278 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-456b678f-d252-4113-97da-e5e3c772e5c2 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:14.863719 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-456b678f-d252-4113-97da-e5e3c772e5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:14.869490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 772/1553] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:14.870728 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b120a8b-11ca-4438-aef9-64d0a7aafa20 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:14.871017 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b120a8b-11ca-4438-aef9-64d0a7aafa20 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:14.871292 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b120a8b-11ca-4438-aef9-64d0a7aafa20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:14.888654 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-8b120a8b-11ca-4438-aef9-64d0a7aafa20 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:14.892376 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-8b120a8b-11ca-4438-aef9-64d0a7aafa20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:14.898731 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 773/1554] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:14.899995 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8de53-e814-4b67-a5c0-2bff45122800 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:14.900349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8de53-e814-4b67-a5c0-2bff45122800 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:14.900685 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8de53-e814-4b67-a5c0-2bff45122800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:14.919055 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-79e8de53-e814-4b67-a5c0-2bff45122800 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:14.920251 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-79e8de53-e814-4b67-a5c0-2bff45122800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:14.928922 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 774/1555] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:14.929852 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8de53-e814-4b67-a5c0-2bff45122800 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:14.940366 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8de53-e814-4b67-a5c0-2bff45122800 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:14.945922 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bebdc2-3f02-49c7-935b-4c740a429797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:14.946599 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bebdc2-3f02-49c7-935b-4c740a429797 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:14.946885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bebdc2-3f02-49c7-935b-4c740a429797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:14.947164 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bebdc2-3f02-49c7-935b-4c740a429797 admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:14.947390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 782/1556] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:18:14 2022] POST /identity/v3/projects => generated 371 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:14.947873 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bebdc2-3f02-49c7-935b-4c740a429797 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:14.948276 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c1d7b-237b-40f3-b543-f2a449d813ac admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:14.949965 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bebdc2-3f02-49c7-935b-4c740a429797 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:14.992136 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:15.013161 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c1d7b-237b-40f3-b543-f2a449d813ac admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:15.017931 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5829bb1-96df-41e5-b7ce-b5ed27cb99f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:15.018613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5829bb1-96df-41e5-b7ce-b5ed27cb99f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:15.018931 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5829bb1-96df-41e5-b7ce-b5ed27cb99f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:15.019205 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5829bb1-96df-41e5-b7ce-b5ed27cb99f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:15.019944 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5829bb1-96df-41e5-b7ce-b5ed27cb99f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:15.021313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: WARNING py.warnings [None req-e5829bb1-96df-41e5-b7ce-b5ed27cb99f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:18:15.021313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: warnings.warn(msg) Jun 22 10:18:15.021313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: Jun 22 10:18:15.022537 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5829bb1-96df-41e5-b7ce-b5ed27cb99f9 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:15.036871 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 775/1557] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:18:14 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:15.036871 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13c206-fca9-4c1d-a5f5-77a365fa01d6 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:15.036871 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13c206-fca9-4c1d-a5f5-77a365fa01d6 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:15.036871 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13c206-fca9-4c1d-a5f5-77a365fa01d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:15.056340 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-0a13c206-fca9-4c1d-a5f5-77a365fa01d6 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:15.058885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-0a13c206-fca9-4c1d-a5f5-77a365fa01d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:15.065093 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 776/1558] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:15.066439 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0c35c-ff34-448f-b2bf-bb870c82d72c None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:15.066733 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0c35c-ff34-448f-b2bf-bb870c82d72c None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:15.067074 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0c35c-ff34-448f-b2bf-bb870c82d72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:15.085753 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-9af0c35c-ff34-448f-b2bf-bb870c82d72c None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:15.094541 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-9af0c35c-ff34-448f-b2bf-bb870c82d72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:15.094987 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 777/1559] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:15.095870 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0c35c-ff34-448f-b2bf-bb870c82d72c None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:15.105828 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0c35c-ff34-448f-b2bf-bb870c82d72c None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:15.110438 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf06ef-21a1-4fbd-91bf-a3aae81989c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:15.111102 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf06ef-21a1-4fbd-91bf-a3aae81989c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:15.111431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf06ef-21a1-4fbd-91bf-a3aae81989c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:15.111718 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf06ef-21a1-4fbd-91bf-a3aae81989c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:15.112461 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf06ef-21a1-4fbd-91bf-a3aae81989c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:18:15.112775 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf06ef-21a1-4fbd-91bf-a3aae81989c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:15.115152 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf06ef-21a1-4fbd-91bf-a3aae81989c6 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:15.120398 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 783/1560] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:18:14 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:15.123336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b23065-68c0-4702-8f8b-b2af03cc566f None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:15.123336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b23065-68c0-4702-8f8b-b2af03cc566f None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:15.123336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b23065-68c0-4702-8f8b-b2af03cc566f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:15.128933 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 778/1561] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:18:15.130946 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c40fe8-6137-4dae-aa2e-0e105e18c539 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:15.131244 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c40fe8-6137-4dae-aa2e-0e105e18c539 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:15.131520 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c40fe8-6137-4dae-aa2e-0e105e18c539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:15.142691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-45b23065-68c0-4702-8f8b-b2af03cc566f None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:15.144519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-45b23065-68c0-4702-8f8b-b2af03cc566f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:15.150908 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-a7c40fe8-6137-4dae-aa2e-0e105e18c539 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:15.152197 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-a7c40fe8-6137-4dae-aa2e-0e105e18c539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:15.155947 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 784/1562] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:15.160147 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b23065-68c0-4702-8f8b-b2af03cc566f None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:15.160409 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 779/1563] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:15.161291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c40fe8-6137-4dae-aa2e-0e105e18c539 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:15.170286 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b23065-68c0-4702-8f8b-b2af03cc566f None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:15.170490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c40fe8-6137-4dae-aa2e-0e105e18c539 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:15.174927 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9232ee-3825-44e8-9ea8-765d47f9dcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:15.175180 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedbe95-759e-45a7-bce2-9913319e2027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:15.175584 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9232ee-3825-44e8-9ea8-765d47f9dcfa admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:15.175851 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedbe95-759e-45a7-bce2-9913319e2027 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:15.175963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9232ee-3825-44e8-9ea8-765d47f9dcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:15.176126 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9232ee-3825-44e8-9ea8-765d47f9dcfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:15.176230 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedbe95-759e-45a7-bce2-9913319e2027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:15.176939 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedbe95-759e-45a7-bce2-9913319e2027 admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:15.177420 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9232ee-3825-44e8-9ea8-765d47f9dcfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:15.177650 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedbe95-759e-45a7-bce2-9913319e2027 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:15.179015 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9232ee-3825-44e8-9ea8-765d47f9dcfa admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:15.179567 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedbe95-759e-45a7-bce2-9913319e2027 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:15.189464 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 780/1564] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:15.190793 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4638ab-27fc-4a58-9aef-ac49428d1e54 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:15.191084 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4638ab-27fc-4a58-9aef-ac49428d1e54 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:15.191484 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4638ab-27fc-4a58-9aef-ac49428d1e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:15.199335 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:15.209893 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-da4638ab-27fc-4a58-9aef-ac49428d1e54 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:15.211102 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-da4638ab-27fc-4a58-9aef-ac49428d1e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:15.219126 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 781/1565] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:15.219952 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4638ab-27fc-4a58-9aef-ac49428d1e54 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:15.229761 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4638ab-27fc-4a58-9aef-ac49428d1e54 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:15.234333 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a94b46-c993-4362-a7e2-12b43152567e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:15.237618 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a94b46-c993-4362-a7e2-12b43152567e admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:15.237618 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a94b46-c993-4362-a7e2-12b43152567e admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:15.237618 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a94b46-c993-4362-a7e2-12b43152567e admin admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:15.237618 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a94b46-c993-4362-a7e2-12b43152567e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:18:15.237618 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a94b46-c993-4362-a7e2-12b43152567e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:15.238257 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a94b46-c993-4362-a7e2-12b43152567e admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:15.249989 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 782/1566] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:18:15.250763 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a94b46-c993-4362-a7e2-12b43152567e admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:15.260683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a94b46-c993-4362-a7e2-12b43152567e admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:15.265411 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 785/1567] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:18:15 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:15.265411 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedbe95-759e-45a7-bce2-9913319e2027 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:15.265799 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d1344-f973-40e6-8e62-8ebc81acc702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:15.266537 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d1344-f973-40e6-8e62-8ebc81acc702 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:15.266824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d1344-f973-40e6-8e62-8ebc81acc702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:15.267106 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d1344-f973-40e6-8e62-8ebc81acc702 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:15.268063 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d1344-f973-40e6-8e62-8ebc81acc702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:15.269597 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d1344-f973-40e6-8e62-8ebc81acc702 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:15.274057 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedbe95-759e-45a7-bce2-9913319e2027 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:15.279343 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e40f1-4d3a-48fb-a41c-eea915e0d157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:15.280028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e40f1-4d3a-48fb-a41c-eea915e0d157 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:15.283628 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e40f1-4d3a-48fb-a41c-eea915e0d157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:15.283813 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 783/1568] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:15.283905 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e40f1-4d3a-48fb-a41c-eea915e0d157 admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:15.283982 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d1344-f973-40e6-8e62-8ebc81acc702 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:15.284078 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e40f1-4d3a-48fb-a41c-eea915e0d157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:15.284078 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e40f1-4d3a-48fb-a41c-eea915e0d157 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:15.297180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d1344-f973-40e6-8e62-8ebc81acc702 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:15.302637 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a171b-d263-4061-b280-6911f16cda7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:15.303291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a171b-d263-4061-b280-6911f16cda7b admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:15.303894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a171b-d263-4061-b280-6911f16cda7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:15.303894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a171b-d263-4061-b280-6911f16cda7b admin admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:15.304531 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a171b-d263-4061-b280-6911f16cda7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:18:15.304861 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a171b-d263-4061-b280-6911f16cda7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:15.306548 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a171b-d263-4061-b280-6911f16cda7b admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:15.318146 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 784/1569] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:18:15.318953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a171b-d263-4061-b280-6911f16cda7b admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:15.328126 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a171b-d263-4061-b280-6911f16cda7b admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:15.332671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12f71a-5a50-44bf-a7eb-2302f4cc1556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:15.333331 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12f71a-5a50-44bf-a7eb-2302f4cc1556 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:15.333613 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12f71a-5a50-44bf-a7eb-2302f4cc1556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:15.333887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12f71a-5a50-44bf-a7eb-2302f4cc1556 admin admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:15.334640 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12f71a-5a50-44bf-a7eb-2302f4cc1556 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:18:15.335156 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12f71a-5a50-44bf-a7eb-2302f4cc1556 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:15.337283 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12f71a-5a50-44bf-a7eb-2302f4cc1556 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:15.349507 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 785/1570] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:18:15.350246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12f71a-5a50-44bf-a7eb-2302f4cc1556 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:15.360034 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12f71a-5a50-44bf-a7eb-2302f4cc1556 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:15.365226 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559de138-26c3-4d7d-a244-c21abe8f834b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:15.365877 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559de138-26c3-4d7d-a244-c21abe8f834b admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:15.366189 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559de138-26c3-4d7d-a244-c21abe8f834b admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:15.369744 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559de138-26c3-4d7d-a244-c21abe8f834b admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:15.369744 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559de138-26c3-4d7d-a244-c21abe8f834b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:15.369744 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559de138-26c3-4d7d-a244-c21abe8f834b admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:15.378956 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 786/1571] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:15.379773 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559de138-26c3-4d7d-a244-c21abe8f834b admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:15.389213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559de138-26c3-4d7d-a244-c21abe8f834b admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:15.394146 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16027b-5633-49ac-a596-bdf0a9776910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:15.394780 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16027b-5633-49ac-a596-bdf0a9776910 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:15.395061 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16027b-5633-49ac-a596-bdf0a9776910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:15.395625 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16027b-5633-49ac-a596-bdf0a9776910 admin admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:15.396333 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16027b-5633-49ac-a596-bdf0a9776910 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:18:15.396641 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16027b-5633-49ac-a596-bdf0a9776910 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:15.398257 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16027b-5633-49ac-a596-bdf0a9776910 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:15.410097 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 787/1572] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:18:15.411386 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16027b-5633-49ac-a596-bdf0a9776910 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:15.420774 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16027b-5633-49ac-a596-bdf0a9776910 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:15.425256 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47b8b6-2627-4437-947e-7af9c19a0e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:15.425867 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47b8b6-2627-4437-947e-7af9c19a0e2c admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:15.426148 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47b8b6-2627-4437-947e-7af9c19a0e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:15.426998 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47b8b6-2627-4437-947e-7af9c19a0e2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:15.427648 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47b8b6-2627-4437-947e-7af9c19a0e2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:15.429543 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47b8b6-2627-4437-947e-7af9c19a0e2c admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:15.444177 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 786/1573] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:18:15 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:15.444177 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e40f1-4d3a-48fb-a41c-eea915e0d157 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:15.501016 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e40f1-4d3a-48fb-a41c-eea915e0d157 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:15.505583 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbe2a7-a2d8-49d3-aaef-7ba00bca7310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:15.511282 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbe2a7-a2d8-49d3-aaef-7ba00bca7310 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:15.511282 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbe2a7-a2d8-49d3-aaef-7ba00bca7310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:15.511282 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbe2a7-a2d8-49d3-aaef-7ba00bca7310 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:15.511282 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbe2a7-a2d8-49d3-aaef-7ba00bca7310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:15.511282 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbe2a7-a2d8-49d3-aaef-7ba00bca7310 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:15.519648 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 787/1574] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:15.520729 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbe2a7-a2d8-49d3-aaef-7ba00bca7310 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:15.529810 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbe2a7-a2d8-49d3-aaef-7ba00bca7310 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:15.534569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8354f0d-3bb2-400c-8a26-94acf2418954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:15.541817 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8354f0d-3bb2-400c-8a26-94acf2418954 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:15.541817 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8354f0d-3bb2-400c-8a26-94acf2418954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:15.541817 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8354f0d-3bb2-400c-8a26-94acf2418954 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:15.541817 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8354f0d-3bb2-400c-8a26-94acf2418954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:15.542195 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 788/1575] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:18:15 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:15.542195 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47b8b6-2627-4437-947e-7af9c19a0e2c admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:15.542380 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8354f0d-3bb2-400c-8a26-94acf2418954 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:15.550574 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 788/1576] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:15.551492 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8354f0d-3bb2-400c-8a26-94acf2418954 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:15.563729 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8354f0d-3bb2-400c-8a26-94acf2418954 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:15.605882 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47b8b6-2627-4437-947e-7af9c19a0e2c admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:15.610478 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b123645-9736-4168-8cc1-adb0245ff20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:15.611133 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b123645-9736-4168-8cc1-adb0245ff20c admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:15.611413 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b123645-9736-4168-8cc1-adb0245ff20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:15.611683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b123645-9736-4168-8cc1-adb0245ff20c admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:15.612364 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b123645-9736-4168-8cc1-adb0245ff20c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:15.614370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b123645-9736-4168-8cc1-adb0245ff20c admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:15.713279 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 789/1577] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:18:15 2022] POST /identity/v3/projects => generated 371 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:15.713279 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b123645-9736-4168-8cc1-adb0245ff20c admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:15.713585 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f64ca8-401a-4495-abfa-26fbf1a98ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:15.713712 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f64ca8-401a-4495-abfa-26fbf1a98ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:15.713994 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f64ca8-401a-4495-abfa-26fbf1a98ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:15.714212 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f64ca8-401a-4495-abfa-26fbf1a98ed0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:15.714908 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f64ca8-401a-4495-abfa-26fbf1a98ed0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:15.716835 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f64ca8-401a-4495-abfa-26fbf1a98ed0 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:15.728038 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:15.760168 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:15.774563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b123645-9736-4168-8cc1-adb0245ff20c admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:15.779352 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b072753-80c8-4ce3-9602-ab3d1111393a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:15.780347 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b072753-80c8-4ce3-9602-ab3d1111393a admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:15.780634 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b072753-80c8-4ce3-9602-ab3d1111393a admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:15.780944 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b072753-80c8-4ce3-9602-ab3d1111393a admin admin] PATH_INFO: `/v3/projects/0521797f600144f4a5b5f844115029bb/users/52eb4e92ccdf466a9c26a54a10313bbe/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:15.796053 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b072753-80c8-4ce3-9602-ab3d1111393a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0521797f600144f4a5b5f844115029bb, user_id=52eb4e92ccdf466a9c26a54a10313bbe, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:15.797215 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: WARNING py.warnings [None req-9b072753-80c8-4ce3-9602-ab3d1111393a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:18:15.797215 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: warnings.warn(msg) Jun 22 10:18:15.797215 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: Jun 22 10:18:15.799166 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b072753-80c8-4ce3-9602-ab3d1111393a admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:15.823083 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 789/1578] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:18:15 2022] POST /identity/v3/projects => generated 373 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:15.823968 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f64ca8-401a-4495-abfa-26fbf1a98ed0 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:15.884959 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f64ca8-401a-4495-abfa-26fbf1a98ed0 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:15.889375 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464a4b9-fe19-494e-8c60-d1a9f5182167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:15.890061 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464a4b9-fe19-494e-8c60-d1a9f5182167 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:15.890380 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464a4b9-fe19-494e-8c60-d1a9f5182167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:15.890655 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464a4b9-fe19-494e-8c60-d1a9f5182167 admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:15.891344 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464a4b9-fe19-494e-8c60-d1a9f5182167 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:15.893249 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464a4b9-fe19-494e-8c60-d1a9f5182167 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:15.947862 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 790/1579] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:18:15 2022] PUT /identity/v3/projects/0521797f600144f4a5b5f844115029bb/users/52eb4e92ccdf466a9c26a54a10313bbe/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:15.948669 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b072753-80c8-4ce3-9602-ab3d1111393a admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:16.009324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b072753-80c8-4ce3-9602-ab3d1111393a admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:16.014038 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91f87f-8064-46f3-8ce3-838e40c72ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:16.014708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91f87f-8064-46f3-8ce3-838e40c72ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:16.014993 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91f87f-8064-46f3-8ce3-838e40c72ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:16.015269 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91f87f-8064-46f3-8ce3-838e40c72ac6 admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:16.015950 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91f87f-8064-46f3-8ce3-838e40c72ac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:16.017401 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 790/1580] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:18:15 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:16.017921 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91f87f-8064-46f3-8ce3-838e40c72ac6 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:16.018238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464a4b9-fe19-494e-8c60-d1a9f5182167 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:16.079329 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464a4b9-fe19-494e-8c60-d1a9f5182167 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:16.084575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03e062-b1f2-49d3-b5f3-10b3c9d423be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:16.085272 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03e062-b1f2-49d3-b5f3-10b3c9d423be admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:16.085561 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03e062-b1f2-49d3-b5f3-10b3c9d423be admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:16.085843 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03e062-b1f2-49d3-b5f3-10b3c9d423be admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:16.086595 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03e062-b1f2-49d3-b5f3-10b3c9d423be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:16.088249 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03e062-b1f2-49d3-b5f3-10b3c9d423be admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:16.097954 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 791/1581] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:16.098779 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03e062-b1f2-49d3-b5f3-10b3c9d423be admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:16.108381 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03e062-b1f2-49d3-b5f3-10b3c9d423be admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:16.112579 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 791/1582] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:18:15 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:16.116058 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91f87f-8064-46f3-8ce3-838e40c72ac6 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:16.116186 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a7fa4-1512-4820-a547-af80aebb377c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:16.116186 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a7fa4-1512-4820-a547-af80aebb377c admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:16.116186 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a7fa4-1512-4820-a547-af80aebb377c admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:16.116186 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a7fa4-1512-4820-a547-af80aebb377c admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:16.116569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a7fa4-1512-4820-a547-af80aebb377c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:16.118458 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a7fa4-1512-4820-a547-af80aebb377c admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:16.123975 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91f87f-8064-46f3-8ce3-838e40c72ac6 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:16.128954 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21877cc6-f0d0-4094-affb-6094bbc42e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:16.130325 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21877cc6-f0d0-4094-affb-6094bbc42e79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:16.130606 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21877cc6-f0d0-4094-affb-6094bbc42e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:16.130884 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21877cc6-f0d0-4094-affb-6094bbc42e79 admin admin] PATH_INFO: `/v3/projects/30df978aece349c4baf14cc311f7b498/users/425bf40bd45642a1aafeb65bdb9650af/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:16.146329 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21877cc6-f0d0-4094-affb-6094bbc42e79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30df978aece349c4baf14cc311f7b498, user_id=425bf40bd45642a1aafeb65bdb9650af, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:16.148972 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21877cc6-f0d0-4094-affb-6094bbc42e79 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:16.200126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 792/1583] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:18:16 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:16.201075 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a7fa4-1512-4820-a547-af80aebb377c admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:16.211333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a7fa4-1512-4820-a547-af80aebb377c admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:16.216090 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb55bf-1b48-4d9c-afaa-be1bb93df90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:16.216734 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb55bf-1b48-4d9c-afaa-be1bb93df90a admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:16.217056 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb55bf-1b48-4d9c-afaa-be1bb93df90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:16.217371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb55bf-1b48-4d9c-afaa-be1bb93df90a admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:16.218061 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb55bf-1b48-4d9c-afaa-be1bb93df90a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:16.220027 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb55bf-1b48-4d9c-afaa-be1bb93df90a admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:16.227600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 792/1584] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:18:16 2022] PUT /identity/v3/projects/30df978aece349c4baf14cc311f7b498/users/425bf40bd45642a1aafeb65bdb9650af/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:16.228576 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21877cc6-f0d0-4094-affb-6094bbc42e79 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:16.289005 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21877cc6-f0d0-4094-affb-6094bbc42e79 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:16.293685 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902773a-0f90-4082-a6d4-1e8a7c31e74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:16.294361 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902773a-0f90-4082-a6d4-1e8a7c31e74e admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:16.294639 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902773a-0f90-4082-a6d4-1e8a7c31e74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:16.298736 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902773a-0f90-4082-a6d4-1e8a7c31e74e admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:16.298736 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902773a-0f90-4082-a6d4-1e8a7c31e74e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:16.298736 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902773a-0f90-4082-a6d4-1e8a7c31e74e admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:16.324914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 793/1585] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:18:16 2022] POST /identity/v3/users => generated 286 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:16.326301 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77746965-ce59-4ad4-9c63-1959bf396a14 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:16.326656 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77746965-ce59-4ad4-9c63-1959bf396a14 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:16.326989 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77746965-ce59-4ad4-9c63-1959bf396a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:16.357951 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-77746965-ce59-4ad4-9c63-1959bf396a14 None None] MFA Rules not processed for user `52eb4e92ccdf466a9c26a54a10313bbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:16.359183 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-77746965-ce59-4ad4-9c63-1959bf396a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:16.389502 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:16.407818 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 793/1586] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:18:16 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:16.407818 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902773a-0f90-4082-a6d4-1e8a7c31e74e admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:16.415645 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902773a-0f90-4082-a6d4-1e8a7c31e74e admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:16.420377 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2448bc8-03c9-4242-9e66-881e452154f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:16.421059 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2448bc8-03c9-4242-9e66-881e452154f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:16.421344 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2448bc8-03c9-4242-9e66-881e452154f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:16.421623 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2448bc8-03c9-4242-9e66-881e452154f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:16.422312 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2448bc8-03c9-4242-9e66-881e452154f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:16.424246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2448bc8-03c9-4242-9e66-881e452154f1 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:16.428657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 794/1587] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:16.429505 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77746965-ce59-4ad4-9c63-1959bf396a14 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:16.443674 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77746965-ce59-4ad4-9c63-1959bf396a14 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:16.448652 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dae99c-4a98-4e37-ba8c-69a899057f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:16.449647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dae99c-4a98-4e37-ba8c-69a899057f1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:16.450050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dae99c-4a98-4e37-ba8c-69a899057f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:16.450388 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dae99c-4a98-4e37-ba8c-69a899057f1d admin admin] PATH_INFO: `/v3/projects/4e95ca5822da4c728cc35e6d67d7a80e/users/d70a62962d3841059aecaaff8ce95953/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:16.466936 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dae99c-4a98-4e37-ba8c-69a899057f1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e95ca5822da4c728cc35e6d67d7a80e, user_id=d70a62962d3841059aecaaff8ce95953, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:16.469624 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dae99c-4a98-4e37-ba8c-69a899057f1d admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:16.542656 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 794/1588] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:18:16 2022] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:16.543706 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2448bc8-03c9-4242-9e66-881e452154f1 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:16.554016 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2448bc8-03c9-4242-9e66-881e452154f1 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:16.554200 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 795/1589] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:18:16 2022] PUT /identity/v3/projects/4e95ca5822da4c728cc35e6d67d7a80e/users/d70a62962d3841059aecaaff8ce95953/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:16.555004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dae99c-4a98-4e37-ba8c-69a899057f1d admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:16.563606 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:16.617975 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1173415-159a-4841-a527-d700208caa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:16.618681 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1173415-159a-4841-a527-d700208caa91 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:16.618963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1173415-159a-4841-a527-d700208caa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:16.619238 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1173415-159a-4841-a527-d700208caa91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:16.620017 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1173415-159a-4841-a527-d700208caa91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:16.621799 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1173415-159a-4841-a527-d700208caa91 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:16.625819 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dae99c-4a98-4e37-ba8c-69a899057f1d admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:16.628870 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62f0b4-c07d-414f-8782-ee836f14f4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:16.629595 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62f0b4-c07d-414f-8782-ee836f14f4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:16.630383 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62f0b4-c07d-414f-8782-ee836f14f4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:16.630660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62f0b4-c07d-414f-8782-ee836f14f4e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:16.631387 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62f0b4-c07d-414f-8782-ee836f14f4e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:16.632358 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 795/1590] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:16.632990 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62f0b4-c07d-414f-8782-ee836f14f4e2 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:16.633915 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3e319-6e4a-4b53-b358-3cbf0278e3e2 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:16.634256 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3e319-6e4a-4b53-b358-3cbf0278e3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:16.634542 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3e319-6e4a-4b53-b358-3cbf0278e3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:16.643655 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 796/1591] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:16.644493 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62f0b4-c07d-414f-8782-ee836f14f4e2 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:16.652976 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-bee3e319-6e4a-4b53-b358-3cbf0278e3e2 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:16.654517 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-bee3e319-6e4a-4b53-b358-3cbf0278e3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:16.654635 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62f0b4-c07d-414f-8782-ee836f14f4e2 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:16.659248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bc16f-b89c-4f3f-b558-3084ee908900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:16.659854 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bc16f-b89c-4f3f-b558-3084ee908900 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:16.660180 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bc16f-b89c-4f3f-b558-3084ee908900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:16.660417 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bc16f-b89c-4f3f-b558-3084ee908900 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:16.661226 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7bc16f-b89c-4f3f-b558-3084ee908900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:16.665492 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 796/1592] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:16.665669 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7bc16f-b89c-4f3f-b558-3084ee908900 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:16.665768 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3e319-6e4a-4b53-b358-3cbf0278e3e2 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:16.675938 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 797/1593] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:16.677488 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3e319-6e4a-4b53-b358-3cbf0278e3e2 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:16.679214 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857d992-6896-42e6-8a02-f728ef1fca72 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:16.679214 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857d992-6896-42e6-8a02-f728ef1fca72 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:16.679450 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857d992-6896-42e6-8a02-f728ef1fca72 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:16.683899 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 798/1594] 10.222.0.46 () {54 vars in 961 bytes} [Wed Jun 22 10:18:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:18:16.683899 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857d992-6896-42e6-8a02-f728ef1fca72 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:16.685091 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0eca24-6ef4-49ba-a710-46a3b76d32b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:16.685840 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0eca24-6ef4-49ba-a710-46a3b76d32b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:16.686183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0eca24-6ef4-49ba-a710-46a3b76d32b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:16.686562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0eca24-6ef4-49ba-a710-46a3b76d32b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:16.687469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0eca24-6ef4-49ba-a710-46a3b76d32b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:16.689351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0eca24-6ef4-49ba-a710-46a3b76d32b3 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:16.699017 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857d992-6896-42e6-8a02-f728ef1fca72 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:16.700976 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 797/1595] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:16.702260 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2eb59-bc99-4cc0-9e91-121df3f267ea None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:16.702628 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2eb59-bc99-4cc0-9e91-121df3f267ea None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:16.702911 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2eb59-bc99-4cc0-9e91-121df3f267ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:16.703715 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd244b-a35d-4853-9f28-29faa79bca10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:16.704542 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd244b-a35d-4853-9f28-29faa79bca10 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:16.704846 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd244b-a35d-4853-9f28-29faa79bca10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:16.705137 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd244b-a35d-4853-9f28-29faa79bca10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:16.705866 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd244b-a35d-4853-9f28-29faa79bca10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:16.707600 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd244b-a35d-4853-9f28-29faa79bca10 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:16.719089 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 799/1596] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:16.720014 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd244b-a35d-4853-9f28-29faa79bca10 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:16.730650 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-56c2eb59-bc99-4cc0-9e91-121df3f267ea None None] MFA Rules not processed for user `d70a62962d3841059aecaaff8ce95953`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:16.732087 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd244b-a35d-4853-9f28-29faa79bca10 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:16.732403 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-56c2eb59-bc99-4cc0-9e91-121df3f267ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:16.737782 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7aa3a-493e-4b80-87cd-5491304b556d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:16.738448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7aa3a-493e-4b80-87cd-5491304b556d admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:16.740720 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7aa3a-493e-4b80-87cd-5491304b556d admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:16.740720 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7aa3a-493e-4b80-87cd-5491304b556d admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:16.740720 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7aa3a-493e-4b80-87cd-5491304b556d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:16.742898 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7aa3a-493e-4b80-87cd-5491304b556d admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:16.760460 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 800/1597] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:16.762015 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7aa3a-493e-4b80-87cd-5491304b556d admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:16.775010 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7aa3a-493e-4b80-87cd-5491304b556d admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:16.779727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1738c9-d012-4c26-8754-71317c920fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:16.780387 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1738c9-d012-4c26-8754-71317c920fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:16.780670 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1738c9-d012-4c26-8754-71317c920fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:16.780984 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1738c9-d012-4c26-8754-71317c920fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:16.781707 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1738c9-d012-4c26-8754-71317c920fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:16.783319 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1738c9-d012-4c26-8754-71317c920fd9 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:16.793746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 801/1598] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:16.794565 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1738c9-d012-4c26-8754-71317c920fd9 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:16.802945 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 798/1599] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:16.803850 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2eb59-bc99-4cc0-9e91-121df3f267ea None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:16.814744 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2eb59-bc99-4cc0-9e91-121df3f267ea None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:16.819719 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d94432-96f1-4527-88a4-20bdefa2457e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:16.820394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d94432-96f1-4527-88a4-20bdefa2457e admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:16.820679 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d94432-96f1-4527-88a4-20bdefa2457e admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:16.821074 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d94432-96f1-4527-88a4-20bdefa2457e admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:16.821809 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d94432-96f1-4527-88a4-20bdefa2457e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:16.823437 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d94432-96f1-4527-88a4-20bdefa2457e admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:16.833648 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 799/1600] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:16.835011 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214ed6f-b85d-4e59-9fa3-9ab317d91249 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:16.835379 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214ed6f-b85d-4e59-9fa3-9ab317d91249 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:16.835762 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214ed6f-b85d-4e59-9fa3-9ab317d91249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:16.854516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-1214ed6f-b85d-4e59-9fa3-9ab317d91249 None None] MFA Rules not processed for user `4ed9a00723ab4af2b633ab7614d178a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:16.855735 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-1214ed6f-b85d-4e59-9fa3-9ab317d91249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:16.856129 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1738c9-d012-4c26-8754-71317c920fd9 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:16.859674 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4919f-5dd2-401b-a3f7-79d88d50d8ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:16.860325 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4919f-5dd2-401b-a3f7-79d88d50d8ae service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:16.860605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4919f-5dd2-401b-a3f7-79d88d50d8ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:16.860909 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4919f-5dd2-401b-a3f7-79d88d50d8ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:16.870802 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4919f-5dd2-401b-a3f7-79d88d50d8ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:16.872225 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4919f-5dd2-401b-a3f7-79d88d50d8ae service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:16.876275 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:16.882921 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 802/1601] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:16.883542 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4919f-5dd2-401b-a3f7-79d88d50d8ae service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:16.892650 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4919f-5dd2-401b-a3f7-79d88d50d8ae service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:16.898054 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb71e8-ff0c-44fb-a793-1d848b6dc666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:16.898725 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb71e8-ff0c-44fb-a793-1d848b6dc666 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:16.899004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb71e8-ff0c-44fb-a793-1d848b6dc666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:16.899280 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb71e8-ff0c-44fb-a793-1d848b6dc666 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:16.900274 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb71e8-ff0c-44fb-a793-1d848b6dc666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:16.901979 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb71e8-ff0c-44fb-a793-1d848b6dc666 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:16.913347 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 803/1602] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:16.914191 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb71e8-ff0c-44fb-a793-1d848b6dc666 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:16.920438 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:16.924735 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb71e8-ff0c-44fb-a793-1d848b6dc666 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:16.929931 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ecd5d-bb89-45df-9f84-be0cd8303b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:16.930595 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ecd5d-bb89-45df-9f84-be0cd8303b87 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:16.930882 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ecd5d-bb89-45df-9f84-be0cd8303b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:16.931219 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ecd5d-bb89-45df-9f84-be0cd8303b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:16.931944 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ecd5d-bb89-45df-9f84-be0cd8303b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:16.933732 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ecd5d-bb89-45df-9f84-be0cd8303b87 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:16.934325 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 800/1603] 10.222.0.46 () {58 vars in 1058 bytes} [Wed Jun 22 10:18:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:16.935129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214ed6f-b85d-4e59-9fa3-9ab317d91249 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:16.947431 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 804/1604] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:16.947431 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ecd5d-bb89-45df-9f84-be0cd8303b87 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:16.947699 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214ed6f-b85d-4e59-9fa3-9ab317d91249 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:16.950092 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a457c9-2977-4f2e-be8d-341b759bfafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:16.951009 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a457c9-2977-4f2e-be8d-341b759bfafa admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:16.951279 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a457c9-2977-4f2e-be8d-341b759bfafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:16.951549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a457c9-2977-4f2e-be8d-341b759bfafa admin admin] PATH_INFO: `/v3/projects/d5e8f35bd8844091accf4166f837f057/users/6e05fbada6264cfb826ae4c93254de5a/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:16.954919 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ecd5d-bb89-45df-9f84-be0cd8303b87 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:16.959548 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f9e60-7f25-4b69-840c-e914f549d48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:16.960426 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f9e60-7f25-4b69-840c-e914f549d48e admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:16.960712 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f9e60-7f25-4b69-840c-e914f549d48e admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:16.961020 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f9e60-7f25-4b69-840c-e914f549d48e admin admin] PATH_INFO: `/v3/projects/b3fed4f483e84ec7a10b96de33677cbc/users/cef533d7373946dcb340fbf496070e9f/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:16.967583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a457c9-2977-4f2e-be8d-341b759bfafa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e8f35bd8844091accf4166f837f057, user_id=6e05fbada6264cfb826ae4c93254de5a, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:16.970366 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a457c9-2977-4f2e-be8d-341b759bfafa admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:16.977249 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f9e60-7f25-4b69-840c-e914f549d48e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3fed4f483e84ec7a10b96de33677cbc, user_id=cef533d7373946dcb340fbf496070e9f, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:16.979876 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f9e60-7f25-4b69-840c-e914f549d48e admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:17.108185 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 801/1605] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:18:16 2022] PUT /identity/v3/projects/d5e8f35bd8844091accf4166f837f057/users/6e05fbada6264cfb826ae4c93254de5a/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:17.113113 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a457c9-2977-4f2e-be8d-341b759bfafa admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:17.113262 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 805/1606] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:18:16 2022] PUT /identity/v3/projects/b3fed4f483e84ec7a10b96de33677cbc/users/cef533d7373946dcb340fbf496070e9f/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:17.113262 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f9e60-7f25-4b69-840c-e914f549d48e admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:17.176094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a457c9-2977-4f2e-be8d-341b759bfafa admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:17.176226 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f9e60-7f25-4b69-840c-e914f549d48e admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:17.180908 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98e24a-89eb-437d-a37e-f2acbc8a695d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:17.181197 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5f2f3-ebc2-4cf3-8bb0-22db80e751ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:17.181849 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98e24a-89eb-437d-a37e-f2acbc8a695d admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:17.181972 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5f2f3-ebc2-4cf3-8bb0-22db80e751ac admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:17.182744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98e24a-89eb-437d-a37e-f2acbc8a695d admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:17.182878 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5f2f3-ebc2-4cf3-8bb0-22db80e751ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:17.182968 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98e24a-89eb-437d-a37e-f2acbc8a695d admin admin] PATH_INFO: `/v3/projects/d30dff4ba8fe401989c5f8d53a79af4c/users/3eddc5541a26499995b06615dcfb821c/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:17.183052 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5f2f3-ebc2-4cf3-8bb0-22db80e751ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:17.183229 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5f2f3-ebc2-4cf3-8bb0-22db80e751ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:17.185301 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5f2f3-ebc2-4cf3-8bb0-22db80e751ac admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:17.205965 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98e24a-89eb-437d-a37e-f2acbc8a695d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d30dff4ba8fe401989c5f8d53a79af4c, user_id=3eddc5541a26499995b06615dcfb821c, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:17.209356 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98e24a-89eb-437d-a37e-f2acbc8a695d admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:17.275548 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 802/1607] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:18:17 2022] POST /identity/v3/projects => generated 371 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:17.276599 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5f2f3-ebc2-4cf3-8bb0-22db80e751ac admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:17.330562 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 806/1608] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:18:17 2022] PUT /identity/v3/projects/d30dff4ba8fe401989c5f8d53a79af4c/users/3eddc5541a26499995b06615dcfb821c/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:17.331607 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98e24a-89eb-437d-a37e-f2acbc8a695d admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:17.338137 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5f2f3-ebc2-4cf3-8bb0-22db80e751ac admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:17.421125 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98e24a-89eb-437d-a37e-f2acbc8a695d admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:17.426758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e42e80-d326-472f-b4b9-cab770274523 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:17.427342 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e42e80-d326-472f-b4b9-cab770274523 service nova] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:17.427624 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e42e80-d326-472f-b4b9-cab770274523 service nova] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:17.427898 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e42e80-d326-472f-b4b9-cab770274523 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:17.431293 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206d4c7-497d-48b0-b0db-1f3f2c1f4659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:17.432303 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206d4c7-497d-48b0-b0db-1f3f2c1f4659 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:17.432656 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206d4c7-497d-48b0-b0db-1f3f2c1f4659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:17.433034 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206d4c7-497d-48b0-b0db-1f3f2c1f4659 admin admin] PATH_INFO: `/v3/projects/097244bbea2d44a8b025c7dd6dfbaeef/users/b1fa4c7767d1429185a7e50370bb540b/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:17.443769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:17.451973 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206d4c7-497d-48b0-b0db-1f3f2c1f4659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=097244bbea2d44a8b025c7dd6dfbaeef, user_id=b1fa4c7767d1429185a7e50370bb540b, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:17.455336 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206d4c7-497d-48b0-b0db-1f3f2c1f4659 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:17.463741 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:17.492506 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e42e80-d326-472f-b4b9-cab770274523 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:17.494153 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e42e80-d326-472f-b4b9-cab770274523 service nova] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:17.503475 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 807/1609] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:17.505714 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e42e80-d326-472f-b4b9-cab770274523 service nova] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:17.514527 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e42e80-d326-472f-b4b9-cab770274523 service nova] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:17.519044 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053081a-6b6f-4728-8a43-fbbef76a85c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:17.519920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053081a-6b6f-4728-8a43-fbbef76a85c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:17.520772 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053081a-6b6f-4728-8a43-fbbef76a85c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:17.521077 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053081a-6b6f-4728-8a43-fbbef76a85c0 admin admin] PATH_INFO: `/v3/projects/43383a4476d847f797dfb43fbfc66e42/users/16265c4e556943369aa0cb3e961795bb/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:17.539455 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053081a-6b6f-4728-8a43-fbbef76a85c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43383a4476d847f797dfb43fbfc66e42, user_id=16265c4e556943369aa0cb3e961795bb, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:17.542225 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053081a-6b6f-4728-8a43-fbbef76a85c0 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:17.558905 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 803/1610] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:18:17 2022] PUT /identity/v3/projects/097244bbea2d44a8b025c7dd6dfbaeef/users/b1fa4c7767d1429185a7e50370bb540b/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:17.569747 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b19fbe-e25c-4477-93bc-8426ff2701e0 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:17.570040 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b19fbe-e25c-4477-93bc-8426ff2701e0 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:17.570322 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b19fbe-e25c-4477-93bc-8426ff2701e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:17.590322 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-82b19fbe-e25c-4477-93bc-8426ff2701e0 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:17.592132 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-82b19fbe-e25c-4477-93bc-8426ff2701e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:17.622312 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 808/1611] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:18:17 2022] PUT /identity/v3/projects/43383a4476d847f797dfb43fbfc66e42/users/16265c4e556943369aa0cb3e961795bb/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:17.623702 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a16d6c-c66a-415c-aaaa-32467a8fed3d None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:17.623978 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a16d6c-c66a-415c-aaaa-32467a8fed3d None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:17.624257 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a16d6c-c66a-415c-aaaa-32467a8fed3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:17.646034 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-60a16d6c-c66a-415c-aaaa-32467a8fed3d None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:17.647442 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-60a16d6c-c66a-415c-aaaa-32467a8fed3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:17.698855 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 804/1612] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:17.700120 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b19fbe-e25c-4477-93bc-8426ff2701e0 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:17.715642 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b19fbe-e25c-4477-93bc-8426ff2701e0 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:17.739803 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 809/1613] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:17.739803 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf051502-32f3-46ba-a8c6-aac463e64c88 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:17.739803 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf051502-32f3-46ba-a8c6-aac463e64c88 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:17.739803 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf051502-32f3-46ba-a8c6-aac463e64c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:17.775117 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-cf051502-32f3-46ba-a8c6-aac463e64c88 None None] MFA Rules not processed for user `3eddc5541a26499995b06615dcfb821c`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:17.776317 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-cf051502-32f3-46ba-a8c6-aac463e64c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:17.787511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c7c1c-db78-4634-9fa8-024ed3382f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:17.788186 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c7c1c-db78-4634-9fa8-024ed3382f8a admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:17.788474 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c7c1c-db78-4634-9fa8-024ed3382f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:17.788755 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c7c1c-db78-4634-9fa8-024ed3382f8a admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:17.789633 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c7c1c-db78-4634-9fa8-024ed3382f8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:17.791734 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c7c1c-db78-4634-9fa8-024ed3382f8a admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:17.842911 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 810/1614] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:17.844198 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49640502-0e49-4936-950b-faf12a431ec1 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:17.844490 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49640502-0e49-4936-950b-faf12a431ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:17.844773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49640502-0e49-4936-950b-faf12a431ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:17.875666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 805/1615] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:18:17 2022] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:17.883931 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51247ce9-e5f7-4e0e-a7de-d370f0165bb1 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:17.884326 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51247ce9-e5f7-4e0e-a7de-d370f0165bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:17.885742 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51247ce9-e5f7-4e0e-a7de-d370f0165bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:17.885866 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-49640502-0e49-4936-950b-faf12a431ec1 None None] MFA Rules not processed for user `b1fa4c7767d1429185a7e50370bb540b`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:17.887296 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-49640502-0e49-4936-950b-faf12a431ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:17.907467 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-51247ce9-e5f7-4e0e-a7de-d370f0165bb1 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:17.909252 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-51247ce9-e5f7-4e0e-a7de-d370f0165bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:17.916921 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:17.919592 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 806/1616] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:17.920705 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51247ce9-e5f7-4e0e-a7de-d370f0165bb1 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:17.922798 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-51247ce9-e5f7-4e0e-a7de-d370f0165bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:17.958451 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 811/1617] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:17.960013 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf516af2-fc70-47e2-8a2f-4dc4780b6314 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:17.960300 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf516af2-fc70-47e2-8a2f-4dc4780b6314 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:17.960577 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf516af2-fc70-47e2-8a2f-4dc4780b6314 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:17.962044 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 812/1618] 10.222.0.46 () {54 vars in 912 bytes} [Wed Jun 22 10:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:18:17.962793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf516af2-fc70-47e2-8a2f-4dc4780b6314 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:17.964436 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-cf516af2-fc70-47e2-8a2f-4dc4780b6314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:17.986370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51247ce9-e5f7-4e0e-a7de-d370f0165bb1 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:17.990054 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20465a-9e45-4f84-89f8-0944df64955c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:17.990741 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20465a-9e45-4f84-89f8-0944df64955c service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:17.991058 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20465a-9e45-4f84-89f8-0944df64955c service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:17.991339 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20465a-9e45-4f84-89f8-0944df64955c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:18.000756 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20465a-9e45-4f84-89f8-0944df64955c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:18.002247 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20465a-9e45-4f84-89f8-0944df64955c service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:18.012392 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 807/1619] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:18.013941 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11056bc-10f0-4c2f-ab12-d5ea4c9c5477 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:18.014232 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11056bc-10f0-4c2f-ab12-d5ea4c9c5477 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:18.014511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11056bc-10f0-4c2f-ab12-d5ea4c9c5477 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:18.016094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 808/1620] 10.222.0.46 () {54 vars in 961 bytes} [Wed Jun 22 10:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:18:18.017070 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11056bc-10f0-4c2f-ab12-d5ea4c9c5477 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:18.025376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf516af2-fc70-47e2-8a2f-4dc4780b6314 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:18.028204 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ddbb1-7f44-420d-9555-629dcc5912b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:18.028981 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ddbb1-7f44-420d-9555-629dcc5912b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:18.029333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ddbb1-7f44-420d-9555-629dcc5912b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:18.029681 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ddbb1-7f44-420d-9555-629dcc5912b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:18.031428 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11056bc-10f0-4c2f-ab12-d5ea4c9c5477 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:18.037409 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723959b6-c543-4438-ae25-3786fe5b1f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:18.038118 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723959b6-c543-4438-ae25-3786fe5b1f49 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:18.038403 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723959b6-c543-4438-ae25-3786fe5b1f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:18.038684 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723959b6-c543-4438-ae25-3786fe5b1f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:18.039424 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723959b6-c543-4438-ae25-3786fe5b1f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:18.040726 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ddbb1-7f44-420d-9555-629dcc5912b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:18.041384 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723959b6-c543-4438-ae25-3786fe5b1f49 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:18.042118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ddbb1-7f44-420d-9555-629dcc5912b4 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:18.052034 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 813/1621] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:18.052891 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ddbb1-7f44-420d-9555-629dcc5912b4 service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:18.053010 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 809/1622] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:18.054136 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723959b6-c543-4438-ae25-3786fe5b1f49 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:18.061797 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:18.064396 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ddbb1-7f44-420d-9555-629dcc5912b4 service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:18.067789 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723959b6-c543-4438-ae25-3786fe5b1f49 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:18.068561 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f8c07-4234-4b8a-b82c-fc8caaf35697 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:18.069328 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f8c07-4234-4b8a-b82c-fc8caaf35697 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:18.069690 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f8c07-4234-4b8a-b82c-fc8caaf35697 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:18.070060 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f8c07-4234-4b8a-b82c-fc8caaf35697 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:18.072922 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43493c-9533-4bd7-a5ba-ddfa82a956dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:18.073579 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43493c-9533-4bd7-a5ba-ddfa82a956dc admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:18.073859 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43493c-9533-4bd7-a5ba-ddfa82a956dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:18.074135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43493c-9533-4bd7-a5ba-ddfa82a956dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:18.074824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43493c-9533-4bd7-a5ba-ddfa82a956dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:18.076923 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43493c-9533-4bd7-a5ba-ddfa82a956dc admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:18.080570 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f8c07-4234-4b8a-b82c-fc8caaf35697 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:18.082035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f8c07-4234-4b8a-b82c-fc8caaf35697 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:18.092373 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 814/1623] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:18.093665 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a684d-24a3-48c6-8466-2bda7703084c None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:18.094051 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a684d-24a3-48c6-8466-2bda7703084c None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:18.094421 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a684d-24a3-48c6-8466-2bda7703084c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:18.117179 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-ca0a684d-24a3-48c6-8466-2bda7703084c None None] MFA Rules not processed for user `4ed9a00723ab4af2b633ab7614d178a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:18.119158 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-ca0a684d-24a3-48c6-8466-2bda7703084c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:18.200453 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 810/1624] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:18:18 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:18.202570 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f7c07-e8c2-4342-9dae-d477b6c1f2bc None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:18.202957 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f7c07-e8c2-4342-9dae-d477b6c1f2bc None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:18.203926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 815/1625] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Jun 22 10:18:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:18.204085 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f7c07-e8c2-4342-9dae-d477b6c1f2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:18.206220 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a684d-24a3-48c6-8466-2bda7703084c None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:18.231323 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a684d-24a3-48c6-8466-2bda7703084c None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:18.235741 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-961f7c07-e8c2-4342-9dae-d477b6c1f2bc None None] MFA Rules not processed for user `4ed9a00723ab4af2b633ab7614d178a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:18.237533 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-961f7c07-e8c2-4342-9dae-d477b6c1f2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:18.308773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f142a-ec38-44d4-a8c0-59c01da3ceb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:18.310043 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f142a-ec38-44d4-a8c0-59c01da3ceb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:18.310580 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f142a-ec38-44d4-a8c0-59c01da3ceb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:18.310911 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f142a-ec38-44d4-a8c0-59c01da3ceb9 admin admin] PATH_INFO: `/v3/projects/671757a9f48d43b4a82c6a23f8aebfcf/users/d8fb6c2a17a64309b5f146b6d1db9e1f/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:18.331882 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f142a-ec38-44d4-a8c0-59c01da3ceb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=671757a9f48d43b4a82c6a23f8aebfcf, user_id=d8fb6c2a17a64309b5f146b6d1db9e1f, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:18.334808 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f142a-ec38-44d4-a8c0-59c01da3ceb9 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:18.345851 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 811/1626] 10.222.0.46 () {58 vars in 1058 bytes} [Wed Jun 22 10:18:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:18.347848 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f7c07-e8c2-4342-9dae-d477b6c1f2bc None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:18.362706 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f7c07-e8c2-4342-9dae-d477b6c1f2bc None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:18.375747 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56981507-2ae8-4818-a0b2-8799d23cd4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:18.377795 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56981507-2ae8-4818-a0b2-8799d23cd4f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:18.378166 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56981507-2ae8-4818-a0b2-8799d23cd4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:18.378610 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56981507-2ae8-4818-a0b2-8799d23cd4f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:18.379487 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56981507-2ae8-4818-a0b2-8799d23cd4f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:18.383749 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56981507-2ae8-4818-a0b2-8799d23cd4f4 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:18.432257 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 816/1627] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:18:18 2022] PUT /identity/v3/projects/671757a9f48d43b4a82c6a23f8aebfcf/users/d8fb6c2a17a64309b5f146b6d1db9e1f/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:18.432257 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f142a-ec38-44d4-a8c0-59c01da3ceb9 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:18.478938 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 812/1628] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:18:18 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:18.481105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56981507-2ae8-4818-a0b2-8799d23cd4f4 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:18.502473 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56981507-2ae8-4818-a0b2-8799d23cd4f4 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:18.507594 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f142a-ec38-44d4-a8c0-59c01da3ceb9 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:18.512861 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99747844-6de9-4354-840a-d07e5130c7b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:18.513868 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99747844-6de9-4354-840a-d07e5130c7b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:18.514258 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99747844-6de9-4354-840a-d07e5130c7b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:18.514638 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99747844-6de9-4354-840a-d07e5130c7b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:18.624365 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5d2cf-a25a-4a38-956f-f12304749b4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:18.625083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5d2cf-a25a-4a38-956f-f12304749b4b service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:18.625365 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5d2cf-a25a-4a38-956f-f12304749b4b service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:18.625901 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5d2cf-a25a-4a38-956f-f12304749b4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:18.654329 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99747844-6de9-4354-840a-d07e5130c7b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:18.655979 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99747844-6de9-4354-840a-d07e5130c7b2 service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:18.676032 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 817/1629] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:18.677138 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99747844-6de9-4354-840a-d07e5130c7b2 service cinder] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:18.731576 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5d2cf-a25a-4a38-956f-f12304749b4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:18.733935 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5d2cf-a25a-4a38-956f-f12304749b4b service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:18.747236 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 813/1630] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:18.748171 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5d2cf-a25a-4a38-956f-f12304749b4b service nova] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:18.879020 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99747844-6de9-4354-840a-d07e5130c7b2 service cinder] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:18.896929 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2e33f-2a7a-4c0d-b6f6-83cae46f6cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:18.898087 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2e33f-2a7a-4c0d-b6f6-83cae46f6cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:18.898372 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2e33f-2a7a-4c0d-b6f6-83cae46f6cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:18.898955 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2e33f-2a7a-4c0d-b6f6-83cae46f6cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:18.899700 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2e33f-2a7a-4c0d-b6f6-83cae46f6cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:18.909592 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2e33f-2a7a-4c0d-b6f6-83cae46f6cb1 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:18.910139 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5d2cf-a25a-4a38-956f-f12304749b4b service nova] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:18.933196 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d6f58-d555-48ad-b6dc-fd3a44c09336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:18.933887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d6f58-d555-48ad-b6dc-fd3a44c09336 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:18.934314 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d6f58-d555-48ad-b6dc-fd3a44c09336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:18.936230 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d6f58-d555-48ad-b6dc-fd3a44c09336 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:18.937023 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d6f58-d555-48ad-b6dc-fd3a44c09336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:18.942450 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d6f58-d555-48ad-b6dc-fd3a44c09336 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:18.951634 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 818/1631] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:18.956318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2e33f-2a7a-4c0d-b6f6-83cae46f6cb1 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:18.973624 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:18.984695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2e33f-2a7a-4c0d-b6f6-83cae46f6cb1 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:18.989671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 814/1632] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:18.990570 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d6f58-d555-48ad-b6dc-fd3a44c09336 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:18.995936 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5046c-65b1-486b-bc66-3ff2a68d27e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:18.996934 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5046c-65b1-486b-bc66-3ff2a68d27e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:18.997663 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5046c-65b1-486b-bc66-3ff2a68d27e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:18.997663 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5046c-65b1-486b-bc66-3ff2a68d27e8 admin admin] PATH_INFO: `/v3/projects/671757a9f48d43b4a82c6a23f8aebfcf/users/d8fb6c2a17a64309b5f146b6d1db9e1f/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:18.999625 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5046c-65b1-486b-bc66-3ff2a68d27e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=671757a9f48d43b4a82c6a23f8aebfcf, user_id=d8fb6c2a17a64309b5f146b6d1db9e1f, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:19.002471 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5046c-65b1-486b-bc66-3ff2a68d27e8 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:19.005308 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d6f58-d555-48ad-b6dc-fd3a44c09336 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:19.011795 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ccb3e-856d-48ae-8c97-87ba836c3df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:19.013241 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ccb3e-856d-48ae-8c97-87ba836c3df4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:19.013904 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ccb3e-856d-48ae-8c97-87ba836c3df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:19.014412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ccb3e-856d-48ae-8c97-87ba836c3df4 admin admin] PATH_INFO: `/v3/projects/7344ebdd4fd5473eb76e1936b05529ba/users/c6feb4f7a72940ac8d45340412cb4b0f/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:19.025511 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 819/1633] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:18:18 2022] PUT /identity/v3/projects/671757a9f48d43b4a82c6a23f8aebfcf/users/d8fb6c2a17a64309b5f146b6d1db9e1f/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:19.026941 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebedbf-f1da-4a2a-9eb9-0e7b67fde79a None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:19.027237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebedbf-f1da-4a2a-9eb9-0e7b67fde79a None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:19.027517 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebedbf-f1da-4a2a-9eb9-0e7b67fde79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:19.037603 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ccb3e-856d-48ae-8c97-87ba836c3df4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7344ebdd4fd5473eb76e1936b05529ba, user_id=c6feb4f7a72940ac8d45340412cb4b0f, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:19.040973 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ccb3e-856d-48ae-8c97-87ba836c3df4 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:19.046907 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:19.065651 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-85ebedbf-f1da-4a2a-9eb9-0e7b67fde79a None None] MFA Rules not processed for user `d8fb6c2a17a64309b5f146b6d1db9e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:19.066923 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-85ebedbf-f1da-4a2a-9eb9-0e7b67fde79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:19.178679 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 815/1634] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:18:18 2022] PUT /identity/v3/projects/7344ebdd4fd5473eb76e1936b05529ba/users/c6feb4f7a72940ac8d45340412cb4b0f/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:19.183361 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ccb3e-856d-48ae-8c97-87ba836c3df4 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:19.207091 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 820/1635] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:19 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:19.226375 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebedbf-f1da-4a2a-9eb9-0e7b67fde79a None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:19.300779 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ccb3e-856d-48ae-8c97-87ba836c3df4 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:19.330600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a0a9b-6f77-4359-b73d-ed33013a7016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:19.331347 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a0a9b-6f77-4359-b73d-ed33013a7016 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:19.331559 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a0a9b-6f77-4359-b73d-ed33013a7016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:19.331837 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a0a9b-6f77-4359-b73d-ed33013a7016 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:19.333258 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a0a9b-6f77-4359-b73d-ed33013a7016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:19.335447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a0a9b-6f77-4359-b73d-ed33013a7016 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:19.337821 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebedbf-f1da-4a2a-9eb9-0e7b67fde79a None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:19.356207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:19.369774 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 816/1636] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:18:19.371658 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37041fbc-3349-4dcc-bd67-80ff68e44985 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:19.371952 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37041fbc-3349-4dcc-bd67-80ff68e44985 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:19.372616 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37041fbc-3349-4dcc-bd67-80ff68e44985 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:19.374244 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 817/1637] 10.222.0.46 () {54 vars in 912 bytes} [Wed Jun 22 10:18:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:18:19.374977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37041fbc-3349-4dcc-bd67-80ff68e44985 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:19.388566 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37041fbc-3349-4dcc-bd67-80ff68e44985 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:19.395316 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0817d-6dd8-454f-9292-f24e753c5f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:19.396088 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0817d-6dd8-454f-9292-f24e753c5f9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:19.396088 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0817d-6dd8-454f-9292-f24e753c5f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:19.396291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0817d-6dd8-454f-9292-f24e753c5f9c admin admin] PATH_INFO: `/v3/projects/7344ebdd4fd5473eb76e1936b05529ba/users/c6feb4f7a72940ac8d45340412cb4b0f/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:19.398726 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc0817d-6dd8-454f-9292-f24e753c5f9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7344ebdd4fd5473eb76e1936b05529ba, user_id=c6feb4f7a72940ac8d45340412cb4b0f, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:19.401904 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc0817d-6dd8-454f-9292-f24e753c5f9c admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:19.428803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 818/1638] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:18:19 2022] PUT /identity/v3/projects/7344ebdd4fd5473eb76e1936b05529ba/users/c6feb4f7a72940ac8d45340412cb4b0f/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:19.430564 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c526eb2-ce00-4a71-a4d5-fb9b5290e1fb None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:19.430787 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c526eb2-ce00-4a71-a4d5-fb9b5290e1fb None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:19.431012 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c526eb2-ce00-4a71-a4d5-fb9b5290e1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:19.453972 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-5c526eb2-ce00-4a71-a4d5-fb9b5290e1fb None None] MFA Rules not processed for user `4ed9a00723ab4af2b633ab7614d178a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:19.467732 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-5c526eb2-ce00-4a71-a4d5-fb9b5290e1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:19.476452 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f00d1-36ff-4f22-be95-fb83f84cfb62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:19.477376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f00d1-36ff-4f22-be95-fb83f84cfb62 service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:19.477664 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f00d1-36ff-4f22-be95-fb83f84cfb62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:19.477943 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f00d1-36ff-4f22-be95-fb83f84cfb62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:19.618041 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 819/1639] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Jun 22 10:18:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:19.619720 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d9e6b-16d2-4d8d-85ed-4e18ea0b0117 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:19.620100 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d9e6b-16d2-4d8d-85ed-4e18ea0b0117 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:19.620738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d9e6b-16d2-4d8d-85ed-4e18ea0b0117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:19.638506 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f00d1-36ff-4f22-be95-fb83f84cfb62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:19.643531 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f00d1-36ff-4f22-be95-fb83f84cfb62 service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:19.656205 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-ce7d9e6b-16d2-4d8d-85ed-4e18ea0b0117 None None] MFA Rules not processed for user `c6feb4f7a72940ac8d45340412cb4b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:19.658678 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 821/1640] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:19 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:18:19.662444 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-ce7d9e6b-16d2-4d8d-85ed-4e18ea0b0117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:20.016593 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 820/1641] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:20.017805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f00d1-36ff-4f22-be95-fb83f84cfb62 service cinder] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:20.017805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f00d1-36ff-4f22-be95-fb83f84cfb62 service cinder] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:20.017805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060a7e9-4f40-40f2-ba8d-6382d87061d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:20.017805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060a7e9-4f40-40f2-ba8d-6382d87061d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:20.018330 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060a7e9-4f40-40f2-ba8d-6382d87061d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:20.018330 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060a7e9-4f40-40f2-ba8d-6382d87061d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:20.018330 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060a7e9-4f40-40f2-ba8d-6382d87061d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:20.018330 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060a7e9-4f40-40f2-ba8d-6382d87061d8 service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:20.018330 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 822/1642] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:20.135909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:20.204925 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d9e6b-16d2-4d8d-85ed-4e18ea0b0117 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:20.217953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d9e6b-16d2-4d8d-85ed-4e18ea0b0117 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:20.224304 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306d0c1-9964-4ab2-870b-ae98eeee5575 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:20.227008 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306d0c1-9964-4ab2-870b-ae98eeee5575 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:20.227008 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306d0c1-9964-4ab2-870b-ae98eeee5575 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:20.227008 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306d0c1-9964-4ab2-870b-ae98eeee5575 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:20.236715 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306d0c1-9964-4ab2-870b-ae98eeee5575 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:20.239489 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306d0c1-9964-4ab2-870b-ae98eeee5575 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:20.251158 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 821/1643] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:20 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:20.588252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:20.902015 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060a7e9-4f40-40f2-ba8d-6382d87061d8 service cinder] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:20.915436 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060a7e9-4f40-40f2-ba8d-6382d87061d8 service cinder] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:20.920783 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1df405-f946-4a0e-933c-279f2da5cffa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:20.921671 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1df405-f946-4a0e-933c-279f2da5cffa service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:20.926814 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1df405-f946-4a0e-933c-279f2da5cffa service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:20.926814 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1df405-f946-4a0e-933c-279f2da5cffa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:20.993040 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1df405-f946-4a0e-933c-279f2da5cffa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:20.994689 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1df405-f946-4a0e-933c-279f2da5cffa service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:21.032038 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 823/1644] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:22.280640 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306d0c1-9964-4ab2-870b-ae98eeee5575 service cinder] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:22.450526 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306d0c1-9964-4ab2-870b-ae98eeee5575 service cinder] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:22.461576 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c13db3-9dc1-43b1-b401-6513ac4a35a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:22.462489 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c13db3-9dc1-43b1-b401-6513ac4a35a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:22.462771 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c13db3-9dc1-43b1-b401-6513ac4a35a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:22.463379 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c13db3-9dc1-43b1-b401-6513ac4a35a2 admin admin] PATH_INFO: `/v3/users/d70a62962d3841059aecaaff8ce95953` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:22.468209 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c13db3-9dc1-43b1-b401-6513ac4a35a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d70a62962d3841059aecaaff8ce95953)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:22.469381 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: WARNING py.warnings [None req-63c13db3-9dc1-43b1-b401-6513ac4a35a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:18:22.469381 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: warnings.warn(msg) Jun 22 10:18:22.469381 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: Jun 22 10:18:22.470761 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c13db3-9dc1-43b1-b401-6513ac4a35a2 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:22.772410 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-63c13db3-9dc1-43b1-b401-6513ac4a35a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd70a62962d3841059aecaaff8ce95953'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:22.792703 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:22.827150 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-63c13db3-9dc1-43b1-b401-6513ac4a35a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd70a62962d3841059aecaaff8ce95953'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:22.912116 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-63c13db3-9dc1-43b1-b401-6513ac4a35a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd70a62962d3841059aecaaff8ce95953'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:22.914808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-63c13db3-9dc1-43b1-b401-6513ac4a35a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd70a62962d3841059aecaaff8ce95953'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:22.943179 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-63c13db3-9dc1-43b1-b401-6513ac4a35a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd70a62962d3841059aecaaff8ce95953'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:22.964054 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 822/1645] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:18:22 2022] DELETE /identity/v3/users/d70a62962d3841059aecaaff8ce95953 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:22.966462 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccddc3c-9a5b-4f5d-b49b-a82deb2cb953 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:22.977682 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccddc3c-9a5b-4f5d-b49b-a82deb2cb953 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:22.977682 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccddc3c-9a5b-4f5d-b49b-a82deb2cb953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:22.999336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-8ccddc3c-9a5b-4f5d-b49b-a82deb2cb953 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:23.000773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-8ccddc3c-9a5b-4f5d-b49b-a82deb2cb953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:23.108208 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 824/1646] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:23.130800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c13db3-9dc1-43b1-b401-6513ac4a35a2 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:23.134750 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-63c13db3-9dc1-43b1-b401-6513ac4a35a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:23.278831 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c13db3-9dc1-43b1-b401-6513ac4a35a2 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:23.289014 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde29901-10ef-4da4-9cf3-cedab0146e0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:23.292585 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde29901-10ef-4da4-9cf3-cedab0146e0f service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:23.292915 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde29901-10ef-4da4-9cf3-cedab0146e0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:23.295035 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde29901-10ef-4da4-9cf3-cedab0146e0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:23.319783 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde29901-10ef-4da4-9cf3-cedab0146e0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:23.323697 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde29901-10ef-4da4-9cf3-cedab0146e0f service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:23.350148 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 823/1647] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:25.475400 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccddc3c-9a5b-4f5d-b49b-a82deb2cb953 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:25.478069 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-8ccddc3c-9a5b-4f5d-b49b-a82deb2cb953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:25.499547 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccddc3c-9a5b-4f5d-b49b-a82deb2cb953 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:25.507393 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00484b-e29e-4dfe-a848-0284cfd71fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:25.517006 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00484b-e29e-4dfe-a848-0284cfd71fae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:25.517006 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00484b-e29e-4dfe-a848-0284cfd71fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:25.517006 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00484b-e29e-4dfe-a848-0284cfd71fae admin admin] PATH_INFO: `/v3/projects/4e95ca5822da4c728cc35e6d67d7a80e` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:25.517006 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00484b-e29e-4dfe-a848-0284cfd71fae admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e95ca5822da4c728cc35e6d67d7a80e)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:25.518917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: WARNING py.warnings [None req-3e00484b-e29e-4dfe-a848-0284cfd71fae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:18:25.518917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: warnings.warn(msg) Jun 22 10:18:25.518917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: Jun 22 10:18:25.521766 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00484b-e29e-4dfe-a848-0284cfd71fae admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:25.567957 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:25.673665 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-3e00484b-e29e-4dfe-a848-0284cfd71fae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e95ca5822da4c728cc35e6d67d7a80e', 'request_id': 'req-3e00484b-e29e-4dfe-a848-0284cfd71fae'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:25.688498 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-3e00484b-e29e-4dfe-a848-0284cfd71fae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e95ca5822da4c728cc35e6d67d7a80e', 'request_id': 'req-3e00484b-e29e-4dfe-a848-0284cfd71fae'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:25.804135 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-3e00484b-e29e-4dfe-a848-0284cfd71fae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e95ca5822da4c728cc35e6d67d7a80e', 'request_id': 'req-3e00484b-e29e-4dfe-a848-0284cfd71fae'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:25.849837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-3e00484b-e29e-4dfe-a848-0284cfd71fae admin admin] The token cache is being invalidate because project 4e95ca5822da4c728cc35e6d67d7a80e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:18:25.849837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-3e00484b-e29e-4dfe-a848-0284cfd71fae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:25.854165 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-3e00484b-e29e-4dfe-a848-0284cfd71fae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:25.862921 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 825/1648] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:18:25 2022] DELETE /identity/v3/projects/4e95ca5822da4c728cc35e6d67d7a80e => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:25.868469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde29901-10ef-4da4-9cf3-cedab0146e0f service neutron] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:25.886198 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde29901-10ef-4da4-9cf3-cedab0146e0f service neutron] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:26.090897 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e62c71-d9e4-4738-af19-7f2293f4083b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:26.091684 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e62c71-d9e4-4738-af19-7f2293f4083b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:26.091966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e62c71-d9e4-4738-af19-7f2293f4083b admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:26.092242 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e62c71-d9e4-4738-af19-7f2293f4083b admin admin] PATH_INFO: `/v3/users/d8fb6c2a17a64309b5f146b6d1db9e1f` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:26.094241 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e62c71-d9e4-4738-af19-7f2293f4083b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8fb6c2a17a64309b5f146b6d1db9e1f)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:26.096230 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e62c71-d9e4-4738-af19-7f2293f4083b admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:26.360711 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e9e62c71-d9e4-4738-af19-7f2293f4083b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8fb6c2a17a64309b5f146b6d1db9e1f'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:26.386545 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e9e62c71-d9e4-4738-af19-7f2293f4083b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8fb6c2a17a64309b5f146b6d1db9e1f'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:26.454000 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e9e62c71-d9e4-4738-af19-7f2293f4083b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8fb6c2a17a64309b5f146b6d1db9e1f'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:26.454647 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e9e62c71-d9e4-4738-af19-7f2293f4083b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8fb6c2a17a64309b5f146b6d1db9e1f'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:26.464411 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:26.466793 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e9e62c71-d9e4-4738-af19-7f2293f4083b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8fb6c2a17a64309b5f146b6d1db9e1f'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:26.492367 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 824/1649] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:18:25 2022] DELETE /identity/v3/users/d8fb6c2a17a64309b5f146b6d1db9e1f => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:27.952010 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00484b-e29e-4dfe-a848-0284cfd71fae admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:27.954773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-3e00484b-e29e-4dfe-a848-0284cfd71fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:27.983277 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50284605-338d-40e0-899c-12028f860879 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:27.987600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50284605-338d-40e0-899c-12028f860879 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:27.987600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50284605-338d-40e0-899c-12028f860879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:28.005972 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00484b-e29e-4dfe-a848-0284cfd71fae admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:28.054393 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-50284605-338d-40e0-899c-12028f860879 None None] MFA Rules not processed for user `425bf40bd45642a1aafeb65bdb9650af`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:28.058656 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-50284605-338d-40e0-899c-12028f860879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:28.238810 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41841a27-cdf9-48b7-b864-f232630d87ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:28.238810 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41841a27-cdf9-48b7-b864-f232630d87ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:28.238810 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41841a27-cdf9-48b7-b864-f232630d87ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:28.238810 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41841a27-cdf9-48b7-b864-f232630d87ff admin admin] PATH_INFO: `/v3/projects/671757a9f48d43b4a82c6a23f8aebfcf` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:28.241130 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41841a27-cdf9-48b7-b864-f232630d87ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=671757a9f48d43b4a82c6a23f8aebfcf)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:28.243094 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41841a27-cdf9-48b7-b864-f232630d87ff admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:28.253876 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 825/1650] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:18:28.264080 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c125dd-c93d-4125-989d-50e32147b205 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:28.264708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c125dd-c93d-4125-989d-50e32147b205 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:28.265045 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c125dd-c93d-4125-989d-50e32147b205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:28.297214 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-73c125dd-c93d-4125-989d-50e32147b205 None None] MFA Rules not processed for user `425bf40bd45642a1aafeb65bdb9650af`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:28.302090 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-73c125dd-c93d-4125-989d-50e32147b205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:28.322489 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 826/1651] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:18:28.335829 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c125dd-c93d-4125-989d-50e32147b205 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:28.337923 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-73c125dd-c93d-4125-989d-50e32147b205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:28.418302 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-41841a27-cdf9-48b7-b864-f232630d87ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '671757a9f48d43b4a82c6a23f8aebfcf', 'request_id': 'req-41841a27-cdf9-48b7-b864-f232630d87ff'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:28.435598 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-41841a27-cdf9-48b7-b864-f232630d87ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '671757a9f48d43b4a82c6a23f8aebfcf', 'request_id': 'req-41841a27-cdf9-48b7-b864-f232630d87ff'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:28.518236 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c125dd-c93d-4125-989d-50e32147b205 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:28.529444 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-41841a27-cdf9-48b7-b864-f232630d87ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '671757a9f48d43b4a82c6a23f8aebfcf', 'request_id': 'req-41841a27-cdf9-48b7-b864-f232630d87ff'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:28.563190 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-41841a27-cdf9-48b7-b864-f232630d87ff admin admin] The token cache is being invalidate because project 671757a9f48d43b4a82c6a23f8aebfcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:18:28.563481 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-41841a27-cdf9-48b7-b864-f232630d87ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:28.567556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-41841a27-cdf9-48b7-b864-f232630d87ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:28.573767 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 826/1652] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:18:27 2022] DELETE /identity/v3/projects/671757a9f48d43b4a82c6a23f8aebfcf => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:28.575265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3266c18-0a08-4de3-bd4d-19a9735adfda None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:28.575556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3266c18-0a08-4de3-bd4d-19a9735adfda None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:28.575830 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3266c18-0a08-4de3-bd4d-19a9735adfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:28.605921 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-c3266c18-0a08-4de3-bd4d-19a9735adfda None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:28.611604 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-c3266c18-0a08-4de3-bd4d-19a9735adfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:28.719727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:28.759761 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8bc9c-90cb-47bd-83a0-98859f5a46ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:28.764875 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8bc9c-90cb-47bd-83a0-98859f5a46ae service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:28.765320 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8bc9c-90cb-47bd-83a0-98859f5a46ae service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:28.765739 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8bc9c-90cb-47bd-83a0-98859f5a46ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:28.775747 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-b5b8bc9c-90cb-47bd-83a0-98859f5a46ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:28.797623 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 827/1653] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:28.808155 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc14bee-7679-49b6-8fac-f288111d1f81 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:28.808681 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:28.809692 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc14bee-7679-49b6-8fac-f288111d1f81 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:28.817156 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc14bee-7679-49b6-8fac-f288111d1f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:28.851458 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-5bc14bee-7679-49b6-8fac-f288111d1f81 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:28.854427 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-5bc14bee-7679-49b6-8fac-f288111d1f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:28.883663 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 828/1654] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:28.891993 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc14bee-7679-49b6-8fac-f288111d1f81 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:28.912668 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc14bee-7679-49b6-8fac-f288111d1f81 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:28.926592 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8bc9c-90cb-47bd-83a0-98859f5a46ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:28.929835 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8bc9c-90cb-47bd-83a0-98859f5a46ae service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:28.929954 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c653a6-42cc-49f7-a9a3-6a3f09310a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:28.930495 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c653a6-42cc-49f7-a9a3-6a3f09310a23 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:28.930920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c653a6-42cc-49f7-a9a3-6a3f09310a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:28.931358 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c653a6-42cc-49f7-a9a3-6a3f09310a23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:28.933089 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c653a6-42cc-49f7-a9a3-6a3f09310a23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:18:28.933805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c653a6-42cc-49f7-a9a3-6a3f09310a23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:28.935599 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c653a6-42cc-49f7-a9a3-6a3f09310a23 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:28.978264 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 829/1655] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:18:28.981124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c653a6-42cc-49f7-a9a3-6a3f09310a23 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:28.990725 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 827/1656] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:18:29.022999 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c653a6-42cc-49f7-a9a3-6a3f09310a23 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:29.034870 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbc722-3d90-48cb-a19f-a6ad9fdfa3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:29.035544 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbc722-3d90-48cb-a19f-a6ad9fdfa3fa admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:29.035833 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbc722-3d90-48cb-a19f-a6ad9fdfa3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:29.036125 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbc722-3d90-48cb-a19f-a6ad9fdfa3fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:29.036850 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbc722-3d90-48cb-a19f-a6ad9fdfa3fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:29.038776 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbc722-3d90-48cb-a19f-a6ad9fdfa3fa admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:29.208333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 830/1657] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:18:28 2022] POST /identity/v3/projects => generated 365 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:29.211434 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8bc9c-90cb-47bd-83a0-98859f5a46ae service nova] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:29.241337 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8bc9c-90cb-47bd-83a0-98859f5a46ae service nova] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:29.413558 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fd2bd-7dea-48c6-9a91-2d95c1091331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:29.414333 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fd2bd-7dea-48c6-9a91-2d95c1091331 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:29.414676 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fd2bd-7dea-48c6-9a91-2d95c1091331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:29.415734 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fd2bd-7dea-48c6-9a91-2d95c1091331 admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:29.416501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fd2bd-7dea-48c6-9a91-2d95c1091331 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:29.418663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fd2bd-7dea-48c6-9a91-2d95c1091331 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:29.633324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 828/1658] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:18:29 2022] POST /identity/v3/users => generated 283 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:29.637546 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbc722-3d90-48cb-a19f-a6ad9fdfa3fa admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:29.657828 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbc722-3d90-48cb-a19f-a6ad9fdfa3fa admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:29.677463 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862cc382-3b4f-4fe8-9c6c-5eb7bbebaf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:29.685426 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cc382-3b4f-4fe8-9c6c-5eb7bbebaf87 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:29.686447 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cc382-3b4f-4fe8-9c6c-5eb7bbebaf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:29.686447 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cc382-3b4f-4fe8-9c6c-5eb7bbebaf87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:29.687479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862cc382-3b4f-4fe8-9c6c-5eb7bbebaf87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:29.689407 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862cc382-3b4f-4fe8-9c6c-5eb7bbebaf87 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:29.720388 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 831/1659] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:29.724659 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fd2bd-7dea-48c6-9a91-2d95c1091331 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:29.748785 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fd2bd-7dea-48c6-9a91-2d95c1091331 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:29.780592 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c184a68-eceb-48ad-9156-d1c42bdcab04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:29.782300 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c184a68-eceb-48ad-9156-d1c42bdcab04 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:29.782591 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c184a68-eceb-48ad-9156-d1c42bdcab04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:29.784208 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c184a68-eceb-48ad-9156-d1c42bdcab04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:29.786630 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c184a68-eceb-48ad-9156-d1c42bdcab04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:29.792180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c184a68-eceb-48ad-9156-d1c42bdcab04 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:29.808010 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 829/1660] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:29.811877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862cc382-3b4f-4fe8-9c6c-5eb7bbebaf87 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:29.829073 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862cc382-3b4f-4fe8-9c6c-5eb7bbebaf87 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:29.840755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f3c97-6ea6-42a5-9a50-7d9598008f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:29.841746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f3c97-6ea6-42a5-9a50-7d9598008f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:29.842059 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f3c97-6ea6-42a5-9a50-7d9598008f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:29.846786 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f3c97-6ea6-42a5-9a50-7d9598008f2c admin admin] PATH_INFO: `/v3/projects/db33a76b7d1a449eadee7812dbea2d86/users/5773671c42ff4284a901907a31a07b62/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:29.882545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f3c97-6ea6-42a5-9a50-7d9598008f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=db33a76b7d1a449eadee7812dbea2d86, user_id=5773671c42ff4284a901907a31a07b62, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:29.885704 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f3c97-6ea6-42a5-9a50-7d9598008f2c admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:30.000094 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 832/1661] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:18:29 2022] PUT /identity/v3/projects/db33a76b7d1a449eadee7812dbea2d86/users/5773671c42ff4284a901907a31a07b62/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:30.009318 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec043df-a00d-4fcc-a77d-91f54b4b3564 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:30.010176 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec043df-a00d-4fcc-a77d-91f54b4b3564 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:30.010617 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec043df-a00d-4fcc-a77d-91f54b4b3564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:30.132494 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b3bb1-209a-48a6-ae7d-90126347c775 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:30.132494 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b3bb1-209a-48a6-ae7d-90126347c775 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:30.133177 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b3bb1-209a-48a6-ae7d-90126347c775 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:30.135844 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 833/1662] 10.222.0.46 () {54 vars in 912 bytes} [Wed Jun 22 10:18:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:18:30.141796 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-5ec043df-a00d-4fcc-a77d-91f54b4b3564 None None] MFA Rules not processed for user `5773671c42ff4284a901907a31a07b62`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:30.142171 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-5ec043df-a00d-4fcc-a77d-91f54b4b3564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:30.154337 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67508112-871e-446e-8a1b-8a94f693c1f0 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:30.161171 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67508112-871e-446e-8a1b-8a94f693c1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:30.161171 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67508112-871e-446e-8a1b-8a94f693c1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:30.285716 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-67508112-871e-446e-8a1b-8a94f693c1f0 None None] MFA Rules not processed for user `0bddc02875304e8c92ac367c8095efee`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:30.287326 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-67508112-871e-446e-8a1b-8a94f693c1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:30.366328 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 830/1663] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:30 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:30.366328 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec043df-a00d-4fcc-a77d-91f54b4b3564 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:30.370602 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-5ec043df-a00d-4fcc-a77d-91f54b4b3564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:30.417188 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:30.457893 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 834/1664] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Jun 22 10:18:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:18:30.457893 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67508112-871e-446e-8a1b-8a94f693c1f0 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:30.558208 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec043df-a00d-4fcc-a77d-91f54b4b3564 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:30.570114 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b20b40-a811-4a13-bf3e-292c3112f1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:30.571929 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b20b40-a811-4a13-bf3e-292c3112f1b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:30.572438 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b20b40-a811-4a13-bf3e-292c3112f1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:30.573403 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b20b40-a811-4a13-bf3e-292c3112f1b6 admin admin] PATH_INFO: `/v3/users/3eddc5541a26499995b06615dcfb821c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:30.578485 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b20b40-a811-4a13-bf3e-292c3112f1b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eddc5541a26499995b06615dcfb821c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:30.586453 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b20b40-a811-4a13-bf3e-292c3112f1b6 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:30.614973 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67508112-871e-446e-8a1b-8a94f693c1f0 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:30.629336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec2dfa-f5df-4f37-b76d-6022b6eb1c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:30.630393 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec2dfa-f5df-4f37-b76d-6022b6eb1c43 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:30.630857 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec2dfa-f5df-4f37-b76d-6022b6eb1c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:30.631452 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec2dfa-f5df-4f37-b76d-6022b6eb1c43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:30.632479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec2dfa-f5df-4f37-b76d-6022b6eb1c43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:30.634632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec2dfa-f5df-4f37-b76d-6022b6eb1c43 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:30.644002 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:30.821604 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 835/1665] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:18:30 2022] POST /identity/v3/projects => generated 363 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:30.823307 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec2dfa-f5df-4f37-b76d-6022b6eb1c43 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:30.826142 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-49ec2dfa-f5df-4f37-b76d-6022b6eb1c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:30.944390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec2dfa-f5df-4f37-b76d-6022b6eb1c43 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:30.950910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b2d0b-f550-4311-92d5-14b5d8866d80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:30.951649 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b2d0b-f550-4311-92d5-14b5d8866d80 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:30.951942 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b2d0b-f550-4311-92d5-14b5d8866d80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:30.952228 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b2d0b-f550-4311-92d5-14b5d8866d80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:30.961795 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-37b20b40-a811-4a13-bf3e-292c3112f1b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eddc5541a26499995b06615dcfb821c'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:30.985457 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b2d0b-f550-4311-92d5-14b5d8866d80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:30.987189 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b2d0b-f550-4311-92d5-14b5d8866d80 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:30.999716 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-37b20b40-a811-4a13-bf3e-292c3112f1b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eddc5541a26499995b06615dcfb821c'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:31.016871 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 836/1666] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:31.021087 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bafa96-419c-47e4-a563-4b3e067e5948 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:31.022314 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bafa96-419c-47e4-a563-4b3e067e5948 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:31.022610 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bafa96-419c-47e4-a563-4b3e067e5948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:31.116665 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-37b20b40-a811-4a13-bf3e-292c3112f1b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eddc5541a26499995b06615dcfb821c'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:31.117372 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-37b20b40-a811-4a13-bf3e-292c3112f1b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eddc5541a26499995b06615dcfb821c'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:31.128875 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-37b20b40-a811-4a13-bf3e-292c3112f1b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eddc5541a26499995b06615dcfb821c'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:31.131422 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-45bafa96-419c-47e4-a563-4b3e067e5948 None None] MFA Rules not processed for user `6e05fbada6264cfb826ae4c93254de5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:31.133323 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-45bafa96-419c-47e4-a563-4b3e067e5948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:31.142765 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 831/1667] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:18:30 2022] DELETE /identity/v3/users/3eddc5541a26499995b06615dcfb821c => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:31.143631 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b20b40-a811-4a13-bf3e-292c3112f1b6 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:31.149637 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-37b20b40-a811-4a13-bf3e-292c3112f1b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:31.315323 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 837/1668] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:31.318700 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867dfde-2a6b-4da9-96b2-257ec4a2678d None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:31.322363 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867dfde-2a6b-4da9-96b2-257ec4a2678d None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:31.322363 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867dfde-2a6b-4da9-96b2-257ec4a2678d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:31.390713 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-6867dfde-2a6b-4da9-96b2-257ec4a2678d None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:31.392159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-6867dfde-2a6b-4da9-96b2-257ec4a2678d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:31.413105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b20b40-a811-4a13-bf3e-292c3112f1b6 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:31.414516 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 838/1669] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:31.421969 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a4822-0c8e-430b-b5a0-c4a440a902cc None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:31.422269 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a4822-0c8e-430b-b5a0-c4a440a902cc None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:31.422559 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a4822-0c8e-430b-b5a0-c4a440a902cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:31.433850 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25224f-bd4b-40d7-a736-15130a2f9041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:31.434574 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25224f-bd4b-40d7-a736-15130a2f9041 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:31.434780 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25224f-bd4b-40d7-a736-15130a2f9041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:31.435060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25224f-bd4b-40d7-a736-15130a2f9041 admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:31.440073 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25224f-bd4b-40d7-a736-15130a2f9041 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:31.456313 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25224f-bd4b-40d7-a736-15130a2f9041 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:31.491890 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-5c3a4822-0c8e-430b-b5a0-c4a440a902cc None None] MFA Rules not processed for user `6e05fbada6264cfb826ae4c93254de5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:31.496394 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-5c3a4822-0c8e-430b-b5a0-c4a440a902cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:31.606776 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 832/1670] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:18:31 2022] POST /identity/v3/users => generated 288 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:31.606776 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25224f-bd4b-40d7-a736-15130a2f9041 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:31.607843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-af25224f-bd4b-40d7-a736-15130a2f9041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:31.656778 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 839/1671] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:31.657896 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a4822-0c8e-430b-b5a0-c4a440a902cc None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:31.716752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a4822-0c8e-430b-b5a0-c4a440a902cc None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:31.732295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57701b30-2013-4a8b-882f-a64158ee34e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:31.733155 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57701b30-2013-4a8b-882f-a64158ee34e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:31.735132 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57701b30-2013-4a8b-882f-a64158ee34e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:31.735132 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57701b30-2013-4a8b-882f-a64158ee34e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:31.735306 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57701b30-2013-4a8b-882f-a64158ee34e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:31.745755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57701b30-2013-4a8b-882f-a64158ee34e1 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:31.777500 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 840/1672] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:31.779597 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57701b30-2013-4a8b-882f-a64158ee34e1 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:31.801514 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-57701b30-2013-4a8b-882f-a64158ee34e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:31.850015 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:31.850207 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:31.924625 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25224f-bd4b-40d7-a736-15130a2f9041 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:31.937825 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008b50f-e967-4809-b7f8-5f472450a5af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:31.938617 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008b50f-e967-4809-b7f8-5f472450a5af service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:31.938781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008b50f-e967-4809-b7f8-5f472450a5af service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:31.939054 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008b50f-e967-4809-b7f8-5f472450a5af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:31.962779 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a008b50f-e967-4809-b7f8-5f472450a5af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:31.964191 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a008b50f-e967-4809-b7f8-5f472450a5af service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:31.989420 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 833/1673] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:31.990264 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008b50f-e967-4809-b7f8-5f472450a5af service neutron] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:32.013828 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008b50f-e967-4809-b7f8-5f472450a5af service neutron] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:32.027071 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c49690-45bf-47fb-a225-8691c9849544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:32.030695 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c49690-45bf-47fb-a225-8691c9849544 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:32.030695 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c49690-45bf-47fb-a225-8691c9849544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:32.030695 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c49690-45bf-47fb-a225-8691c9849544 admin admin] PATH_INFO: `/v3/projects/a2ad16d2c29644538c752e2ec6acfc91/users/f2815b0993804fa98f846b8e17fe3200/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:32.062168 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57701b30-2013-4a8b-882f-a64158ee34e1 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:32.089172 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46630fb1-72a9-4578-bedc-495486d5061a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:32.090116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46630fb1-72a9-4578-bedc-495486d5061a service nova] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:32.090761 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46630fb1-72a9-4578-bedc-495486d5061a service nova] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:32.091150 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46630fb1-72a9-4578-bedc-495486d5061a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:32.098210 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c49690-45bf-47fb-a225-8691c9849544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2ad16d2c29644538c752e2ec6acfc91, user_id=f2815b0993804fa98f846b8e17fe3200, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:32.102475 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c49690-45bf-47fb-a225-8691c9849544 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:32.124293 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46630fb1-72a9-4578-bedc-495486d5061a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:32.132095 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46630fb1-72a9-4578-bedc-495486d5061a service nova] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:32.180313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 841/1674] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:32.221564 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 834/1675] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:18:31 2022] PUT /identity/v3/projects/a2ad16d2c29644538c752e2ec6acfc91/users/f2815b0993804fa98f846b8e17fe3200/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:32.222192 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46630fb1-72a9-4578-bedc-495486d5061a service nova] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:32.256339 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46630fb1-72a9-4578-bedc-495486d5061a service nova] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:32.326965 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598353fe-bc26-4fbd-a88b-7c44d94d9a69 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:32.327479 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598353fe-bc26-4fbd-a88b-7c44d94d9a69 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:32.327818 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598353fe-bc26-4fbd-a88b-7c44d94d9a69 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:32.329360 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 835/1676] 10.222.0.46 () {54 vars in 960 bytes} [Wed Jun 22 10:18:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:18:32.336974 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2aa143-e16e-4d53-a17c-2af82f559f24 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:32.343767 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2aa143-e16e-4d53-a17c-2af82f559f24 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:32.343767 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2aa143-e16e-4d53-a17c-2af82f559f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:32.395498 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-2e2aa143-e16e-4d53-a17c-2af82f559f24 None None] MFA Rules not processed for user `675892a676054b4f86f9ac12d95f4f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:32.400262 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-2e2aa143-e16e-4d53-a17c-2af82f559f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:32.533278 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85966299-92db-40c9-aa3f-3a4405fc6452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:32.533278 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85966299-92db-40c9-aa3f-3a4405fc6452 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:32.533278 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85966299-92db-40c9-aa3f-3a4405fc6452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:32.533278 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85966299-92db-40c9-aa3f-3a4405fc6452 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:32.533621 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85966299-92db-40c9-aa3f-3a4405fc6452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:32.536007 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85966299-92db-40c9-aa3f-3a4405fc6452 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:32.560496 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 842/1677] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:32.566093 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85966299-92db-40c9-aa3f-3a4405fc6452 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:32.594932 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85966299-92db-40c9-aa3f-3a4405fc6452 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:32.606230 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128504ec-05bf-42f9-b237-940b6a148245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:32.607301 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128504ec-05bf-42f9-b237-940b6a148245 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:32.607700 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128504ec-05bf-42f9-b237-940b6a148245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:32.608112 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128504ec-05bf-42f9-b237-940b6a148245 admin admin] PATH_INFO: `/v3/projects/a2ad16d2c29644538c752e2ec6acfc91/users/f2815b0993804fa98f846b8e17fe3200/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:32.615616 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 836/1678] 10.222.0.46 () {58 vars in 1057 bytes} [Wed Jun 22 10:18:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:18:32.617372 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128504ec-05bf-42f9-b237-940b6a148245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2ad16d2c29644538c752e2ec6acfc91, user_id=f2815b0993804fa98f846b8e17fe3200, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:32.617476 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9c93c-8725-455e-89dd-64f1d14abe72 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:32.617476 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9c93c-8725-455e-89dd-64f1d14abe72 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:32.617642 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9c93c-8725-455e-89dd-64f1d14abe72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:32.626755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128504ec-05bf-42f9-b237-940b6a148245 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:32.672121 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-dfd9c93c-8725-455e-89dd-64f1d14abe72 None None] MFA Rules not processed for user `425bf40bd45642a1aafeb65bdb9650af`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:32.677734 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-dfd9c93c-8725-455e-89dd-64f1d14abe72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:32.685296 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 843/1679] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:18:32 2022] PUT /identity/v3/projects/a2ad16d2c29644538c752e2ec6acfc91/users/f2815b0993804fa98f846b8e17fe3200/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:32.686748 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128504ec-05bf-42f9-b237-940b6a148245 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:32.877412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 837/1680] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:32.893359 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90823d38-5907-485c-9714-30ba6ea56a58 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:32.894261 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90823d38-5907-485c-9714-30ba6ea56a58 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:32.894499 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90823d38-5907-485c-9714-30ba6ea56a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:32.976687 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-90823d38-5907-485c-9714-30ba6ea56a58 None None] MFA Rules not processed for user `f2815b0993804fa98f846b8e17fe3200`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:32.979306 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-90823d38-5907-485c-9714-30ba6ea56a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:32.995338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128504ec-05bf-42f9-b237-940b6a148245 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:33.010990 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203fb1a-11bc-49aa-87f2-ccf5550cdc00 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '675892a676054b4f86f9ac12d95f4f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:33.011967 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203fb1a-11bc-49aa-87f2-ccf5550cdc00 service placement] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:33.012437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203fb1a-11bc-49aa-87f2-ccf5550cdc00 service placement] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:33.012897 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203fb1a-11bc-49aa-87f2-ccf5550cdc00 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:33.017333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-d203fb1a-11bc-49aa-87f2-ccf5550cdc00 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:33.047525 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203fb1a-11bc-49aa-87f2-ccf5550cdc00 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:33.049606 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203fb1a-11bc-49aa-87f2-ccf5550cdc00 service placement] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:33.062425 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 844/1681] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:33.064833 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd5d3f-346a-4b37-846c-268c34ce961c None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:33.068702 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd5d3f-346a-4b37-846c-268c34ce961c None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:33.068702 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd5d3f-346a-4b37-846c-268c34ce961c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:33.077659 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:33.106385 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:33.144949 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-99dd5d3f-346a-4b37-846c-268c34ce961c None None] MFA Rules not processed for user `16265c4e556943369aa0cb3e961795bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:33.146612 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-99dd5d3f-346a-4b37-846c-268c34ce961c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:33.201745 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 838/1682] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:32 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:33.215671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90823d38-5907-485c-9714-30ba6ea56a58 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:33.217392 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-90823d38-5907-485c-9714-30ba6ea56a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:33.392008 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 845/1683] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:33.394297 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683a1be-f06f-4bb3-9792-a1379f0c75b5 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:33.394297 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683a1be-f06f-4bb3-9792-a1379f0c75b5 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:33.394489 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683a1be-f06f-4bb3-9792-a1379f0c75b5 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:33.395808 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 846/1684] 10.222.0.46 () {54 vars in 912 bytes} [Wed Jun 22 10:18:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:18:33.408416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90823d38-5907-485c-9714-30ba6ea56a58 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:33.408956 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fd9eb-53aa-4481-aed4-452cac61f7df None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:33.409172 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fd9eb-53aa-4481-aed4-452cac61f7df None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:33.409536 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fd9eb-53aa-4481-aed4-452cac61f7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:33.433518 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461569b-e992-4cc5-bf6d-f74c25dd95d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:33.434345 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461569b-e992-4cc5-bf6d-f74c25dd95d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:33.434633 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461569b-e992-4cc5-bf6d-f74c25dd95d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:33.434913 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461569b-e992-4cc5-bf6d-f74c25dd95d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:33.449727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-ac5fd9eb-53aa-4481-aed4-452cac61f7df None None] MFA Rules not processed for user `0bddc02875304e8c92ac367c8095efee`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:33.450986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-ac5fd9eb-53aa-4481-aed4-452cac61f7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:33.467671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461569b-e992-4cc5-bf6d-f74c25dd95d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:33.469183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461569b-e992-4cc5-bf6d-f74c25dd95d7 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:33.516165 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 839/1685] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:33 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:33.654220 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 847/1686] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Jun 22 10:18:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:33.965689 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461569b-e992-4cc5-bf6d-f74c25dd95d7 service cinder] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:33.967165 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-f461569b-e992-4cc5-bf6d-f74c25dd95d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:34.009764 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461569b-e992-4cc5-bf6d-f74c25dd95d7 service cinder] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:34.026713 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0259bc-cf7a-41dc-85bd-04a70e196448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:34.028137 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0259bc-cf7a-41dc-85bd-04a70e196448 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:34.028137 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0259bc-cf7a-41dc-85bd-04a70e196448 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:34.028319 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0259bc-cf7a-41dc-85bd-04a70e196448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:34.056711 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0259bc-cf7a-41dc-85bd-04a70e196448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:34.058250 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0259bc-cf7a-41dc-85bd-04a70e196448 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:34.088623 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 840/1687] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:34.233743 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5fd9eb-53aa-4481-aed4-452cac61f7df None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:34.235293 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-ac5fd9eb-53aa-4481-aed4-452cac61f7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:34.431704 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5fd9eb-53aa-4481-aed4-452cac61f7df None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:34.439702 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0331f6-a811-4969-a1b4-916e80fb18c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:34.439923 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0331f6-a811-4969-a1b4-916e80fb18c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:34.440207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0331f6-a811-4969-a1b4-916e80fb18c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:34.443887 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0331f6-a811-4969-a1b4-916e80fb18c8 admin admin] PATH_INFO: `/v3/projects/d30dff4ba8fe401989c5f8d53a79af4c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:34.446548 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0331f6-a811-4969-a1b4-916e80fb18c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d30dff4ba8fe401989c5f8d53a79af4c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:34.448899 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0331f6-a811-4969-a1b4-916e80fb18c8 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:34.619821 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:34.639125 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-aa0331f6-a811-4969-a1b4-916e80fb18c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd30dff4ba8fe401989c5f8d53a79af4c', 'request_id': 'req-aa0331f6-a811-4969-a1b4-916e80fb18c8'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:34.682970 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-aa0331f6-a811-4969-a1b4-916e80fb18c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd30dff4ba8fe401989c5f8d53a79af4c', 'request_id': 'req-aa0331f6-a811-4969-a1b4-916e80fb18c8'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:34.776391 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-aa0331f6-a811-4969-a1b4-916e80fb18c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd30dff4ba8fe401989c5f8d53a79af4c', 'request_id': 'req-aa0331f6-a811-4969-a1b4-916e80fb18c8'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:34.799535 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-aa0331f6-a811-4969-a1b4-916e80fb18c8 admin admin] The token cache is being invalidate because project d30dff4ba8fe401989c5f8d53a79af4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:18:34.799535 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-aa0331f6-a811-4969-a1b4-916e80fb18c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:34.799535 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-aa0331f6-a811-4969-a1b4-916e80fb18c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:34.802744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 848/1688] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:18:34 2022] DELETE /identity/v3/projects/d30dff4ba8fe401989c5f8d53a79af4c => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:34.807641 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99801d-179d-412f-ab00-94a2c56c99ab None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:34.808203 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99801d-179d-412f-ab00-94a2c56c99ab None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:34.808203 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99801d-179d-412f-ab00-94a2c56c99ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:34.845620 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-ad99801d-179d-412f-ab00-94a2c56c99ab None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:34.851145 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-ad99801d-179d-412f-ab00-94a2c56c99ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:34.993179 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 841/1689] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:35.001056 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548dffcd-bc11-4597-818f-f7697620d867 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:35.002449 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548dffcd-bc11-4597-818f-f7697620d867 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:35.003198 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548dffcd-bc11-4597-818f-f7697620d867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:35.060847 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99801d-179d-412f-ab00-94a2c56c99ab None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:35.067148 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-ad99801d-179d-412f-ab00-94a2c56c99ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:35.094480 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99801d-179d-412f-ab00-94a2c56c99ab None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:35.099473 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-548dffcd-bc11-4597-818f-f7697620d867 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:35.105984 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-548dffcd-bc11-4597-818f-f7697620d867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:35.112187 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2878f-e053-4e2e-a346-8cfdf5116130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:35.116447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2878f-e053-4e2e-a346-8cfdf5116130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:35.117198 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2878f-e053-4e2e-a346-8cfdf5116130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:35.117992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2878f-e053-4e2e-a346-8cfdf5116130 admin admin] PATH_INFO: `/v3/users/5773671c42ff4284a901907a31a07b62` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:35.128624 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2878f-e053-4e2e-a346-8cfdf5116130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5773671c42ff4284a901907a31a07b62)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:35.137075 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2878f-e053-4e2e-a346-8cfdf5116130 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:35.138382 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 849/1690] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:35.142102 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548dffcd-bc11-4597-818f-f7697620d867 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:35.178987 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548dffcd-bc11-4597-818f-f7697620d867 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:35.194288 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76af1a-ab3d-48ee-8c64-2ea0942b643e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:35.197678 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76af1a-ab3d-48ee-8c64-2ea0942b643e admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:35.198050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76af1a-ab3d-48ee-8c64-2ea0942b643e admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:35.198400 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76af1a-ab3d-48ee-8c64-2ea0942b643e admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:35.200445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76af1a-ab3d-48ee-8c64-2ea0942b643e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:18:35.201848 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76af1a-ab3d-48ee-8c64-2ea0942b643e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:35.203961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76af1a-ab3d-48ee-8c64-2ea0942b643e admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:35.242365 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 850/1691] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:18:35.243965 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76af1a-ab3d-48ee-8c64-2ea0942b643e admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:35.249086 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-3b76af1a-ab3d-48ee-8c64-2ea0942b643e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:35.573483 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76af1a-ab3d-48ee-8c64-2ea0942b643e admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:35.603613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93686853-90ea-4650-a5bb-e9d0962d01c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:35.621310 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93686853-90ea-4650-a5bb-e9d0962d01c7 service nova] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:35.621310 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93686853-90ea-4650-a5bb-e9d0962d01c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:35.621310 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93686853-90ea-4650-a5bb-e9d0962d01c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:35.634562 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-93686853-90ea-4650-a5bb-e9d0962d01c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:35.650170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-5cf2878f-e053-4e2e-a346-8cfdf5116130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5773671c42ff4284a901907a31a07b62'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:35.666926 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:35.703943 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-5cf2878f-e053-4e2e-a346-8cfdf5116130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5773671c42ff4284a901907a31a07b62'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:35.797847 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-5cf2878f-e053-4e2e-a346-8cfdf5116130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5773671c42ff4284a901907a31a07b62'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:35.799517 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-5cf2878f-e053-4e2e-a346-8cfdf5116130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5773671c42ff4284a901907a31a07b62'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:35.816889 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-5cf2878f-e053-4e2e-a346-8cfdf5116130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5773671c42ff4284a901907a31a07b62'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:35.845960 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 842/1692] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:18:35 2022] DELETE /identity/v3/users/5773671c42ff4284a901907a31a07b62 => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:35.845960 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2878f-e053-4e2e-a346-8cfdf5116130 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:35.849382 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-5cf2878f-e053-4e2e-a346-8cfdf5116130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:35.964984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2878f-e053-4e2e-a346-8cfdf5116130 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:35.971286 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c2194-fea0-4666-8d38-786c4af1934f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:35.972010 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c2194-fea0-4666-8d38-786c4af1934f admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:35.972355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c2194-fea0-4666-8d38-786c4af1934f admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:35.975068 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c2194-fea0-4666-8d38-786c4af1934f admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:35.977685 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93686853-90ea-4650-a5bb-e9d0962d01c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:35.984793 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c2194-fea0-4666-8d38-786c4af1934f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:35.985007 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93686853-90ea-4650-a5bb-e9d0962d01c7 service nova] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:35.985101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c2194-fea0-4666-8d38-786c4af1934f admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:36.019350 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 851/1693] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 775 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:36.020741 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17affa7a-0bcb-4da6-a2fe-bb9b7c3dbce7 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:36.021065 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17affa7a-0bcb-4da6-a2fe-bb9b7c3dbce7 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:36.021349 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17affa7a-0bcb-4da6-a2fe-bb9b7c3dbce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:36.068107 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-17affa7a-0bcb-4da6-a2fe-bb9b7c3dbce7 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:36.072001 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-17affa7a-0bcb-4da6-a2fe-bb9b7c3dbce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:36.094476 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 852/1694] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:36.096132 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa45b7-e4c7-488c-a2e9-4dda2bc7b59d None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:36.096659 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa45b7-e4c7-488c-a2e9-4dda2bc7b59d None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:36.097181 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa45b7-e4c7-488c-a2e9-4dda2bc7b59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:36.148837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-eafa45b7-e4c7-488c-a2e9-4dda2bc7b59d None None] MFA Rules not processed for user `cef533d7373946dcb340fbf496070e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:36.151187 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-eafa45b7-e4c7-488c-a2e9-4dda2bc7b59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:36.183549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 843/1695] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:18:35 2022] POST /identity/v3/projects => generated 365 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:36.183549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c2194-fea0-4666-8d38-786c4af1934f admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:36.188262 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-d22c2194-fea0-4666-8d38-786c4af1934f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:36.376649 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c2194-fea0-4666-8d38-786c4af1934f admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:36.391656 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4857a4c-a368-4ba3-a818-58383923b2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:36.392576 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4857a4c-a368-4ba3-a818-58383923b2a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:36.392891 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4857a4c-a368-4ba3-a818-58383923b2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:36.393202 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4857a4c-a368-4ba3-a818-58383923b2a4 admin admin] PATH_INFO: `/v3/users/52eb4e92ccdf466a9c26a54a10313bbe` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:36.395158 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4857a4c-a368-4ba3-a818-58383923b2a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52eb4e92ccdf466a9c26a54a10313bbe)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:36.397166 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4857a4c-a368-4ba3-a818-58383923b2a4 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:36.414838 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:36.568149 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 853/1696] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:36.568797 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa45b7-e4c7-488c-a2e9-4dda2bc7b59d None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:36.570811 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-eafa45b7-e4c7-488c-a2e9-4dda2bc7b59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:36.714509 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa45b7-e4c7-488c-a2e9-4dda2bc7b59d None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:36.723639 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-a4857a4c-a368-4ba3-a818-58383923b2a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52eb4e92ccdf466a9c26a54a10313bbe'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:36.769710 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-a4857a4c-a368-4ba3-a818-58383923b2a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52eb4e92ccdf466a9c26a54a10313bbe'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:36.792320 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:36.921684 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453da46-2675-4065-8a9c-6f11dec82503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:36.925616 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453da46-2675-4065-8a9c-6f11dec82503 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:36.925906 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453da46-2675-4065-8a9c-6f11dec82503 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:36.928596 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453da46-2675-4065-8a9c-6f11dec82503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:36.937464 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-a4857a4c-a368-4ba3-a818-58383923b2a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52eb4e92ccdf466a9c26a54a10313bbe'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:36.937464 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-a4857a4c-a368-4ba3-a818-58383923b2a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52eb4e92ccdf466a9c26a54a10313bbe'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:36.948580 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-a4857a4c-a368-4ba3-a818-58383923b2a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52eb4e92ccdf466a9c26a54a10313bbe'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:36.969372 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453da46-2675-4065-8a9c-6f11dec82503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:36.971201 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453da46-2675-4065-8a9c-6f11dec82503 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:36.988330 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 844/1697] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:18:36 2022] DELETE /identity/v3/users/52eb4e92ccdf466a9c26a54a10313bbe => generated 0 bytes in 804 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:36.989698 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4857a4c-a368-4ba3-a818-58383923b2a4 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:36.995450 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-a4857a4c-a368-4ba3-a818-58383923b2a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:37.012460 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 854/1698] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:37.013883 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453da46-2675-4065-8a9c-6f11dec82503 service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:37.018466 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-f453da46-2675-4065-8a9c-6f11dec82503 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:37.205739 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4857a4c-a368-4ba3-a818-58383923b2a4 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:37.229231 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934472e6-b0b1-42d4-86e6-e10cb35bacaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:37.230003 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934472e6-b0b1-42d4-86e6-e10cb35bacaa admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:37.232253 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934472e6-b0b1-42d4-86e6-e10cb35bacaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:37.232613 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934472e6-b0b1-42d4-86e6-e10cb35bacaa admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:37.234824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934472e6-b0b1-42d4-86e6-e10cb35bacaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:37.237934 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934472e6-b0b1-42d4-86e6-e10cb35bacaa admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:37.279888 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453da46-2675-4065-8a9c-6f11dec82503 service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:37.331221 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 845/1699] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:18:36 2022] POST /identity/v3/users => generated 283 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:37.333538 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311e93e-c0e2-452c-a939-6dc0738131c6 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:37.334035 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311e93e-c0e2-452c-a939-6dc0738131c6 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:37.334840 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311e93e-c0e2-452c-a939-6dc0738131c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:37.367227 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-3311e93e-c0e2-452c-a939-6dc0738131c6 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:37.370264 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-3311e93e-c0e2-452c-a939-6dc0738131c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:37.394220 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 846/1700] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:37.395750 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311e93e-c0e2-452c-a939-6dc0738131c6 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:37.421372 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311e93e-c0e2-452c-a939-6dc0738131c6 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:37.427989 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc075bb-9bd6-4deb-aa58-b00c1e5c28e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:37.428731 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc075bb-9bd6-4deb-aa58-b00c1e5c28e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:37.429055 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc075bb-9bd6-4deb-aa58-b00c1e5c28e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:37.429402 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc075bb-9bd6-4deb-aa58-b00c1e5c28e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:37.430502 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc075bb-9bd6-4deb-aa58-b00c1e5c28e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:37.432880 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc075bb-9bd6-4deb-aa58-b00c1e5c28e2 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:37.455761 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 847/1701] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:37.457119 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc075bb-9bd6-4deb-aa58-b00c1e5c28e2 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:37.459867 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-3cc075bb-9bd6-4deb-aa58-b00c1e5c28e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:37.562802 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d0b5d-4377-406a-a78b-4369e07645c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:37.563484 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d0b5d-4377-406a-a78b-4369e07645c6 service nova] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:37.563941 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d0b5d-4377-406a-a78b-4369e07645c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:37.564375 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d0b5d-4377-406a-a78b-4369e07645c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:37.569453 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-796d0b5d-4377-406a-a78b-4369e07645c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:37.585146 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc075bb-9bd6-4deb-aa58-b00c1e5c28e2 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:37.602791 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2fbb1-5140-4258-82d5-fd348d651360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:37.603312 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2fbb1-5140-4258-82d5-fd348d651360 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:37.603774 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2fbb1-5140-4258-82d5-fd348d651360 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:37.604060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2fbb1-5140-4258-82d5-fd348d651360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:37.616626 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2fbb1-5140-4258-82d5-fd348d651360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:37.619594 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2fbb1-5140-4258-82d5-fd348d651360 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:37.662517 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 848/1702] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:37.664172 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2fbb1-5140-4258-82d5-fd348d651360 service neutron] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:37.681367 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2fbb1-5140-4258-82d5-fd348d651360 service neutron] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:37.708452 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1a977-ed25-4d05-8315-3c440df2961c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:37.709402 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1a977-ed25-4d05-8315-3c440df2961c admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:37.714075 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1a977-ed25-4d05-8315-3c440df2961c admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:37.714075 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1a977-ed25-4d05-8315-3c440df2961c admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:37.714075 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1a977-ed25-4d05-8315-3c440df2961c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:37.714815 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:37.714899 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1a977-ed25-4d05-8315-3c440df2961c admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:37.767090 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 849/1703] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:37.771981 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1a977-ed25-4d05-8315-3c440df2961c admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:37.798395 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1a977-ed25-4d05-8315-3c440df2961c admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:37.811794 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b01611-4bbb-4e15-94ec-c1d95e85e199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:37.813483 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d0b5d-4377-406a-a78b-4369e07645c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:37.813728 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b01611-4bbb-4e15-94ec-c1d95e85e199 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:37.813876 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b01611-4bbb-4e15-94ec-c1d95e85e199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:37.814083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b01611-4bbb-4e15-94ec-c1d95e85e199 admin admin] PATH_INFO: `/v3/projects/44283a97c1d147db8c95dfeb066c55ca/users/2033482f0ed34e5288627ca045df1145/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:37.819447 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d0b5d-4377-406a-a78b-4369e07645c6 service nova] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:37.882023 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b01611-4bbb-4e15-94ec-c1d95e85e199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44283a97c1d147db8c95dfeb066c55ca, user_id=2033482f0ed34e5288627ca045df1145, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:37.895464 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b01611-4bbb-4e15-94ec-c1d95e85e199 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:37.897852 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 855/1704] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 884 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:38.045978 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 850/1705] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:18:37 2022] PUT /identity/v3/projects/44283a97c1d147db8c95dfeb066c55ca/users/2033482f0ed34e5288627ca045df1145/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:38.067058 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacb307-5500-4cbe-8f64-b1f55d8aadef None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:38.067058 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacb307-5500-4cbe-8f64-b1f55d8aadef None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:38.067058 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacb307-5500-4cbe-8f64-b1f55d8aadef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:38.234068 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-5cacb307-5500-4cbe-8f64-b1f55d8aadef None None] MFA Rules not processed for user `2033482f0ed34e5288627ca045df1145`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:38.243256 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-5cacb307-5500-4cbe-8f64-b1f55d8aadef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:38.588557 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 856/1706] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:38 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 533 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:38.592859 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b01611-4bbb-4e15-94ec-c1d95e85e199 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:38.642464 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:38.734649 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacb307-5500-4cbe-8f64-b1f55d8aadef None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:38.736486 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-5cacb307-5500-4cbe-8f64-b1f55d8aadef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:38.766604 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b01611-4bbb-4e15-94ec-c1d95e85e199 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:38.785302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57391d27-f51b-4227-9252-b433aad2b9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:38.785994 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57391d27-f51b-4227-9252-b433aad2b9d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:38.786284 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57391d27-f51b-4227-9252-b433aad2b9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:38.788226 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57391d27-f51b-4227-9252-b433aad2b9d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:38.789503 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57391d27-f51b-4227-9252-b433aad2b9d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:38.794348 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57391d27-f51b-4227-9252-b433aad2b9d8 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:38.909700 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:38.914736 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacb307-5500-4cbe-8f64-b1f55d8aadef None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:38.923464 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d22678-6a36-4004-952d-01443fa9c03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:38.924961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d22678-6a36-4004-952d-01443fa9c03e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:38.925600 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d22678-6a36-4004-952d-01443fa9c03e admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:38.926068 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d22678-6a36-4004-952d-01443fa9c03e admin admin] PATH_INFO: `/v3/projects/db33a76b7d1a449eadee7812dbea2d86` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:38.928283 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d22678-6a36-4004-952d-01443fa9c03e admin admin] RBAC: Authorizing `identity:delete_project(project_id=db33a76b7d1a449eadee7812dbea2d86)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:38.930562 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d22678-6a36-4004-952d-01443fa9c03e admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:38.983692 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 851/1707] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:18:38 2022] POST /identity/v3/projects => generated 367 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:38.988526 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57391d27-f51b-4227-9252-b433aad2b9d8 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:39.169608 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57391d27-f51b-4227-9252-b433aad2b9d8 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:39.224408 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe320a2-06c4-4bbd-86b3-3b16a34a0f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:39.229852 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe320a2-06c4-4bbd-86b3-3b16a34a0f61 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:39.230146 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe320a2-06c4-4bbd-86b3-3b16a34a0f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:39.233100 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe320a2-06c4-4bbd-86b3-3b16a34a0f61 admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:39.233548 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-03d22678-6a36-4004-952d-01443fa9c03e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db33a76b7d1a449eadee7812dbea2d86', 'request_id': 'req-03d22678-6a36-4004-952d-01443fa9c03e'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:39.237694 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe320a2-06c4-4bbd-86b3-3b16a34a0f61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:39.245319 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-03d22678-6a36-4004-952d-01443fa9c03e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db33a76b7d1a449eadee7812dbea2d86', 'request_id': 'req-03d22678-6a36-4004-952d-01443fa9c03e'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:39.249325 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe320a2-06c4-4bbd-86b3-3b16a34a0f61 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:39.374200 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-03d22678-6a36-4004-952d-01443fa9c03e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db33a76b7d1a449eadee7812dbea2d86', 'request_id': 'req-03d22678-6a36-4004-952d-01443fa9c03e'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:39.402983 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-03d22678-6a36-4004-952d-01443fa9c03e admin admin] The token cache is being invalidate because project db33a76b7d1a449eadee7812dbea2d86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:18:39.404166 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-03d22678-6a36-4004-952d-01443fa9c03e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:39.405295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-03d22678-6a36-4004-952d-01443fa9c03e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:39.412534 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 857/1708] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:18:38 2022] DELETE /identity/v3/projects/db33a76b7d1a449eadee7812dbea2d86 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:18:39.414458 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9675f-b29c-4b7a-a3ed-7a1bc69327f1 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:39.421221 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9675f-b29c-4b7a-a3ed-7a1bc69327f1 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:39.421221 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9675f-b29c-4b7a-a3ed-7a1bc69327f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:39.464568 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 852/1709] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:18:38 2022] POST /identity/v3/users => generated 290 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:39.465623 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe320a2-06c4-4bbd-86b3-3b16a34a0f61 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:39.468865 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-1fe320a2-06c4-4bbd-86b3-3b16a34a0f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:39.519713 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-ceb9675f-b29c-4b7a-a3ed-7a1bc69327f1 None None] MFA Rules not processed for user `7b4d3b1fe8064cc592d89e7bab91bace`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:39.530442 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-ceb9675f-b29c-4b7a-a3ed-7a1bc69327f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:39.578441 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe320a2-06c4-4bbd-86b3-3b16a34a0f61 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:39.800717 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 858/1710] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Jun 22 10:18:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:39.802674 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9675f-b29c-4b7a-a3ed-7a1bc69327f1 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:39.806578 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-ceb9675f-b29c-4b7a-a3ed-7a1bc69327f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:40.061112 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9675f-b29c-4b7a-a3ed-7a1bc69327f1 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:40.098397 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13955ac7-1a29-4acc-b5e3-027df2171554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:40.099104 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13955ac7-1a29-4acc-b5e3-027df2171554 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:40.103207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13955ac7-1a29-4acc-b5e3-027df2171554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:40.104496 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13955ac7-1a29-4acc-b5e3-027df2171554 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:40.105342 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13955ac7-1a29-4acc-b5e3-027df2171554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:40.106999 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13955ac7-1a29-4acc-b5e3-027df2171554 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:40.132027 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 859/1711] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:40.139004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13955ac7-1a29-4acc-b5e3-027df2171554 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:40.144226 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-13955ac7-1a29-4acc-b5e3-027df2171554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:40.176147 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13955ac7-1a29-4acc-b5e3-027df2171554 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:40.184677 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dcc721-ab20-4939-b132-10168d0f2871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:40.185522 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcc721-ab20-4939-b132-10168d0f2871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:40.185805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcc721-ab20-4939-b132-10168d0f2871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:40.186088 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcc721-ab20-4939-b132-10168d0f2871 admin admin] PATH_INFO: `/v3/projects/0521797f600144f4a5b5f844115029bb` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:40.188569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dcc721-ab20-4939-b132-10168d0f2871 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0521797f600144f4a5b5f844115029bb)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:40.191584 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dcc721-ab20-4939-b132-10168d0f2871 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:40.239643 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4823a06-4d20-4ce2-8e5c-b771a8bc3af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:40.243966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4823a06-4d20-4ce2-8e5c-b771a8bc3af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:40.246837 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4823a06-4d20-4ce2-8e5c-b771a8bc3af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:40.247336 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4823a06-4d20-4ce2-8e5c-b771a8bc3af1 admin admin] PATH_INFO: `/v3/users/f2815b0993804fa98f846b8e17fe3200` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:40.252909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4823a06-4d20-4ce2-8e5c-b771a8bc3af1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2815b0993804fa98f846b8e17fe3200)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:40.261551 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4823a06-4d20-4ce2-8e5c-b771a8bc3af1 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:40.278686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:40.408033 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-e4dcc721-ab20-4939-b132-10168d0f2871 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0521797f600144f4a5b5f844115029bb', 'request_id': 'req-e4dcc721-ab20-4939-b132-10168d0f2871'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:40.415900 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-e4dcc721-ab20-4939-b132-10168d0f2871 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0521797f600144f4a5b5f844115029bb', 'request_id': 'req-e4dcc721-ab20-4939-b132-10168d0f2871'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:40.568956 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-e4dcc721-ab20-4939-b132-10168d0f2871 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0521797f600144f4a5b5f844115029bb', 'request_id': 'req-e4dcc721-ab20-4939-b132-10168d0f2871'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:40.605982 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-e4dcc721-ab20-4939-b132-10168d0f2871 admin admin] The token cache is being invalidate because project 0521797f600144f4a5b5f844115029bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:18:40.606448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-e4dcc721-ab20-4939-b132-10168d0f2871 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:40.609025 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-e4dcc721-ab20-4939-b132-10168d0f2871 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:40.615154 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 860/1712] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:18:40 2022] DELETE /identity/v3/projects/0521797f600144f4a5b5f844115029bb => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:40.616058 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dcc721-ab20-4939-b132-10168d0f2871 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:40.635198 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-e4dcc721-ab20-4939-b132-10168d0f2871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:40.747139 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:40.777411 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e4823a06-4d20-4ce2-8e5c-b771a8bc3af1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2815b0993804fa98f846b8e17fe3200'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:40.810909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e4823a06-4d20-4ce2-8e5c-b771a8bc3af1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2815b0993804fa98f846b8e17fe3200'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:40.909949 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dcc721-ab20-4939-b132-10168d0f2871 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:40.922782 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0c203-0da6-4e4e-8c8d-730c3e1f502e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:40.926422 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0c203-0da6-4e4e-8c8d-730c3e1f502e admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:40.926691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0c203-0da6-4e4e-8c8d-730c3e1f502e admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:40.927163 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0c203-0da6-4e4e-8c8d-730c3e1f502e admin admin] PATH_INFO: `/v3/projects/72610dd9fb84485980e8200429d23cd1/users/c9242c373795455b8dae61af5d7d1ac7/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:40.945254 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e4823a06-4d20-4ce2-8e5c-b771a8bc3af1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2815b0993804fa98f846b8e17fe3200'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:40.945895 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e4823a06-4d20-4ce2-8e5c-b771a8bc3af1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2815b0993804fa98f846b8e17fe3200'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:40.958501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e4823a06-4d20-4ce2-8e5c-b771a8bc3af1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2815b0993804fa98f846b8e17fe3200'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:40.969127 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0c203-0da6-4e4e-8c8d-730c3e1f502e admin admin] RBAC: Authorizing `identity:create_grant(project_id=72610dd9fb84485980e8200429d23cd1, user_id=c9242c373795455b8dae61af5d7d1ac7, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:40.973222 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0c203-0da6-4e4e-8c8d-730c3e1f502e admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:40.984627 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 853/1713] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:18:39 2022] DELETE /identity/v3/users/f2815b0993804fa98f846b8e17fe3200 => generated 0 bytes in 1517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:40.986237 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4823a06-4d20-4ce2-8e5c-b771a8bc3af1 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:40.991438 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-e4823a06-4d20-4ce2-8e5c-b771a8bc3af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:41.105870 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 861/1714] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:18:40 2022] PUT /identity/v3/projects/72610dd9fb84485980e8200429d23cd1/users/c9242c373795455b8dae61af5d7d1ac7/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:41.112779 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f44e43-f29a-49d3-9586-eb2c9bf55b10 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:41.113374 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f44e43-f29a-49d3-9586-eb2c9bf55b10 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:41.114708 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f44e43-f29a-49d3-9586-eb2c9bf55b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:41.189158 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-b1f44e43-f29a-49d3-9586-eb2c9bf55b10 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:41.191781 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-b1f44e43-f29a-49d3-9586-eb2c9bf55b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:41.211987 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4823a06-4d20-4ce2-8e5c-b771a8bc3af1 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:41.292742 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9188fc-1fcc-4eeb-b67f-047d54fedbcc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c724063ce51470ca09c5c5ab231fd9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:41.300722 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9188fc-1fcc-4eeb-b67f-047d54fedbcc service swift] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:41.300722 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9188fc-1fcc-4eeb-b67f-047d54fedbcc service swift] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:41.300722 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9188fc-1fcc-4eeb-b67f-047d54fedbcc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:41.300722 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-7a9188fc-1fcc-4eeb-b67f-047d54fedbcc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:41.375768 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 862/1715] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:41.379896 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f44e43-f29a-49d3-9586-eb2c9bf55b10 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:41.383093 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-b1f44e43-f29a-49d3-9586-eb2c9bf55b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:41.409542 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f44e43-f29a-49d3-9586-eb2c9bf55b10 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:41.411574 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef6c3a-bc6c-4f61-a9de-6a000854d569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:41.412363 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef6c3a-bc6c-4f61-a9de-6a000854d569 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:41.412725 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef6c3a-bc6c-4f61-a9de-6a000854d569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:41.413111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef6c3a-bc6c-4f61-a9de-6a000854d569 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:41.414790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef6c3a-bc6c-4f61-a9de-6a000854d569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:41.416934 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef6c3a-bc6c-4f61-a9de-6a000854d569 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:41.439679 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 863/1716] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:41.442599 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50e3d9-f15a-44e0-a046-9cab704af5a0 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:41.442970 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50e3d9-f15a-44e0-a046-9cab704af5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:41.443250 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50e3d9-f15a-44e0-a046-9cab704af5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:41.490049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-2b50e3d9-f15a-44e0-a046-9cab704af5a0 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:41.490511 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-2b50e3d9-f15a-44e0-a046-9cab704af5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:41.516477 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 864/1717] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:41.517358 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50e3d9-f15a-44e0-a046-9cab704af5a0 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:41.540115 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50e3d9-f15a-44e0-a046-9cab704af5a0 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:41.560035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7006ce-8156-41dd-8b2e-6a6a4ba78a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:41.561755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7006ce-8156-41dd-8b2e-6a6a4ba78a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:41.561755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7006ce-8156-41dd-8b2e-6a6a4ba78a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:41.561755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7006ce-8156-41dd-8b2e-6a6a4ba78a4a admin admin] PATH_INFO: `/v3/projects/72610dd9fb84485980e8200429d23cd1/users/c9242c373795455b8dae61af5d7d1ac7/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:41.563767 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7006ce-8156-41dd-8b2e-6a6a4ba78a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=72610dd9fb84485980e8200429d23cd1, user_id=c9242c373795455b8dae61af5d7d1ac7, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:41.567191 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7006ce-8156-41dd-8b2e-6a6a4ba78a4a admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:41.573504 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9188fc-1fcc-4eeb-b67f-047d54fedbcc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:41.575360 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9188fc-1fcc-4eeb-b67f-047d54fedbcc service swift] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:41.604031 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 865/1718] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:18:41 2022] PUT /identity/v3/projects/72610dd9fb84485980e8200429d23cd1/users/c9242c373795455b8dae61af5d7d1ac7/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:41.605261 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7006ce-8156-41dd-8b2e-6a6a4ba78a4a admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:41.636088 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 854/1719] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 22 10:18:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:18:41.638189 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc276e-f1fb-46dc-bbbe-f99520e46d5b None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:41.638677 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc276e-f1fb-46dc-bbbe-f99520e46d5b None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:41.639430 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc276e-f1fb-46dc-bbbe-f99520e46d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:41.767464 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7006ce-8156-41dd-8b2e-6a6a4ba78a4a admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:41.790292 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016521d-db42-4b24-b35d-0ef3f39924ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:41.791044 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016521d-db42-4b24-b35d-0ef3f39924ad admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:41.791327 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016521d-db42-4b24-b35d-0ef3f39924ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:41.791614 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016521d-db42-4b24-b35d-0ef3f39924ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:41.792419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016521d-db42-4b24-b35d-0ef3f39924ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:18:41.792736 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016521d-db42-4b24-b35d-0ef3f39924ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:41.794435 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016521d-db42-4b24-b35d-0ef3f39924ad admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:41.811051 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-addc276e-f1fb-46dc-bbbe-f99520e46d5b None None] MFA Rules not processed for user `c9242c373795455b8dae61af5d7d1ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:41.814232 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-addc276e-f1fb-46dc-bbbe-f99520e46d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:41.839556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 866/1720] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:18:41.840554 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016521d-db42-4b24-b35d-0ef3f39924ad admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:41.881795 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:41.884060 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016521d-db42-4b24-b35d-0ef3f39924ad admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:41.911209 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf148f-3dce-4e19-b57e-b6f96a6e411c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:41.912294 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf148f-3dce-4e19-b57e-b6f96a6e411c admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:41.913042 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf148f-3dce-4e19-b57e-b6f96a6e411c admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:41.913706 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf148f-3dce-4e19-b57e-b6f96a6e411c admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:41.917757 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf148f-3dce-4e19-b57e-b6f96a6e411c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:41.927937 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf148f-3dce-4e19-b57e-b6f96a6e411c admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:42.071659 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 855/1721] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:41 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:42.081906 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc276e-f1fb-46dc-bbbe-f99520e46d5b None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:42.083481 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-addc276e-f1fb-46dc-bbbe-f99520e46d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:42.185447 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 867/1722] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:18:41 2022] POST /identity/v3/projects => generated 377 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:42.191400 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf148f-3dce-4e19-b57e-b6f96a6e411c admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:42.388153 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc276e-f1fb-46dc-bbbe-f99520e46d5b None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:42.455990 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf148f-3dce-4e19-b57e-b6f96a6e411c admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:42.455990 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a8407-42ec-40c3-abd7-22ecbeba7161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:42.456604 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a8407-42ec-40c3-abd7-22ecbeba7161 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:42.457107 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a8407-42ec-40c3-abd7-22ecbeba7161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:42.457796 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a8407-42ec-40c3-abd7-22ecbeba7161 admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:42.459371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a8407-42ec-40c3-abd7-22ecbeba7161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:42.465646 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a8407-42ec-40c3-abd7-22ecbeba7161 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:42.594643 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc932e-2920-41cc-a9bf-656b27332388 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:42.594643 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc932e-2920-41cc-a9bf-656b27332388 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:42.594643 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc932e-2920-41cc-a9bf-656b27332388 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:42.594643 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc932e-2920-41cc-a9bf-656b27332388 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:42.645950 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 868/1723] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:18:42 2022] POST /identity/v3/users => generated 289 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:42.650779 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1df95-daf1-4a66-9db9-7926e0d10269 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:42.653934 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1df95-daf1-4a66-9db9-7926e0d10269 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:42.655840 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1df95-daf1-4a66-9db9-7926e0d10269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:42.724691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-a4a1df95-daf1-4a66-9db9-7926e0d10269 None None] MFA Rules not processed for user `16265c4e556943369aa0cb3e961795bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:42.726855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-a4a1df95-daf1-4a66-9db9-7926e0d10269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:42.742009 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:42.765480 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc932e-2920-41cc-a9bf-656b27332388 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:42.766986 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc932e-2920-41cc-a9bf-656b27332388 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:42.788203 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 856/1724] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:42 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 707 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:18:42.789577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc932e-2920-41cc-a9bf-656b27332388 service cinder] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:42.816227 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc932e-2920-41cc-a9bf-656b27332388 service cinder] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:42.827458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ca3b6-9db0-4611-9f14-63c0399ec5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:42.829935 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ca3b6-9db0-4611-9f14-63c0399ec5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:42.829935 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ca3b6-9db0-4611-9f14-63c0399ec5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:42.829935 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ca3b6-9db0-4611-9f14-63c0399ec5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:42.829935 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ca3b6-9db0-4611-9f14-63c0399ec5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:42.831870 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ca3b6-9db0-4611-9f14-63c0399ec5e8 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:42.867914 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 857/1725] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:42.869185 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 869/1726] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:42.874888 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ca3b6-9db0-4611-9f14-63c0399ec5e8 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:42.885836 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ca3b6-9db0-4611-9f14-63c0399ec5e8 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:42.893739 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29128c4f-0a5f-40dd-9295-a24e4da4be7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:42.898695 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29128c4f-0a5f-40dd-9295-a24e4da4be7a admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:42.898695 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29128c4f-0a5f-40dd-9295-a24e4da4be7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:42.898695 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29128c4f-0a5f-40dd-9295-a24e4da4be7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:42.898695 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29128c4f-0a5f-40dd-9295-a24e4da4be7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:42.898695 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29128c4f-0a5f-40dd-9295-a24e4da4be7a admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:42.915435 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 858/1727] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:42.915585 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1df95-daf1-4a66-9db9-7926e0d10269 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:42.952213 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1df95-daf1-4a66-9db9-7926e0d10269 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:42.971582 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d086d-aa5b-4688-8923-14900b7e2952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:42.972526 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d086d-aa5b-4688-8923-14900b7e2952 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:42.972831 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d086d-aa5b-4688-8923-14900b7e2952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:42.973146 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d086d-aa5b-4688-8923-14900b7e2952 admin admin] PATH_INFO: `/v3/projects/96e3d21e2fc04db893767a724026859b/users/baf08d2a0f054436baf20a2245d67e33/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:43.042976 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d086d-aa5b-4688-8923-14900b7e2952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96e3d21e2fc04db893767a724026859b, user_id=baf08d2a0f054436baf20a2245d67e33, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:43.046912 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d086d-aa5b-4688-8923-14900b7e2952 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:43.102536 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29128c4f-0a5f-40dd-9295-a24e4da4be7a admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:43.128431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29128c4f-0a5f-40dd-9295-a24e4da4be7a admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:43.173827 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10dc6d-c94b-41c3-afb7-aee74f554872 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:43.173827 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10dc6d-c94b-41c3-afb7-aee74f554872 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:43.173827 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10dc6d-c94b-41c3-afb7-aee74f554872 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:43.173827 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10dc6d-c94b-41c3-afb7-aee74f554872 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:43.174159 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-8e10dc6d-c94b-41c3-afb7-aee74f554872 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:43.317507 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10dc6d-c94b-41c3-afb7-aee74f554872 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:43.324044 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10dc6d-c94b-41c3-afb7-aee74f554872 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:43.341442 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 870/1728] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:18:42 2022] PUT /identity/v3/projects/96e3d21e2fc04db893767a724026859b/users/baf08d2a0f054436baf20a2245d67e33/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:43.343976 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41198a52-6b54-4d76-b198-d31b3c71d7fb None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:43.344289 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41198a52-6b54-4d76-b198-d31b3c71d7fb None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:43.344578 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41198a52-6b54-4d76-b198-d31b3c71d7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:43.376623 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 859/1729] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:43 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:43.432176 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-41198a52-6b54-4d76-b198-d31b3c71d7fb None None] MFA Rules not processed for user `baf08d2a0f054436baf20a2245d67e33`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:43.433665 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-41198a52-6b54-4d76-b198-d31b3c71d7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:43.702904 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 871/1730] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:43.703236 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10dc6d-c94b-41c3-afb7-aee74f554872 service cinder] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:43.709018 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e8c98-4930-4e2a-b5bb-5ed148f11caa None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:43.710363 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e8c98-4930-4e2a-b5bb-5ed148f11caa None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:43.710930 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e8c98-4930-4e2a-b5bb-5ed148f11caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:43.722546 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10dc6d-c94b-41c3-afb7-aee74f554872 service cinder] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:43.781772 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-a19e8c98-4930-4e2a-b5bb-5ed148f11caa None None] MFA Rules not processed for user `0bddc02875304e8c92ac367c8095efee`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:43.784393 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-a19e8c98-4930-4e2a-b5bb-5ed148f11caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:43.959906 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 872/1731] 10.222.0.62 () {58 vars in 1015 bytes} [Wed Jun 22 10:18:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:43.983679 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf1de8-ca6d-44c8-af5b-f5d21af85249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:43.984874 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf1de8-ca6d-44c8-af5b-f5d21af85249 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:43.984874 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf1de8-ca6d-44c8-af5b-f5d21af85249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:43.985094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf1de8-ca6d-44c8-af5b-f5d21af85249 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:43.985713 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf1de8-ca6d-44c8-af5b-f5d21af85249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:43.987725 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf1de8-ca6d-44c8-af5b-f5d21af85249 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:44.019686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e8c98-4930-4e2a-b5bb-5ed148f11caa None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:44.021630 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-a19e8c98-4930-4e2a-b5bb-5ed148f11caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:44.051639 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e8c98-4930-4e2a-b5bb-5ed148f11caa None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:44.052915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc64ce-a487-4f61-89de-be207affb015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:44.054939 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc64ce-a487-4f61-89de-be207affb015 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:44.055851 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc64ce-a487-4f61-89de-be207affb015 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:44.067365 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc64ce-a487-4f61-89de-be207affb015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:44.083627 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc64ce-a487-4f61-89de-be207affb015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:44.088958 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc64ce-a487-4f61-89de-be207affb015 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:44.108268 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 873/1732] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:44.179476 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:44.195397 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 860/1733] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:18:43 2022] POST /identity/v3/projects => generated 375 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:18:44.196269 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc64ce-a487-4f61-89de-be207affb015 service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:44.233624 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc64ce-a487-4f61-89de-be207affb015 service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:44.462905 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2144a6-c2f2-42c0-9a2a-7348844b429d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:44.463615 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2144a6-c2f2-42c0-9a2a-7348844b429d admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:44.463904 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2144a6-c2f2-42c0-9a2a-7348844b429d admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:44.464572 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2144a6-c2f2-42c0-9a2a-7348844b429d admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:44.466066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2144a6-c2f2-42c0-9a2a-7348844b429d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:44.474509 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2144a6-c2f2-42c0-9a2a-7348844b429d admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:44.684709 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 874/1734] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:18:44 2022] POST /identity/v3/users => generated 294 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:18:44.688102 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf1de8-ca6d-44c8-af5b-f5d21af85249 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:44.713479 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf1de8-ca6d-44c8-af5b-f5d21af85249 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:44.727779 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88990a-a9b8-4594-86cc-645e947d8e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:44.728682 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88990a-a9b8-4594-86cc-645e947d8e66 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:44.730237 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88990a-a9b8-4594-86cc-645e947d8e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:44.731945 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88990a-a9b8-4594-86cc-645e947d8e66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:44.733619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88990a-a9b8-4594-86cc-645e947d8e66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:44.737798 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88990a-a9b8-4594-86cc-645e947d8e66 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:44.761356 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2144a6-c2f2-42c0-9a2a-7348844b429d admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:44.764362 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-2e2144a6-c2f2-42c0-9a2a-7348844b429d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:44.780884 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 861/1735] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:44.783595 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88990a-a9b8-4594-86cc-645e947d8e66 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:44.791339 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2144a6-c2f2-42c0-9a2a-7348844b429d admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:44.803145 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50f02e-4ace-4373-b598-8195a205e67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:44.805398 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50f02e-4ace-4373-b598-8195a205e67e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:44.805899 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50f02e-4ace-4373-b598-8195a205e67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:44.806483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88990a-a9b8-4594-86cc-645e947d8e66 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:44.806963 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50f02e-4ace-4373-b598-8195a205e67e admin admin] PATH_INFO: `/v3/projects/a2ad16d2c29644538c752e2ec6acfc91` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:44.810695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50f02e-4ace-4373-b598-8195a205e67e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2ad16d2c29644538c752e2ec6acfc91)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:44.815636 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50f02e-4ace-4373-b598-8195a205e67e admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:44.820098 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56488fe9-625b-4837-8d6e-cf066c42c04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:44.828684 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56488fe9-625b-4837-8d6e-cf066c42c04e admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:44.828684 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56488fe9-625b-4837-8d6e-cf066c42c04e admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:44.828684 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56488fe9-625b-4837-8d6e-cf066c42c04e admin admin] PATH_INFO: `/v3/projects/8f10bb00903949e5b437e000742e0b02/users/977e06e135a64a9d9d234ca4b502ed07/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:44.881999 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56488fe9-625b-4837-8d6e-cf066c42c04e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f10bb00903949e5b437e000742e0b02, user_id=977e06e135a64a9d9d234ca4b502ed07, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:44.894065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56488fe9-625b-4837-8d6e-cf066c42c04e admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:45.014439 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 862/1736] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:18:44 2022] PUT /identity/v3/projects/8f10bb00903949e5b437e000742e0b02/users/977e06e135a64a9d9d234ca4b502ed07/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:45.020882 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bc19f-40cd-4f71-baa3-86477cc94c05 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:45.020882 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bc19f-40cd-4f71-baa3-86477cc94c05 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:45.020882 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bc19f-40cd-4f71-baa3-86477cc94c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:45.053216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-3a50f02e-4ace-4373-b598-8195a205e67e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2ad16d2c29644538c752e2ec6acfc91', 'request_id': 'req-3a50f02e-4ace-4373-b598-8195a205e67e'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:45.060066 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-887bc19f-40cd-4f71-baa3-86477cc94c05 None None] MFA Rules not processed for user `cef533d7373946dcb340fbf496070e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:45.061448 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-887bc19f-40cd-4f71-baa3-86477cc94c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:45.092709 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-3a50f02e-4ace-4373-b598-8195a205e67e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2ad16d2c29644538c752e2ec6acfc91', 'request_id': 'req-3a50f02e-4ace-4373-b598-8195a205e67e'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:45.230950 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 863/1737] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:45.234489 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887bc19f-40cd-4f71-baa3-86477cc94c05 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:45.254674 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-3a50f02e-4ace-4373-b598-8195a205e67e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2ad16d2c29644538c752e2ec6acfc91', 'request_id': 'req-3a50f02e-4ace-4373-b598-8195a205e67e'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:45.255282 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:45.282070 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-3a50f02e-4ace-4373-b598-8195a205e67e admin admin] The token cache is being invalidate because project a2ad16d2c29644538c752e2ec6acfc91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:18:45.282378 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-3a50f02e-4ace-4373-b598-8195a205e67e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:45.283943 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-3a50f02e-4ace-4373-b598-8195a205e67e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:45.292207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 875/1738] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:18:44 2022] DELETE /identity/v3/projects/a2ad16d2c29644538c752e2ec6acfc91 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:45.298843 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f6ac0-e706-436c-bc01-b7a74e144c7d None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:45.299059 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f6ac0-e706-436c-bc01-b7a74e144c7d None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:45.299527 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f6ac0-e706-436c-bc01-b7a74e144c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:45.353317 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-c03f6ac0-e706-436c-bc01-b7a74e144c7d None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:45.355142 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-c03f6ac0-e706-436c-bc01-b7a74e144c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:45.415610 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887bc19f-40cd-4f71-baa3-86477cc94c05 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:45.433815 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30706d-c611-4e8a-82dc-2b32f1a7b326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:45.438778 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30706d-c611-4e8a-82dc-2b32f1a7b326 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:45.439245 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30706d-c611-4e8a-82dc-2b32f1a7b326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:45.440249 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30706d-c611-4e8a-82dc-2b32f1a7b326 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:45.441198 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30706d-c611-4e8a-82dc-2b32f1a7b326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:45.448313 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30706d-c611-4e8a-82dc-2b32f1a7b326 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:45.480377 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 864/1739] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:45.489574 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30706d-c611-4e8a-82dc-2b32f1a7b326 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:45.494786 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-cb30706d-c611-4e8a-82dc-2b32f1a7b326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:45.540392 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30706d-c611-4e8a-82dc-2b32f1a7b326 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:45.555031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec86af1-371d-4a17-9ce9-1bc6f17c1a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:45.555031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec86af1-371d-4a17-9ce9-1bc6f17c1a8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:45.555031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec86af1-371d-4a17-9ce9-1bc6f17c1a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:45.555031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec86af1-371d-4a17-9ce9-1bc6f17c1a8d admin admin] PATH_INFO: `/v3/projects/8f10bb00903949e5b437e000742e0b02/users/977e06e135a64a9d9d234ca4b502ed07/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:45.562936 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 876/1740] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:45.562936 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5887b-7413-41be-9b27-e3db75c2d38e None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:45.562936 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5887b-7413-41be-9b27-e3db75c2d38e None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:45.562936 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5887b-7413-41be-9b27-e3db75c2d38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:45.563229 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec86af1-371d-4a17-9ce9-1bc6f17c1a8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f10bb00903949e5b437e000742e0b02, user_id=977e06e135a64a9d9d234ca4b502ed07, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:45.565708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec86af1-371d-4a17-9ce9-1bc6f17c1a8d admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:45.582036 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-e6e5887b-7413-41be-9b27-e3db75c2d38e None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:45.583788 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-e6e5887b-7413-41be-9b27-e3db75c2d38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:45.608087 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 865/1741] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:18:45 2022] PUT /identity/v3/projects/8f10bb00903949e5b437e000742e0b02/users/977e06e135a64a9d9d234ca4b502ed07/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:45.623655 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9648a0d-f909-444b-9458-c0232378acbf None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:45.625267 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9648a0d-f909-444b-9458-c0232378acbf None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:45.625706 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9648a0d-f909-444b-9458-c0232378acbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:45.675416 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 877/1742] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:45.681302 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5887b-7413-41be-9b27-e3db75c2d38e None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:45.694051 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5887b-7413-41be-9b27-e3db75c2d38e None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:45.701044 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea351a55-7d6b-4a97-8816-ce63a6efa450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:45.701044 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea351a55-7d6b-4a97-8816-ce63a6efa450 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:45.701044 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea351a55-7d6b-4a97-8816-ce63a6efa450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:45.701711 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea351a55-7d6b-4a97-8816-ce63a6efa450 admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:45.703285 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea351a55-7d6b-4a97-8816-ce63a6efa450 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:18:45.704112 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea351a55-7d6b-4a97-8816-ce63a6efa450 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:45.706181 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea351a55-7d6b-4a97-8816-ce63a6efa450 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:45.711733 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:45.746962 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 878/1743] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:18:45.749565 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea351a55-7d6b-4a97-8816-ce63a6efa450 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:45.761834 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-d9648a0d-f909-444b-9458-c0232378acbf None None] MFA Rules not processed for user `977e06e135a64a9d9d234ca4b502ed07`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:45.764331 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-d9648a0d-f909-444b-9458-c0232378acbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:45.775856 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea351a55-7d6b-4a97-8816-ce63a6efa450 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:45.792095 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d777f-053f-4e7b-9664-640d0a300e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:45.793041 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d777f-053f-4e7b-9664-640d0a300e5d admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:45.794532 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d777f-053f-4e7b-9664-640d0a300e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:45.796207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d777f-053f-4e7b-9664-640d0a300e5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:45.797785 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d777f-053f-4e7b-9664-640d0a300e5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:45.803694 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d777f-053f-4e7b-9664-640d0a300e5d admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:45.951101 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 879/1744] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:18:45 2022] POST /identity/v3/projects => generated 365 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:45.957590 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d777f-053f-4e7b-9664-640d0a300e5d admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:45.995681 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 866/1745] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:45 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:18:46.007322 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9648a0d-f909-444b-9458-c0232378acbf None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:46.009082 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-d9648a0d-f909-444b-9458-c0232378acbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:46.080928 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:46.121610 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d777f-053f-4e7b-9664-640d0a300e5d admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:46.133313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22717f-ed0d-4c95-91c4-94f68d69737e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:46.139201 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22717f-ed0d-4c95-91c4-94f68d69737e admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:46.139201 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22717f-ed0d-4c95-91c4-94f68d69737e admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:46.139201 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22717f-ed0d-4c95-91c4-94f68d69737e admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:46.139201 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22717f-ed0d-4c95-91c4-94f68d69737e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:46.139201 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22717f-ed0d-4c95-91c4-94f68d69737e admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:46.155237 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9648a0d-f909-444b-9458-c0232378acbf None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:46.280141 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 880/1746] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:18:45 2022] POST /identity/v3/users => generated 283 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:46.285068 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22717f-ed0d-4c95-91c4-94f68d69737e admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:46.291565 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ea840-7d06-4a67-8e5d-4014c9d8a71d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:46.292249 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ea840-7d06-4a67-8e5d-4014c9d8a71d service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:46.292542 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ea840-7d06-4a67-8e5d-4014c9d8a71d service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:46.292844 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ea840-7d06-4a67-8e5d-4014c9d8a71d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:46.296019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-712ea840-7d06-4a67-8e5d-4014c9d8a71d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:46.313120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22717f-ed0d-4c95-91c4-94f68d69737e admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:46.355078 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21746399-e3bf-4f44-85d3-2b52c491d825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:46.360773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21746399-e3bf-4f44-85d3-2b52c491d825 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:46.364559 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21746399-e3bf-4f44-85d3-2b52c491d825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:46.365004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21746399-e3bf-4f44-85d3-2b52c491d825 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:46.365829 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21746399-e3bf-4f44-85d3-2b52c491d825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:46.375214 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21746399-e3bf-4f44-85d3-2b52c491d825 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:46.404980 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 881/1747] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:46.409423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21746399-e3bf-4f44-85d3-2b52c491d825 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:46.474002 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ea840-7d06-4a67-8e5d-4014c9d8a71d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:46.477035 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ea840-7d06-4a67-8e5d-4014c9d8a71d service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:46.479823 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21746399-e3bf-4f44-85d3-2b52c491d825 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:46.497434 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43dad8-413a-4f25-862c-bd8826e35324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:46.498383 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43dad8-413a-4f25-862c-bd8826e35324 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:46.499326 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43dad8-413a-4f25-862c-bd8826e35324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:46.499446 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 867/1748] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:46.517611 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43dad8-413a-4f25-862c-bd8826e35324 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:46.521934 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f43dad8-413a-4f25-862c-bd8826e35324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:46.532489 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f43dad8-413a-4f25-862c-bd8826e35324 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:46.581728 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ea840-7d06-4a67-8e5d-4014c9d8a71d service cinder] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:46.585511 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 882/1749] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:18:46.612925 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ea840-7d06-4a67-8e5d-4014c9d8a71d service cinder] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:46.619794 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a3bd3-9490-4b10-a978-91e56db31591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:46.624444 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a3bd3-9490-4b10-a978-91e56db31591 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:46.625023 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a3bd3-9490-4b10-a978-91e56db31591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:46.625482 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a3bd3-9490-4b10-a978-91e56db31591 admin admin] PATH_INFO: `/v3/projects/d40e7108becd47cd9db6211a47d4fe7c/users/213e54358e7949fa89f063371b779241/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:46.690087 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a3bd3-9490-4b10-a978-91e56db31591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d40e7108becd47cd9db6211a47d4fe7c, user_id=213e54358e7949fa89f063371b779241, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:46.701336 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a3bd3-9490-4b10-a978-91e56db31591 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:46.863837 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 868/1750] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:18:46 2022] PUT /identity/v3/projects/d40e7108becd47cd9db6211a47d4fe7c/users/213e54358e7949fa89f063371b779241/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:46.867981 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43817084-e6ca-49f2-897a-be679230faeb None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:46.869084 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43817084-e6ca-49f2-897a-be679230faeb None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:46.869694 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43817084-e6ca-49f2-897a-be679230faeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:46.967999 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-43817084-e6ca-49f2-897a-be679230faeb None None] MFA Rules not processed for user `213e54358e7949fa89f063371b779241`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:46.969801 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-43817084-e6ca-49f2-897a-be679230faeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:47.094430 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 883/1751] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:47.100944 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a3bd3-9490-4b10-a978-91e56db31591 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:47.214250 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:47.226427 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a3bd3-9490-4b10-a978-91e56db31591 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:47.249275 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e724fa-b7e1-4dda-994c-a029b93e8816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:47.249972 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e724fa-b7e1-4dda-994c-a029b93e8816 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:47.250256 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e724fa-b7e1-4dda-994c-a029b93e8816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:47.250533 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e724fa-b7e1-4dda-994c-a029b93e8816 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:47.251247 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e724fa-b7e1-4dda-994c-a029b93e8816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:47.253939 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e724fa-b7e1-4dda-994c-a029b93e8816 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:47.265558 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:47.490196 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 869/1752] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:18:47 2022] POST /identity/v3/projects => generated 363 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:47.495278 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43817084-e6ca-49f2-897a-be679230faeb None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:47.524462 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43817084-e6ca-49f2-897a-be679230faeb None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:47.718870 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7bb66-650f-4c7b-be4b-2d2567f1b871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:47.719569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7bb66-650f-4c7b-be4b-2d2567f1b871 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:47.719863 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7bb66-650f-4c7b-be4b-2d2567f1b871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:47.720147 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7bb66-650f-4c7b-be4b-2d2567f1b871 admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:47.720951 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7bb66-650f-4c7b-be4b-2d2567f1b871 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:47.729481 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7bb66-650f-4c7b-be4b-2d2567f1b871 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:47.879897 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 884/1753] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:18:47 2022] POST /identity/v3/users => generated 288 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:47.881284 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e724fa-b7e1-4dda-994c-a029b93e8816 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:47.922027 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e724fa-b7e1-4dda-994c-a029b93e8816 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:47.942507 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125903a-df38-41f1-a223-1d5d64e09147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:47.943868 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125903a-df38-41f1-a223-1d5d64e09147 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:47.947560 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125903a-df38-41f1-a223-1d5d64e09147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:47.948218 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125903a-df38-41f1-a223-1d5d64e09147 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:47.949300 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125903a-df38-41f1-a223-1d5d64e09147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:47.955791 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c125903a-df38-41f1-a223-1d5d64e09147 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:48.002010 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 870/1754] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:48.003535 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7bb66-650f-4c7b-be4b-2d2567f1b871 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:48.015538 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7bb66-650f-4c7b-be4b-2d2567f1b871 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:48.035498 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2948fb6-c1db-4789-bb35-830810839a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:48.038732 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2948fb6-c1db-4789-bb35-830810839a05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:48.038732 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2948fb6-c1db-4789-bb35-830810839a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:48.038732 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2948fb6-c1db-4789-bb35-830810839a05 admin admin] PATH_INFO: `/v3/projects/28224c271d114abdac46a6658a4cf266/users/3a6be0f8a1c34384a757cab9438eace1/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:48.069134 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2948fb6-c1db-4789-bb35-830810839a05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28224c271d114abdac46a6658a4cf266, user_id=3a6be0f8a1c34384a757cab9438eace1, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:48.072763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2948fb6-c1db-4789-bb35-830810839a05 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:48.245320 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 885/1755] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:18:48 2022] PUT /identity/v3/projects/28224c271d114abdac46a6658a4cf266/users/3a6be0f8a1c34384a757cab9438eace1/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:48.251699 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125903a-df38-41f1-a223-1d5d64e09147 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:48.284154 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c125903a-df38-41f1-a223-1d5d64e09147 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:48.377177 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5ddb0-5905-4f6c-9370-ef9a44be1df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:48.378133 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5ddb0-5905-4f6c-9370-ef9a44be1df2 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:48.378514 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5ddb0-5905-4f6c-9370-ef9a44be1df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:48.378884 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5ddb0-5905-4f6c-9370-ef9a44be1df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:48.379881 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5ddb0-5905-4f6c-9370-ef9a44be1df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:48.381949 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5ddb0-5905-4f6c-9370-ef9a44be1df2 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:48.402012 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 871/1756] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:48.407212 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2948fb6-c1db-4789-bb35-830810839a05 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:48.457801 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2948fb6-c1db-4789-bb35-830810839a05 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:48.476844 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c6f2c-74bb-4a73-9950-11f79e1fab88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:48.480701 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c6f2c-74bb-4a73-9950-11f79e1fab88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:48.483378 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c6f2c-74bb-4a73-9950-11f79e1fab88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:48.483378 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c6f2c-74bb-4a73-9950-11f79e1fab88 admin admin] PATH_INFO: `/v3/projects/28224c271d114abdac46a6658a4cf266/users/3a6be0f8a1c34384a757cab9438eace1/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:48.487532 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c6f2c-74bb-4a73-9950-11f79e1fab88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28224c271d114abdac46a6658a4cf266, user_id=3a6be0f8a1c34384a757cab9438eace1, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:48.503808 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c6f2c-74bb-4a73-9950-11f79e1fab88 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:48.527643 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 886/1757] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:18:48 2022] PUT /identity/v3/projects/28224c271d114abdac46a6658a4cf266/users/3a6be0f8a1c34384a757cab9438eace1/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:48.541151 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ce2fe-567e-4d93-9502-82082b701805 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:48.542919 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ce2fe-567e-4d93-9502-82082b701805 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:48.543404 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ce2fe-567e-4d93-9502-82082b701805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:48.628963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-042ce2fe-567e-4d93-9502-82082b701805 None None] MFA Rules not processed for user `3a6be0f8a1c34384a757cab9438eace1`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:48.630927 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-042ce2fe-567e-4d93-9502-82082b701805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:48.800543 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 872/1758] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:18:48 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:49.020067 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c6f2c-74bb-4a73-9950-11f79e1fab88 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:49.024561 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-661c6f2c-74bb-4a73-9950-11f79e1fab88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:49.146720 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c6f2c-74bb-4a73-9950-11f79e1fab88 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:49.165582 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616e679-4d6e-444a-ae5a-c408c5bb9ceb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:49.165582 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616e679-4d6e-444a-ae5a-c408c5bb9ceb service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:49.165582 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616e679-4d6e-444a-ae5a-c408c5bb9ceb service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:49.165582 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616e679-4d6e-444a-ae5a-c408c5bb9ceb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:49.242665 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616e679-4d6e-444a-ae5a-c408c5bb9ceb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:49.244144 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616e679-4d6e-444a-ae5a-c408c5bb9ceb service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:49.284103 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 887/1759] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:49 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:49.802602 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:49.944896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ce2fe-567e-4d93-9502-82082b701805 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:49.961521 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ce2fe-567e-4d93-9502-82082b701805 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:49.971183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0af68-cbce-4710-ba29-91252e896202 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:49.979647 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0af68-cbce-4710-ba29-91252e896202 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:49.979647 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0af68-cbce-4710-ba29-91252e896202 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:49.979647 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0af68-cbce-4710-ba29-91252e896202 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:50.150428 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0af68-cbce-4710-ba29-91252e896202 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:50.155341 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0af68-cbce-4710-ba29-91252e896202 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:50.220131 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 873/1760] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:49 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:50.346510 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669e869-a703-4f6e-81be-c6ede8177e41 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:50.350809 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669e869-a703-4f6e-81be-c6ede8177e41 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:50.353851 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669e869-a703-4f6e-81be-c6ede8177e41 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:50.357713 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 888/1761] 10.222.0.46 () {54 vars in 921 bytes} [Wed Jun 22 10:18:50 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:18:50.466826 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b5483-92a6-4a6e-ace1-cb7f63798f2d None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:50.467551 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b5483-92a6-4a6e-ace1-cb7f63798f2d None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:50.467993 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b5483-92a6-4a6e-ace1-cb7f63798f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:50.503379 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-205b5483-92a6-4a6e-ace1-cb7f63798f2d None None] MFA Rules not processed for user `4ed9a00723ab4af2b633ab7614d178a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:50.504783 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-205b5483-92a6-4a6e-ace1-cb7f63798f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:50.673892 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 874/1762] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Jun 22 10:18:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:18:50.790739 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:51.602254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669e869-a703-4f6e-81be-c6ede8177e41 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:51.604425 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-0669e869-a703-4f6e-81be-c6ede8177e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:51.634082 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669e869-a703-4f6e-81be-c6ede8177e41 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:51.659209 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afe047-35a5-4033-acbf-35f9bc687c53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:51.662637 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afe047-35a5-4033-acbf-35f9bc687c53 service nova] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:51.662637 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afe047-35a5-4033-acbf-35f9bc687c53 service nova] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:51.662637 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afe047-35a5-4033-acbf-35f9bc687c53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:51.722807 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afe047-35a5-4033-acbf-35f9bc687c53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:51.726702 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afe047-35a5-4033-acbf-35f9bc687c53 service nova] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:51.787784 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 889/1763] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:52.213639 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:57.786079 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b5483-92a6-4a6e-ace1-cb7f63798f2d None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:57.797062 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b5483-92a6-4a6e-ace1-cb7f63798f2d None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:57.801430 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982befa-7d3d-410b-84f0-d67f1b34d7d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:57.802232 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982befa-7d3d-410b-84f0-d67f1b34d7d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:57.802588 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982befa-7d3d-410b-84f0-d67f1b34d7d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:57.802942 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982befa-7d3d-410b-84f0-d67f1b34d7d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:57.915591 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982befa-7d3d-410b-84f0-d67f1b34d7d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:57.917107 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982befa-7d3d-410b-84f0-d67f1b34d7d4 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:57.928901 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 875/1764] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:57 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:59.822697 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afe047-35a5-4033-acbf-35f9bc687c53 service nova] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:59.824439 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-46afe047-35a5-4033-acbf-35f9bc687c53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:59.905014 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afe047-35a5-4033-acbf-35f9bc687c53 service nova] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:59.909725 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416db2b-0fca-46d3-ac4a-211c16c63b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:59.910594 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416db2b-0fca-46d3-ac4a-211c16c63b9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:59.910878 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416db2b-0fca-46d3-ac4a-211c16c63b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:59.911153 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416db2b-0fca-46d3-ac4a-211c16c63b9d admin admin] PATH_INFO: `/v3/users/2033482f0ed34e5288627ca045df1145` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:59.912345 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416db2b-0fca-46d3-ac4a-211c16c63b9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2033482f0ed34e5288627ca045df1145)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:59.914296 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416db2b-0fca-46d3-ac4a-211c16c63b9d admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:00.174040 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:00.185290 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9416db2b-0fca-46d3-ac4a-211c16c63b9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2033482f0ed34e5288627ca045df1145'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:00.185948 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9416db2b-0fca-46d3-ac4a-211c16c63b9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2033482f0ed34e5288627ca045df1145'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:00.297861 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9416db2b-0fca-46d3-ac4a-211c16c63b9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2033482f0ed34e5288627ca045df1145'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:00.311045 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9416db2b-0fca-46d3-ac4a-211c16c63b9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2033482f0ed34e5288627ca045df1145'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:00.319390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9416db2b-0fca-46d3-ac4a-211c16c63b9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2033482f0ed34e5288627ca045df1145'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:00.325722 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 890/1765] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:18:59 2022] DELETE /identity/v3/users/2033482f0ed34e5288627ca045df1145 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:19:00.330701 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff62e7-d344-49af-aff7-7bc59815f691 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:00.331128 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff62e7-d344-49af-aff7-7bc59815f691 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:00.331211 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff62e7-d344-49af-aff7-7bc59815f691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:00.348291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-94ff62e7-d344-49af-aff7-7bc59815f691 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:19:00.349601 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-94ff62e7-d344-49af-aff7-7bc59815f691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:00.412928 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 876/1766] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:19:00.423012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416db2b-0fca-46d3-ac4a-211c16c63b9d admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:00.424454 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-9416db2b-0fca-46d3-ac4a-211c16c63b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:00.481114 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416db2b-0fca-46d3-ac4a-211c16c63b9d admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:00.484666 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b43cd-9334-4b63-8790-3cc8524487b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:00.485825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b43cd-9334-4b63-8790-3cc8524487b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:00.487305 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b43cd-9334-4b63-8790-3cc8524487b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:00.487305 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b43cd-9334-4b63-8790-3cc8524487b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:00.495608 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b43cd-9334-4b63-8790-3cc8524487b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:00.497051 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b43cd-9334-4b63-8790-3cc8524487b2 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:00.507807 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 891/1767] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:19:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:19:01.026568 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff62e7-d344-49af-aff7-7bc59815f691 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:01.028159 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-94ff62e7-d344-49af-aff7-7bc59815f691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:01.042154 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff62e7-d344-49af-aff7-7bc59815f691 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:01.047007 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a33377-2e55-41ad-b32e-1d795f5b65ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:01.048396 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a33377-2e55-41ad-b32e-1d795f5b65ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:01.048686 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a33377-2e55-41ad-b32e-1d795f5b65ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:01.049011 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a33377-2e55-41ad-b32e-1d795f5b65ee admin admin] PATH_INFO: `/v3/projects/44283a97c1d147db8c95dfeb066c55ca` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:01.050422 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a33377-2e55-41ad-b32e-1d795f5b65ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=44283a97c1d147db8c95dfeb066c55ca)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:01.052244 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a33377-2e55-41ad-b32e-1d795f5b65ee admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:01.186505 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:01.206374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-58a33377-2e55-41ad-b32e-1d795f5b65ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44283a97c1d147db8c95dfeb066c55ca', 'request_id': 'req-58a33377-2e55-41ad-b32e-1d795f5b65ee'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:01.215387 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-58a33377-2e55-41ad-b32e-1d795f5b65ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44283a97c1d147db8c95dfeb066c55ca', 'request_id': 'req-58a33377-2e55-41ad-b32e-1d795f5b65ee'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:01.315574 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-58a33377-2e55-41ad-b32e-1d795f5b65ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44283a97c1d147db8c95dfeb066c55ca', 'request_id': 'req-58a33377-2e55-41ad-b32e-1d795f5b65ee'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:01.327223 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-58a33377-2e55-41ad-b32e-1d795f5b65ee admin admin] The token cache is being invalidate because project 44283a97c1d147db8c95dfeb066c55ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:19:01.327513 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-58a33377-2e55-41ad-b32e-1d795f5b65ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:01.328167 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-58a33377-2e55-41ad-b32e-1d795f5b65ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:01.329759 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 877/1768] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:19:01 2022] DELETE /identity/v3/projects/44283a97c1d147db8c95dfeb066c55ca => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:19:01.333951 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b43cd-9334-4b63-8790-3cc8524487b2 service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:01.346726 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b43cd-9334-4b63-8790-3cc8524487b2 service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:01.402033 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d66da-f3bd-4425-b192-af3ce48f4f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:01.402924 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d66da-f3bd-4425-b192-af3ce48f4f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:01.403207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d66da-f3bd-4425-b192-af3ce48f4f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:01.403484 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d66da-f3bd-4425-b192-af3ce48f4f95 admin admin] PATH_INFO: `/v3/users/c9242c373795455b8dae61af5d7d1ac7` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:01.404668 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d66da-f3bd-4425-b192-af3ce48f4f95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9242c373795455b8dae61af5d7d1ac7)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:01.407165 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d66da-f3bd-4425-b192-af3ce48f4f95 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:01.563342 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-dc9d66da-f3bd-4425-b192-af3ce48f4f95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9242c373795455b8dae61af5d7d1ac7'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:01.564012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-dc9d66da-f3bd-4425-b192-af3ce48f4f95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9242c373795455b8dae61af5d7d1ac7'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:01.658169 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-dc9d66da-f3bd-4425-b192-af3ce48f4f95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9242c373795455b8dae61af5d7d1ac7'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:01.659701 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:01.671684 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-dc9d66da-f3bd-4425-b192-af3ce48f4f95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9242c373795455b8dae61af5d7d1ac7'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:01.679112 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-dc9d66da-f3bd-4425-b192-af3ce48f4f95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9242c373795455b8dae61af5d7d1ac7'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:01.685419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 892/1769] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:19:01 2022] DELETE /identity/v3/users/c9242c373795455b8dae61af5d7d1ac7 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:19:02.145065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a33377-2e55-41ad-b32e-1d795f5b65ee admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:02.146501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-58a33377-2e55-41ad-b32e-1d795f5b65ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:02.162644 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a33377-2e55-41ad-b32e-1d795f5b65ee admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:02.220859 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a13a6f-713f-4cdb-bf68-839854857d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:02.221732 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a13a6f-713f-4cdb-bf68-839854857d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:02.222015 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a13a6f-713f-4cdb-bf68-839854857d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:02.222292 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a13a6f-713f-4cdb-bf68-839854857d03 admin admin] PATH_INFO: `/v3/projects/72610dd9fb84485980e8200429d23cd1` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:02.223499 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a13a6f-713f-4cdb-bf68-839854857d03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72610dd9fb84485980e8200429d23cd1)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:02.225479 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a13a6f-713f-4cdb-bf68-839854857d03 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:02.322552 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-06a13a6f-713f-4cdb-bf68-839854857d03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72610dd9fb84485980e8200429d23cd1', 'request_id': 'req-06a13a6f-713f-4cdb-bf68-839854857d03'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:02.328977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-06a13a6f-713f-4cdb-bf68-839854857d03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72610dd9fb84485980e8200429d23cd1', 'request_id': 'req-06a13a6f-713f-4cdb-bf68-839854857d03'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:02.406162 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-06a13a6f-713f-4cdb-bf68-839854857d03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72610dd9fb84485980e8200429d23cd1', 'request_id': 'req-06a13a6f-713f-4cdb-bf68-839854857d03'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:02.417454 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-06a13a6f-713f-4cdb-bf68-839854857d03 admin admin] The token cache is being invalidate because project 72610dd9fb84485980e8200429d23cd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:19:02.417744 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-06a13a6f-713f-4cdb-bf68-839854857d03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:02.418442 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-06a13a6f-713f-4cdb-bf68-839854857d03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:02.420173 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 878/1770] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:19:02 2022] DELETE /identity/v3/projects/72610dd9fb84485980e8200429d23cd1 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:19:02.425810 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54987c-745f-4f93-aead-dc979318530d None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:02.426276 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54987c-745f-4f93-aead-dc979318530d None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:02.426388 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54987c-745f-4f93-aead-dc979318530d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:02.445363 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-ec54987c-745f-4f93-aead-dc979318530d None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:19:02.446579 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-ec54987c-745f-4f93-aead-dc979318530d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:02.504387 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 893/1771] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:19:02.513090 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfdcdb-a99b-4f07-8dbc-734f9af93f23 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:02.513375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfdcdb-a99b-4f07-8dbc-734f9af93f23 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:02.513648 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfdcdb-a99b-4f07-8dbc-734f9af93f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:02.531987 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-0abfdcdb-a99b-4f07-8dbc-734f9af93f23 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:19:02.533332 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-0abfdcdb-a99b-4f07-8dbc-734f9af93f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:02.541532 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 879/1772] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:19:02.545867 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54987c-745f-4f93-aead-dc979318530d None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:02.556985 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54987c-745f-4f93-aead-dc979318530d None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:02.562028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797e7c3-6824-4c02-ae5b-a84e660e2977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:02.565581 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797e7c3-6824-4c02-ae5b-a84e660e2977 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:02.565581 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797e7c3-6824-4c02-ae5b-a84e660e2977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:02.565581 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797e7c3-6824-4c02-ae5b-a84e660e2977 admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:02.565581 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d797e7c3-6824-4c02-ae5b-a84e660e2977 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:19:02.565581 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d797e7c3-6824-4c02-ae5b-a84e660e2977 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:02.566536 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d797e7c3-6824-4c02-ae5b-a84e660e2977 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:02.579548 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 894/1773] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:19:02.583699 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfdcdb-a99b-4f07-8dbc-734f9af93f23 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:02.593357 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfdcdb-a99b-4f07-8dbc-734f9af93f23 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:02.598290 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe10b3-312d-4e73-ae07-17e0fc9b8188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:02.598962 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe10b3-312d-4e73-ae07-17e0fc9b8188 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:02.599248 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe10b3-312d-4e73-ae07-17e0fc9b8188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:02.599525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe10b3-312d-4e73-ae07-17e0fc9b8188 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:02.600233 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe10b3-312d-4e73-ae07-17e0fc9b8188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:02.602171 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe10b3-312d-4e73-ae07-17e0fc9b8188 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:02.710954 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 880/1774] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:19:02 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:19:02.714428 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797e7c3-6824-4c02-ae5b-a84e660e2977 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:02.724501 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797e7c3-6824-4c02-ae5b-a84e660e2977 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:02.780135 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423c5ab-d79b-4984-a6c5-ce9bd05a2bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:02.780801 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423c5ab-d79b-4984-a6c5-ce9bd05a2bfc admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:02.781695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423c5ab-d79b-4984-a6c5-ce9bd05a2bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:02.781695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423c5ab-d79b-4984-a6c5-ce9bd05a2bfc admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:02.782059 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423c5ab-d79b-4984-a6c5-ce9bd05a2bfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:02.784473 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423c5ab-d79b-4984-a6c5-ce9bd05a2bfc admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:02.867338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 895/1775] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:19:02 2022] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:19:02.879933 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe10b3-312d-4e73-ae07-17e0fc9b8188 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:02.880477 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe10b3-312d-4e73-ae07-17e0fc9b8188 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:02.885727 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b97cf-c560-40d7-873d-ee8a97b26792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:02.886439 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b97cf-c560-40d7-873d-ee8a97b26792 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:02.886738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b97cf-c560-40d7-873d-ee8a97b26792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:02.887008 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b97cf-c560-40d7-873d-ee8a97b26792 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:02.887737 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b97cf-c560-40d7-873d-ee8a97b26792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:02.889414 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b97cf-c560-40d7-873d-ee8a97b26792 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:02.901523 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 881/1776] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:19:02.908629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423c5ab-d79b-4984-a6c5-ce9bd05a2bfc admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:02.918938 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423c5ab-d79b-4984-a6c5-ce9bd05a2bfc admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:02.924272 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00e7a8-79ea-4b6b-a04c-b473f0d641cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:02.928071 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00e7a8-79ea-4b6b-a04c-b473f0d641cd admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:02.928071 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00e7a8-79ea-4b6b-a04c-b473f0d641cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:02.928071 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00e7a8-79ea-4b6b-a04c-b473f0d641cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:02.928071 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00e7a8-79ea-4b6b-a04c-b473f0d641cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:02.928071 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00e7a8-79ea-4b6b-a04c-b473f0d641cd admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:02.939816 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 896/1777] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:19:02.944106 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b97cf-c560-40d7-873d-ee8a97b26792 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:02.958310 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b97cf-c560-40d7-873d-ee8a97b26792 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:02.961218 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19ba7f-26c8-44a9-be49-e1ba0fda8f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:02.962130 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19ba7f-26c8-44a9-be49-e1ba0fda8f90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:02.962130 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19ba7f-26c8-44a9-be49-e1ba0fda8f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:02.962677 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19ba7f-26c8-44a9-be49-e1ba0fda8f90 admin admin] PATH_INFO: `/v3/projects/ed08bae7f74c4542ae688e737049d921/users/3da12750959c488080e4c8a793c9f334/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:02.965228 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:02.982313 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19ba7f-26c8-44a9-be49-e1ba0fda8f90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed08bae7f74c4542ae688e737049d921, user_id=3da12750959c488080e4c8a793c9f334, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:02.985181 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19ba7f-26c8-44a9-be49-e1ba0fda8f90 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:03.086833 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 882/1778] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:19:02 2022] PUT /identity/v3/projects/ed08bae7f74c4542ae688e737049d921/users/3da12750959c488080e4c8a793c9f334/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:19:03.098866 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193e4dc-5179-4911-b1b1-a30567575bc5 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:03.099169 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193e4dc-5179-4911-b1b1-a30567575bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:03.101190 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193e4dc-5179-4911-b1b1-a30567575bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:03.134958 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-7193e4dc-5179-4911-b1b1-a30567575bc5 None None] MFA Rules not processed for user `3da12750959c488080e4c8a793c9f334`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:19:03.137184 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-7193e4dc-5179-4911-b1b1-a30567575bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:03.169428 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:03.221699 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 897/1779] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:19:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:19:03.226700 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19ba7f-26c8-44a9-be49-e1ba0fda8f90 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:03.294878 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19ba7f-26c8-44a9-be49-e1ba0fda8f90 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:03.300076 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3a31d-49f9-466d-8a89-3606def03072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:03.300754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3a31d-49f9-466d-8a89-3606def03072 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:03.301066 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3a31d-49f9-466d-8a89-3606def03072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:03.301340 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3a31d-49f9-466d-8a89-3606def03072 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:03.302070 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3a31d-49f9-466d-8a89-3606def03072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:03.304179 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3a31d-49f9-466d-8a89-3606def03072 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:03.458653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 883/1780] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:19:03 2022] POST /identity/v3/projects => generated 381 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:19:03.459876 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193e4dc-5179-4911-b1b1-a30567575bc5 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:03.472994 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193e4dc-5179-4911-b1b1-a30567575bc5 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:03.553811 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240e27c-8204-4aa8-a871-ea5cb9857630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:03.554530 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240e27c-8204-4aa8-a871-ea5cb9857630 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:03.554817 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240e27c-8204-4aa8-a871-ea5cb9857630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:03.555124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240e27c-8204-4aa8-a871-ea5cb9857630 admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:03.555837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240e27c-8204-4aa8-a871-ea5cb9857630 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:03.557858 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240e27c-8204-4aa8-a871-ea5cb9857630 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:03.649688 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 898/1781] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:19:03 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:19:03.653807 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3a31d-49f9-466d-8a89-3606def03072 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:03.674718 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3a31d-49f9-466d-8a89-3606def03072 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:03.692703 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed9a41-b18b-4de2-8ec6-0848a6a9c140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:03.693956 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed9a41-b18b-4de2-8ec6-0848a6a9c140 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:03.695031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed9a41-b18b-4de2-8ec6-0848a6a9c140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:03.695515 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed9a41-b18b-4de2-8ec6-0848a6a9c140 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:03.696466 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed9a41-b18b-4de2-8ec6-0848a6a9c140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:03.698471 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed9a41-b18b-4de2-8ec6-0848a6a9c140 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:03.719829 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 884/1782] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:19:03.720012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240e27c-8204-4aa8-a871-ea5cb9857630 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:03.728952 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240e27c-8204-4aa8-a871-ea5cb9857630 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:03.734355 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448595b-5c97-4567-afb8-24f5e7b55700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:03.735287 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448595b-5c97-4567-afb8-24f5e7b55700 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:03.735871 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448595b-5c97-4567-afb8-24f5e7b55700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:03.735995 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448595b-5c97-4567-afb8-24f5e7b55700 admin admin] PATH_INFO: `/v3/projects/0808392b348d4ee2bf50635b55f66242/users/465967a927254a51993ff8d962485ede/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:03.756259 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448595b-5c97-4567-afb8-24f5e7b55700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0808392b348d4ee2bf50635b55f66242, user_id=465967a927254a51993ff8d962485ede, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:03.759366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448595b-5c97-4567-afb8-24f5e7b55700 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:03.828655 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 899/1783] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:19:03 2022] PUT /identity/v3/projects/0808392b348d4ee2bf50635b55f66242/users/465967a927254a51993ff8d962485ede/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:19:03.833845 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed9a41-b18b-4de2-8ec6-0848a6a9c140 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:03.847278 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed9a41-b18b-4de2-8ec6-0848a6a9c140 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:03.914825 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907ab44-6f68-4f3e-b6a0-2cdf03864ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:03.915593 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907ab44-6f68-4f3e-b6a0-2cdf03864ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:03.915938 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907ab44-6f68-4f3e-b6a0-2cdf03864ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:03.916297 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907ab44-6f68-4f3e-b6a0-2cdf03864ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:03.917141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907ab44-6f68-4f3e-b6a0-2cdf03864ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:03.918845 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907ab44-6f68-4f3e-b6a0-2cdf03864ef7 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:03.932752 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 885/1784] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:19:03.937457 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448595b-5c97-4567-afb8-24f5e7b55700 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:03.959032 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448595b-5c97-4567-afb8-24f5e7b55700 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:03.966310 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f28cfc-1b3e-4400-a53a-c4ecf57a91ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:03.971000 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f28cfc-1b3e-4400-a53a-c4ecf57a91ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:03.971000 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f28cfc-1b3e-4400-a53a-c4ecf57a91ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:03.971000 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f28cfc-1b3e-4400-a53a-c4ecf57a91ad admin admin] PATH_INFO: `/v3/projects/0808392b348d4ee2bf50635b55f66242/users/465967a927254a51993ff8d962485ede/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:03.971941 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f28cfc-1b3e-4400-a53a-c4ecf57a91ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=0808392b348d4ee2bf50635b55f66242, user_id=465967a927254a51993ff8d962485ede, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:03.976729 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f28cfc-1b3e-4400-a53a-c4ecf57a91ad admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:03.994512 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 900/1785] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:19:03 2022] PUT /identity/v3/projects/0808392b348d4ee2bf50635b55f66242/users/465967a927254a51993ff8d962485ede/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:19:04.008216 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd19a4-f380-49cd-983c-408af60c6e4e None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:04.008514 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd19a4-f380-49cd-983c-408af60c6e4e None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:04.008790 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd19a4-f380-49cd-983c-408af60c6e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:04.036592 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-3bbd19a4-f380-49cd-983c-408af60c6e4e None None] MFA Rules not processed for user `465967a927254a51993ff8d962485ede`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:19:04.038365 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-3bbd19a4-f380-49cd-983c-408af60c6e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:04.091925 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:04.127581 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 886/1786] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:19:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:19:04.305060 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f28cfc-1b3e-4400-a53a-c4ecf57a91ad admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:04.306779 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-c8f28cfc-1b3e-4400-a53a-c4ecf57a91ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:04.371175 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f28cfc-1b3e-4400-a53a-c4ecf57a91ad admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:04.375833 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51c054-9cf9-40b6-a7a7-b0264dbf8004 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:04.376509 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51c054-9cf9-40b6-a7a7-b0264dbf8004 service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:04.376795 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51c054-9cf9-40b6-a7a7-b0264dbf8004 service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:04.377103 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51c054-9cf9-40b6-a7a7-b0264dbf8004 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:04.397815 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51c054-9cf9-40b6-a7a7-b0264dbf8004 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:04.399665 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51c054-9cf9-40b6-a7a7-b0264dbf8004 service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:04.410402 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 901/1787] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:19:04 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:19:05.028132 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd19a4-f380-49cd-983c-408af60c6e4e None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:05.098330 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd19a4-f380-49cd-983c-408af60c6e4e None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:05.102813 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04af4f-c363-4948-9b0d-b20bed2c460d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:05.103686 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04af4f-c363-4948-9b0d-b20bed2c460d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:05.103968 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04af4f-c363-4948-9b0d-b20bed2c460d admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:05.104241 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04af4f-c363-4948-9b0d-b20bed2c460d admin admin] PATH_INFO: `/v3/users/3da12750959c488080e4c8a793c9f334` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:05.105443 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04af4f-c363-4948-9b0d-b20bed2c460d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3da12750959c488080e4c8a793c9f334)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:05.107351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04af4f-c363-4948-9b0d-b20bed2c460d admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:05.299373 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-9d04af4f-c363-4948-9b0d-b20bed2c460d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3da12750959c488080e4c8a793c9f334'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:05.314851 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-9d04af4f-c363-4948-9b0d-b20bed2c460d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3da12750959c488080e4c8a793c9f334'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:05.400134 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-9d04af4f-c363-4948-9b0d-b20bed2c460d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3da12750959c488080e4c8a793c9f334'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:05.400761 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-9d04af4f-c363-4948-9b0d-b20bed2c460d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3da12750959c488080e4c8a793c9f334'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:05.408358 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-9d04af4f-c363-4948-9b0d-b20bed2c460d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3da12750959c488080e4c8a793c9f334'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:05.414433 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 887/1788] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:19:05 2022] DELETE /identity/v3/users/3da12750959c488080e4c8a793c9f334 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:19:05.419037 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f2870-1795-462a-908a-a0c962433f1a None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:05.419511 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f2870-1795-462a-908a-a0c962433f1a None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:05.419601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f2870-1795-462a-908a-a0c962433f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:05.436850 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-c16f2870-1795-462a-908a-a0c962433f1a None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:19:05.438071 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-c16f2870-1795-462a-908a-a0c962433f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:05.454709 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:05.494945 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 902/1789] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:19:05.505221 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04af4f-c363-4948-9b0d-b20bed2c460d admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:05.506606 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-9d04af4f-c363-4948-9b0d-b20bed2c460d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:05.561741 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04af4f-c363-4948-9b0d-b20bed2c460d admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:05.565908 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cc94d-1503-42af-b93e-5dee4a272637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:05.566559 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cc94d-1503-42af-b93e-5dee4a272637 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:05.566792 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cc94d-1503-42af-b93e-5dee4a272637 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:05.567067 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cc94d-1503-42af-b93e-5dee4a272637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:05.576628 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32cc94d-1503-42af-b93e-5dee4a272637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:05.582098 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32cc94d-1503-42af-b93e-5dee4a272637 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:05.587105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:05.592136 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 888/1790] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:19:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:19:06.007594 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f2870-1795-462a-908a-a0c962433f1a None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:06.009106 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-c16f2870-1795-462a-908a-a0c962433f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:06.024250 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f2870-1795-462a-908a-a0c962433f1a None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:06.029034 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459dc37f-5aa3-43f1-8045-6439a33fc458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:06.029904 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459dc37f-5aa3-43f1-8045-6439a33fc458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:06.030216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459dc37f-5aa3-43f1-8045-6439a33fc458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:06.030493 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459dc37f-5aa3-43f1-8045-6439a33fc458 admin admin] PATH_INFO: `/v3/projects/ed08bae7f74c4542ae688e737049d921` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:06.031719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459dc37f-5aa3-43f1-8045-6439a33fc458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed08bae7f74c4542ae688e737049d921)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:06.034748 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459dc37f-5aa3-43f1-8045-6439a33fc458 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:06.155772 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-459dc37f-5aa3-43f1-8045-6439a33fc458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed08bae7f74c4542ae688e737049d921', 'request_id': 'req-459dc37f-5aa3-43f1-8045-6439a33fc458'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:06.162111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-459dc37f-5aa3-43f1-8045-6439a33fc458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed08bae7f74c4542ae688e737049d921', 'request_id': 'req-459dc37f-5aa3-43f1-8045-6439a33fc458'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:06.234391 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-459dc37f-5aa3-43f1-8045-6439a33fc458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed08bae7f74c4542ae688e737049d921', 'request_id': 'req-459dc37f-5aa3-43f1-8045-6439a33fc458'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:06.246319 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-459dc37f-5aa3-43f1-8045-6439a33fc458 admin admin] The token cache is being invalidate because project ed08bae7f74c4542ae688e737049d921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:19:06.246605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-459dc37f-5aa3-43f1-8045-6439a33fc458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:06.247256 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-459dc37f-5aa3-43f1-8045-6439a33fc458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:06.248792 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 903/1791] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:19:06 2022] DELETE /identity/v3/projects/ed08bae7f74c4542ae688e737049d921 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:19:06.252855 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cc94d-1503-42af-b93e-5dee4a272637 service neutron] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:06.262347 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cc94d-1503-42af-b93e-5dee4a272637 service neutron] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:06.319985 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cfbd8-4ba8-40cf-a4a3-3f25d8fe6090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:06.320945 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cfbd8-4ba8-40cf-a4a3-3f25d8fe6090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:06.321179 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cfbd8-4ba8-40cf-a4a3-3f25d8fe6090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:06.321466 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cfbd8-4ba8-40cf-a4a3-3f25d8fe6090 admin admin] PATH_INFO: `/v3/users/465967a927254a51993ff8d962485ede` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:06.322742 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62cfbd8-4ba8-40cf-a4a3-3f25d8fe6090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=465967a927254a51993ff8d962485ede)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:06.324737 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62cfbd8-4ba8-40cf-a4a3-3f25d8fe6090 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:06.553534 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f62cfbd8-4ba8-40cf-a4a3-3f25d8fe6090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '465967a927254a51993ff8d962485ede'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:06.565609 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f62cfbd8-4ba8-40cf-a4a3-3f25d8fe6090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '465967a927254a51993ff8d962485ede'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:06.605603 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f62cfbd8-4ba8-40cf-a4a3-3f25d8fe6090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '465967a927254a51993ff8d962485ede'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:06.606375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f62cfbd8-4ba8-40cf-a4a3-3f25d8fe6090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '465967a927254a51993ff8d962485ede'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:06.614447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f62cfbd8-4ba8-40cf-a4a3-3f25d8fe6090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '465967a927254a51993ff8d962485ede'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:06.620510 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 889/1792] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:19:06 2022] DELETE /identity/v3/users/465967a927254a51993ff8d962485ede => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:19:07.013922 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459dc37f-5aa3-43f1-8045-6439a33fc458 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:07.017039 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-459dc37f-5aa3-43f1-8045-6439a33fc458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:07.035956 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459dc37f-5aa3-43f1-8045-6439a33fc458 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:07.101748 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af9d0e-3ccc-4655-8512-fd048da24d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:07.102662 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af9d0e-3ccc-4655-8512-fd048da24d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:07.102945 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af9d0e-3ccc-4655-8512-fd048da24d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:07.103223 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af9d0e-3ccc-4655-8512-fd048da24d21 admin admin] PATH_INFO: `/v3/projects/0808392b348d4ee2bf50635b55f66242` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:07.104489 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af9d0e-3ccc-4655-8512-fd048da24d21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0808392b348d4ee2bf50635b55f66242)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:07.106519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af9d0e-3ccc-4655-8512-fd048da24d21 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:07.194427 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:07.195815 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-33af9d0e-3ccc-4655-8512-fd048da24d21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0808392b348d4ee2bf50635b55f66242', 'request_id': 'req-33af9d0e-3ccc-4655-8512-fd048da24d21'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:07.201218 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-33af9d0e-3ccc-4655-8512-fd048da24d21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0808392b348d4ee2bf50635b55f66242', 'request_id': 'req-33af9d0e-3ccc-4655-8512-fd048da24d21'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:07.245509 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-33af9d0e-3ccc-4655-8512-fd048da24d21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0808392b348d4ee2bf50635b55f66242', 'request_id': 'req-33af9d0e-3ccc-4655-8512-fd048da24d21'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:07.257658 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-33af9d0e-3ccc-4655-8512-fd048da24d21 admin admin] The token cache is being invalidate because project 0808392b348d4ee2bf50635b55f66242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:19:07.257948 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-33af9d0e-3ccc-4655-8512-fd048da24d21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:07.259357 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-33af9d0e-3ccc-4655-8512-fd048da24d21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:07.260765 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 904/1793] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:19:07 2022] DELETE /identity/v3/projects/0808392b348d4ee2bf50635b55f66242 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:19:07.265722 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099267a-0470-47a6-aa61-1719d3b413a0 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:07.267037 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099267a-0470-47a6-aa61-1719d3b413a0 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:07.267231 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099267a-0470-47a6-aa61-1719d3b413a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:07.285010 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-4099267a-0470-47a6-aa61-1719d3b413a0 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:19:07.286229 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-4099267a-0470-47a6-aa61-1719d3b413a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:07.348372 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 890/1794] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:19:07.356476 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7698e76-819e-49b5-a7c4-a6fce43c2c31 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:07.356762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7698e76-819e-49b5-a7c4-a6fce43c2c31 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:07.360551 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7698e76-819e-49b5-a7c4-a6fce43c2c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:07.377038 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-d7698e76-819e-49b5-a7c4-a6fce43c2c31 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:19:07.378302 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-d7698e76-819e-49b5-a7c4-a6fce43c2c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:07.389412 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 905/1795] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:19:07.393992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099267a-0470-47a6-aa61-1719d3b413a0 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:07.404105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099267a-0470-47a6-aa61-1719d3b413a0 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:07.409240 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691b3b0-d755-4d7b-a1a2-7ba43de95e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:07.409920 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691b3b0-d755-4d7b-a1a2-7ba43de95e0b admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:07.410298 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691b3b0-d755-4d7b-a1a2-7ba43de95e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:07.410461 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691b3b0-d755-4d7b-a1a2-7ba43de95e0b admin admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:07.411308 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691b3b0-d755-4d7b-a1a2-7ba43de95e0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:19:07.411527 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691b3b0-d755-4d7b-a1a2-7ba43de95e0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:07.413161 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691b3b0-d755-4d7b-a1a2-7ba43de95e0b admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:07.425876 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 891/1796] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:19:07.430460 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7698e76-819e-49b5-a7c4-a6fce43c2c31 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:07.440059 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7698e76-819e-49b5-a7c4-a6fce43c2c31 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:07.444795 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9079e95-462a-40a5-8ece-eb3957d2bfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:07.445493 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9079e95-462a-40a5-8ece-eb3957d2bfd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:07.445780 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9079e95-462a-40a5-8ece-eb3957d2bfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:07.446058 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9079e95-462a-40a5-8ece-eb3957d2bfd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:07.446757 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9079e95-462a-40a5-8ece-eb3957d2bfd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:07.448696 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9079e95-462a-40a5-8ece-eb3957d2bfd3 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:07.510350 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 906/1797] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:19:07 2022] POST /identity/v3/projects => generated 375 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:19:07.514409 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691b3b0-d755-4d7b-a1a2-7ba43de95e0b admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:07.524694 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691b3b0-d755-4d7b-a1a2-7ba43de95e0b admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:07.528257 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:07.582598 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c10a8d-9424-4651-9aaf-de7b7988503a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:07.583287 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c10a8d-9424-4651-9aaf-de7b7988503a admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:07.584309 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c10a8d-9424-4651-9aaf-de7b7988503a admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:07.584309 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c10a8d-9424-4651-9aaf-de7b7988503a admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:07.584580 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c10a8d-9424-4651-9aaf-de7b7988503a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:07.586714 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c10a8d-9424-4651-9aaf-de7b7988503a admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:07.652251 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 892/1798] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:19:07 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:19:07.656407 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9079e95-462a-40a5-8ece-eb3957d2bfd3 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:07.671663 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9079e95-462a-40a5-8ece-eb3957d2bfd3 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:07.677197 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3905d-4b3c-4bb2-856e-717e8db67642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:07.677805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3905d-4b3c-4bb2-856e-717e8db67642 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:07.678096 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3905d-4b3c-4bb2-856e-717e8db67642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:07.682437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3905d-4b3c-4bb2-856e-717e8db67642 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:07.683366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a3905d-4b3c-4bb2-856e-717e8db67642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:07.685152 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a3905d-4b3c-4bb2-856e-717e8db67642 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:07.697185 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 907/1799] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:19:07.701195 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c10a8d-9424-4651-9aaf-de7b7988503a admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:07.711383 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c10a8d-9424-4651-9aaf-de7b7988503a admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:07.718544 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe27fe-b5b6-4bf0-9768-84dc3eff0f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:07.719788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe27fe-b5b6-4bf0-9768-84dc3eff0f35 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:07.720072 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe27fe-b5b6-4bf0-9768-84dc3eff0f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:07.720348 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe27fe-b5b6-4bf0-9768-84dc3eff0f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:07.721147 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe27fe-b5b6-4bf0-9768-84dc3eff0f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:07.722846 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe27fe-b5b6-4bf0-9768-84dc3eff0f35 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:07.738225 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 893/1800] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:19:07.742272 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3905d-4b3c-4bb2-856e-717e8db67642 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:07.752163 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3905d-4b3c-4bb2-856e-717e8db67642 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:07.756727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1c2da-2318-4967-9103-db37083d049a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:07.757644 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1c2da-2318-4967-9103-db37083d049a admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:07.757931 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1c2da-2318-4967-9103-db37083d049a admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:07.758206 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1c2da-2318-4967-9103-db37083d049a admin admin] PATH_INFO: `/v3/projects/115b6bd8b1764d5f933b22950b98b727/users/169ea4f12e9e4ba686193143358ba2b3/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:07.772806 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1c2da-2318-4967-9103-db37083d049a admin admin] RBAC: Authorizing `identity:create_grant(project_id=115b6bd8b1764d5f933b22950b98b727, user_id=169ea4f12e9e4ba686193143358ba2b3, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:07.775523 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1c2da-2318-4967-9103-db37083d049a admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:07.840550 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 908/1801] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:19:07 2022] PUT /identity/v3/projects/115b6bd8b1764d5f933b22950b98b727/users/169ea4f12e9e4ba686193143358ba2b3/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:19:07.851368 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54308ebb-d66f-474d-8978-b352a549d37a None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:07.852348 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54308ebb-d66f-474d-8978-b352a549d37a None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:07.852348 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54308ebb-d66f-474d-8978-b352a549d37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:07.882493 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-54308ebb-d66f-474d-8978-b352a549d37a None None] MFA Rules not processed for user `169ea4f12e9e4ba686193143358ba2b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:19:07.882493 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-54308ebb-d66f-474d-8978-b352a549d37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:07.948159 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 894/1802] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:19:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:19:07.959584 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1c2da-2318-4967-9103-db37083d049a admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:07.961295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-dbc1c2da-2318-4967-9103-db37083d049a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:08.017789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1c2da-2318-4967-9103-db37083d049a admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:08.021458 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fd89b-f3e3-4d69-8ac9-ef1929857edc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:08.022105 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fd89b-f3e3-4d69-8ac9-ef1929857edc service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:08.022389 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fd89b-f3e3-4d69-8ac9-ef1929857edc service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:08.022669 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fd89b-f3e3-4d69-8ac9-ef1929857edc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:08.030932 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fd89b-f3e3-4d69-8ac9-ef1929857edc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:08.032878 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fd89b-f3e3-4d69-8ac9-ef1929857edc service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:08.041762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 909/1803] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:19:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:19:17.945148 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=63,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:18.037641 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=60,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:23.337575 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861eb16b-4184-4c6c-ba52-eabd69526d7b None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:23.338021 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861eb16b-4184-4c6c-ba52-eabd69526d7b None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:23.338214 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861eb16b-4184-4c6c-ba52-eabd69526d7b None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:23.340728 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 895/1804] 10.222.0.46 () {54 vars in 921 bytes} [Wed Jun 22 10:19:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:19:23.351468 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819f9df-bab9-4605-b95c-24a8a43854f4 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:23.359613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819f9df-bab9-4605-b95c-24a8a43854f4 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:23.359613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819f9df-bab9-4605-b95c-24a8a43854f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:23.380392 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-1819f9df-bab9-4605-b95c-24a8a43854f4 None None] MFA Rules not processed for user `4ed9a00723ab4af2b633ab7614d178a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:19:23.381678 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-1819f9df-bab9-4605-b95c-24a8a43854f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:23.456422 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 910/1805] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Jun 22 10:19:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:19:23.470748 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861eb16b-4184-4c6c-ba52-eabd69526d7b None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:23.473639 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-861eb16b-4184-4c6c-ba52-eabd69526d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:23.493221 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861eb16b-4184-4c6c-ba52-eabd69526d7b None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:23.499238 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4645e60-ae88-465a-86d7-699df50236c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:23.499896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4645e60-ae88-465a-86d7-699df50236c4 service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:23.500178 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4645e60-ae88-465a-86d7-699df50236c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:23.500454 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4645e60-ae88-465a-86d7-699df50236c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:23.513003 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4645e60-ae88-465a-86d7-699df50236c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:23.516632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4645e60-ae88-465a-86d7-699df50236c4 service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:23.532001 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 896/1806] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:19:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:19:30.580493 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf45b1c-a85c-4696-aff6-1d30f4692ebe None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:30.581686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf45b1c-a85c-4696-aff6-1d30f4692ebe None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:30.581971 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf45b1c-a85c-4696-aff6-1d30f4692ebe None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:30.583436 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 911/1807] 10.222.0.46 () {54 vars in 921 bytes} [Wed Jun 22 10:19:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:19:30.602734 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b77f53-69cd-430a-abb6-5b44452f2694 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:30.604520 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b77f53-69cd-430a-abb6-5b44452f2694 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:30.605096 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b77f53-69cd-430a-abb6-5b44452f2694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:30.648318 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-57b77f53-69cd-430a-abb6-5b44452f2694 None None] MFA Rules not processed for user `4ed9a00723ab4af2b633ab7614d178a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:19:30.649854 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-57b77f53-69cd-430a-abb6-5b44452f2694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:30.665745 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 897/1808] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Jun 22 10:19:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:19:30.677868 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf45b1c-a85c-4696-aff6-1d30f4692ebe None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:30.704359 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf45b1c-a85c-4696-aff6-1d30f4692ebe None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:30.711790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d030b-d275-4eee-9d96-d25d9e3c8e84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:30.712768 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d030b-d275-4eee-9d96-d25d9e3c8e84 service nova] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:30.713437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d030b-d275-4eee-9d96-d25d9e3c8e84 service nova] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:30.713889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d030b-d275-4eee-9d96-d25d9e3c8e84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:30.733818 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d030b-d275-4eee-9d96-d25d9e3c8e84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:30.735806 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d030b-d275-4eee-9d96-d25d9e3c8e84 service nova] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:30.748663 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 912/1809] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:19:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:19:40.623521 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=9 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:40.743831 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=37 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:49.898866 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b77f53-69cd-430a-abb6-5b44452f2694 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:49.900335 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-57b77f53-69cd-430a-abb6-5b44452f2694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:49.983291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b77f53-69cd-430a-abb6-5b44452f2694 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:49.988134 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e67984-56bb-4a01-9f06-82a97186d9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:49.989035 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e67984-56bb-4a01-9f06-82a97186d9d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:49.989315 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e67984-56bb-4a01-9f06-82a97186d9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:49.989584 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e67984-56bb-4a01-9f06-82a97186d9d6 admin admin] PATH_INFO: `/v3/users/213e54358e7949fa89f063371b779241` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:49.990763 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e67984-56bb-4a01-9f06-82a97186d9d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=213e54358e7949fa89f063371b779241)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:49.992753 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e67984-56bb-4a01-9f06-82a97186d9d6 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:50.189401 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-00e67984-56bb-4a01-9f06-82a97186d9d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '213e54358e7949fa89f063371b779241'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:50.204664 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-00e67984-56bb-4a01-9f06-82a97186d9d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '213e54358e7949fa89f063371b779241'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:50.270454 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-00e67984-56bb-4a01-9f06-82a97186d9d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '213e54358e7949fa89f063371b779241'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:50.271163 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-00e67984-56bb-4a01-9f06-82a97186d9d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '213e54358e7949fa89f063371b779241'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:50.278871 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-00e67984-56bb-4a01-9f06-82a97186d9d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '213e54358e7949fa89f063371b779241'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:50.285698 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 898/1810] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:19:49 2022] DELETE /identity/v3/users/213e54358e7949fa89f063371b779241 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:19:50.290311 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a4872-27d5-4cec-aa33-1dfbe7588230 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:50.290806 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a4872-27d5-4cec-aa33-1dfbe7588230 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:50.290900 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a4872-27d5-4cec-aa33-1dfbe7588230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:50.309519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-eb0a4872-27d5-4cec-aa33-1dfbe7588230 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:19:50.310766 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-eb0a4872-27d5-4cec-aa33-1dfbe7588230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:50.378467 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 913/1811] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:19:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:19:50.388471 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e67984-56bb-4a01-9f06-82a97186d9d6 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:50.398022 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-00e67984-56bb-4a01-9f06-82a97186d9d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:50.458825 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e67984-56bb-4a01-9f06-82a97186d9d6 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:50.462391 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937d16b-1347-4269-b64e-dcabbd7d9c71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:50.463051 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937d16b-1347-4269-b64e-dcabbd7d9c71 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:50.463448 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937d16b-1347-4269-b64e-dcabbd7d9c71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:50.463735 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937d16b-1347-4269-b64e-dcabbd7d9c71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:50.473986 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937d16b-1347-4269-b64e-dcabbd7d9c71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:50.475638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937d16b-1347-4269-b64e-dcabbd7d9c71 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:50.486024 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 899/1812] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:19:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:19:50.915694 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a4872-27d5-4cec-aa33-1dfbe7588230 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:50.917332 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-eb0a4872-27d5-4cec-aa33-1dfbe7588230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:50.934910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a4872-27d5-4cec-aa33-1dfbe7588230 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:50.957471 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914ed9c-1fe2-4624-8e31-682d419336d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:50.958259 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914ed9c-1fe2-4624-8e31-682d419336d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:50.959217 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914ed9c-1fe2-4624-8e31-682d419336d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:50.959426 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914ed9c-1fe2-4624-8e31-682d419336d3 admin admin] PATH_INFO: `/v3/projects/d40e7108becd47cd9db6211a47d4fe7c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:50.961334 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914ed9c-1fe2-4624-8e31-682d419336d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d40e7108becd47cd9db6211a47d4fe7c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:50.965059 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914ed9c-1fe2-4624-8e31-682d419336d3 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:51.102170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-0914ed9c-1fe2-4624-8e31-682d419336d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd40e7108becd47cd9db6211a47d4fe7c', 'request_id': 'req-0914ed9c-1fe2-4624-8e31-682d419336d3'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:51.108728 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-0914ed9c-1fe2-4624-8e31-682d419336d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd40e7108becd47cd9db6211a47d4fe7c', 'request_id': 'req-0914ed9c-1fe2-4624-8e31-682d419336d3'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:51.213493 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-0914ed9c-1fe2-4624-8e31-682d419336d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd40e7108becd47cd9db6211a47d4fe7c', 'request_id': 'req-0914ed9c-1fe2-4624-8e31-682d419336d3'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:51.225146 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-0914ed9c-1fe2-4624-8e31-682d419336d3 admin admin] The token cache is being invalidate because project d40e7108becd47cd9db6211a47d4fe7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:19:51.225351 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-0914ed9c-1fe2-4624-8e31-682d419336d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:51.225974 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-0914ed9c-1fe2-4624-8e31-682d419336d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:51.227564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 914/1813] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:19:50 2022] DELETE /identity/v3/projects/d40e7108becd47cd9db6211a47d4fe7c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:19:51.231585 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937d16b-1347-4269-b64e-dcabbd7d9c71 service neutron] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:51.242131 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937d16b-1347-4269-b64e-dcabbd7d9c71 service neutron] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:51.261110 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:51.307281 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d3fff-ab60-4689-a31e-0b35297f3823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:51.308142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d3fff-ab60-4689-a31e-0b35297f3823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:51.308452 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d3fff-ab60-4689-a31e-0b35297f3823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:51.308727 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d3fff-ab60-4689-a31e-0b35297f3823 admin admin] PATH_INFO: `/v3/users/3a6be0f8a1c34384a757cab9438eace1` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:51.309996 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d3fff-ab60-4689-a31e-0b35297f3823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a6be0f8a1c34384a757cab9438eace1)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:51.311964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d3fff-ab60-4689-a31e-0b35297f3823 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:51.508784 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f00d3fff-ab60-4689-a31e-0b35297f3823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a6be0f8a1c34384a757cab9438eace1'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:51.521850 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f00d3fff-ab60-4689-a31e-0b35297f3823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a6be0f8a1c34384a757cab9438eace1'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:51.590809 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f00d3fff-ab60-4689-a31e-0b35297f3823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a6be0f8a1c34384a757cab9438eace1'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:51.591457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f00d3fff-ab60-4689-a31e-0b35297f3823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a6be0f8a1c34384a757cab9438eace1'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:51.599463 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f00d3fff-ab60-4689-a31e-0b35297f3823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a6be0f8a1c34384a757cab9438eace1'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:51.605532 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 900/1814] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:19:51 2022] DELETE /identity/v3/users/3a6be0f8a1c34384a757cab9438eace1 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:19:52.016594 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914ed9c-1fe2-4624-8e31-682d419336d3 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:52.018298 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-0914ed9c-1fe2-4624-8e31-682d419336d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:52.037164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914ed9c-1fe2-4624-8e31-682d419336d3 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:52.106468 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531d834-b7fe-45d3-8ef5-9b73e76db2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:52.107428 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531d834-b7fe-45d3-8ef5-9b73e76db2a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:52.107704 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531d834-b7fe-45d3-8ef5-9b73e76db2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:52.107975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531d834-b7fe-45d3-8ef5-9b73e76db2a4 admin admin] PATH_INFO: `/v3/projects/28224c271d114abdac46a6658a4cf266` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:52.109316 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531d834-b7fe-45d3-8ef5-9b73e76db2a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28224c271d114abdac46a6658a4cf266)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:52.111872 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531d834-b7fe-45d3-8ef5-9b73e76db2a4 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:52.203928 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:52.226105 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-7531d834-b7fe-45d3-8ef5-9b73e76db2a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28224c271d114abdac46a6658a4cf266', 'request_id': 'req-7531d834-b7fe-45d3-8ef5-9b73e76db2a4'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:52.232655 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-7531d834-b7fe-45d3-8ef5-9b73e76db2a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28224c271d114abdac46a6658a4cf266', 'request_id': 'req-7531d834-b7fe-45d3-8ef5-9b73e76db2a4'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:52.277604 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-7531d834-b7fe-45d3-8ef5-9b73e76db2a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28224c271d114abdac46a6658a4cf266', 'request_id': 'req-7531d834-b7fe-45d3-8ef5-9b73e76db2a4'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:52.293107 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-7531d834-b7fe-45d3-8ef5-9b73e76db2a4 admin admin] The token cache is being invalidate because project 28224c271d114abdac46a6658a4cf266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:19:52.293445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-7531d834-b7fe-45d3-8ef5-9b73e76db2a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:52.294133 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-7531d834-b7fe-45d3-8ef5-9b73e76db2a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:52.295948 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 915/1815] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:19:52 2022] DELETE /identity/v3/projects/28224c271d114abdac46a6658a4cf266 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:19:52.302024 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513b334-6aac-429c-a546-f873ece6d07e None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:52.302505 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513b334-6aac-429c-a546-f873ece6d07e None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:52.302661 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513b334-6aac-429c-a546-f873ece6d07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:52.323840 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-4513b334-6aac-429c-a546-f873ece6d07e None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:19:52.325097 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-4513b334-6aac-429c-a546-f873ece6d07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:52.402361 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 901/1816] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:19:52.410711 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e7783-e3da-4f9d-88ac-cf5fff53426e None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:52.411077 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e7783-e3da-4f9d-88ac-cf5fff53426e None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:52.411403 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e7783-e3da-4f9d-88ac-cf5fff53426e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:52.429910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-4d8e7783-e3da-4f9d-88ac-cf5fff53426e None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:19:52.431159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-4d8e7783-e3da-4f9d-88ac-cf5fff53426e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:52.439702 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 916/1817] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:19:52.444081 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513b334-6aac-429c-a546-f873ece6d07e None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:52.453702 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513b334-6aac-429c-a546-f873ece6d07e None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:52.458767 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431a505-1182-4cde-af2d-33b0e425eebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:52.459417 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431a505-1182-4cde-af2d-33b0e425eebf admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:52.459699 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431a505-1182-4cde-af2d-33b0e425eebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:52.459974 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431a505-1182-4cde-af2d-33b0e425eebf admin admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:52.460717 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431a505-1182-4cde-af2d-33b0e425eebf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:19:52.461034 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431a505-1182-4cde-af2d-33b0e425eebf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:52.462629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431a505-1182-4cde-af2d-33b0e425eebf admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:52.474069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 902/1818] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:19:52.478290 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e7783-e3da-4f9d-88ac-cf5fff53426e None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:52.487378 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e7783-e3da-4f9d-88ac-cf5fff53426e None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:52.492046 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54290a82-a56a-4e2f-8d43-a676f7c205fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:52.492695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54290a82-a56a-4e2f-8d43-a676f7c205fb admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:52.493015 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54290a82-a56a-4e2f-8d43-a676f7c205fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:52.493297 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54290a82-a56a-4e2f-8d43-a676f7c205fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:52.494019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54290a82-a56a-4e2f-8d43-a676f7c205fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:52.495915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54290a82-a56a-4e2f-8d43-a676f7c205fb admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:52.590282 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 917/1819] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:19:52 2022] POST /identity/v3/projects => generated 363 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:19:52.591415 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431a505-1182-4cde-af2d-33b0e425eebf admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:52.601581 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431a505-1182-4cde-af2d-33b0e425eebf admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:52.628463 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:52.660621 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719c952-c7f8-4bd2-8a6e-284a0e2483eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:52.661359 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719c952-c7f8-4bd2-8a6e-284a0e2483eb admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:52.661667 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719c952-c7f8-4bd2-8a6e-284a0e2483eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:52.661942 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719c952-c7f8-4bd2-8a6e-284a0e2483eb admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:52.662646 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719c952-c7f8-4bd2-8a6e-284a0e2483eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:52.664747 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719c952-c7f8-4bd2-8a6e-284a0e2483eb admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:52.762691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 903/1820] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:19:52 2022] POST /identity/v3/users => generated 282 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:19:52.766675 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54290a82-a56a-4e2f-8d43-a676f7c205fb admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:52.777092 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54290a82-a56a-4e2f-8d43-a676f7c205fb admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:52.782216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc7629-7919-4f8e-9b64-dde57bdcd57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:52.782920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc7629-7919-4f8e-9b64-dde57bdcd57c admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:52.783203 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc7629-7919-4f8e-9b64-dde57bdcd57c admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:52.783479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc7629-7919-4f8e-9b64-dde57bdcd57c admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:52.784208 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc7629-7919-4f8e-9b64-dde57bdcd57c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:52.785831 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc7629-7919-4f8e-9b64-dde57bdcd57c admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:52.796144 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 918/1821] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:19:52.800904 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719c952-c7f8-4bd2-8a6e-284a0e2483eb admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:52.811271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719c952-c7f8-4bd2-8a6e-284a0e2483eb admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:52.816415 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e345371-9637-4312-8f11-7b0dba16ed26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:52.817110 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e345371-9637-4312-8f11-7b0dba16ed26 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:52.817395 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e345371-9637-4312-8f11-7b0dba16ed26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:52.817673 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e345371-9637-4312-8f11-7b0dba16ed26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:52.818411 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e345371-9637-4312-8f11-7b0dba16ed26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:52.820321 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e345371-9637-4312-8f11-7b0dba16ed26 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:52.830809 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 904/1822] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:19:52.835187 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc7629-7919-4f8e-9b64-dde57bdcd57c admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:52.845749 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc7629-7919-4f8e-9b64-dde57bdcd57c admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:52.850415 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b4d43-bb4d-4b3d-be1d-75f6df6d0d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:52.851306 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b4d43-bb4d-4b3d-be1d-75f6df6d0d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:52.851592 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b4d43-bb4d-4b3d-be1d-75f6df6d0d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:52.851874 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b4d43-bb4d-4b3d-be1d-75f6df6d0d70 admin admin] PATH_INFO: `/v3/projects/30034feaea6a4dd08904f67a0cee70d4/users/8b6da39b01404ea0a4971cc39446d8c0/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:52.868100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b4d43-bb4d-4b3d-be1d-75f6df6d0d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30034feaea6a4dd08904f67a0cee70d4, user_id=8b6da39b01404ea0a4971cc39446d8c0, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:52.870780 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b4d43-bb4d-4b3d-be1d-75f6df6d0d70 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:52.985488 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 919/1823] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:19:52 2022] PUT /identity/v3/projects/30034feaea6a4dd08904f67a0cee70d4/users/8b6da39b01404ea0a4971cc39446d8c0/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:19:52.996640 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568f4fc-73f2-4ab9-aefb-a1a7b5419d12 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:52.996972 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568f4fc-73f2-4ab9-aefb-a1a7b5419d12 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:52.997249 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568f4fc-73f2-4ab9-aefb-a1a7b5419d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:53.023871 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-a568f4fc-73f2-4ab9-aefb-a1a7b5419d12 None None] MFA Rules not processed for user `8b6da39b01404ea0a4971cc39446d8c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:19:53.025100 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-a568f4fc-73f2-4ab9-aefb-a1a7b5419d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:53.087892 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 905/1824] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:19:52 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:19:53.092567 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b4d43-bb4d-4b3d-be1d-75f6df6d0d70 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:53.168670 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b4d43-bb4d-4b3d-be1d-75f6df6d0d70 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:53.174449 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac117bb-3cc7-46dc-b268-a5c81c732eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:53.174988 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac117bb-3cc7-46dc-b268-a5c81c732eff admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:53.175933 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac117bb-3cc7-46dc-b268-a5c81c732eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:53.175933 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac117bb-3cc7-46dc-b268-a5c81c732eff admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:53.176329 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac117bb-3cc7-46dc-b268-a5c81c732eff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:53.178349 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac117bb-3cc7-46dc-b268-a5c81c732eff admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:53.280811 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 920/1825] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:19:53 2022] POST /identity/v3/projects => generated 365 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:19:53.282532 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568f4fc-73f2-4ab9-aefb-a1a7b5419d12 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:53.293745 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568f4fc-73f2-4ab9-aefb-a1a7b5419d12 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:53.351534 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866eb486-b6da-4c94-a21e-b1ca840827aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:53.352165 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866eb486-b6da-4c94-a21e-b1ca840827aa admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:53.352398 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866eb486-b6da-4c94-a21e-b1ca840827aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:53.352674 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866eb486-b6da-4c94-a21e-b1ca840827aa admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:53.353424 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866eb486-b6da-4c94-a21e-b1ca840827aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:53.355380 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866eb486-b6da-4c94-a21e-b1ca840827aa admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:53.436573 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 906/1826] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:19:53 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:19:53.437757 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac117bb-3cc7-46dc-b268-a5c81c732eff admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:53.449158 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac117bb-3cc7-46dc-b268-a5c81c732eff admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:53.454763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0789d2f-1a3a-481e-9883-09f0e1a95925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:53.455435 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0789d2f-1a3a-481e-9883-09f0e1a95925 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:53.462769 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0789d2f-1a3a-481e-9883-09f0e1a95925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:53.462769 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0789d2f-1a3a-481e-9883-09f0e1a95925 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:53.462769 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0789d2f-1a3a-481e-9883-09f0e1a95925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:53.462769 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0789d2f-1a3a-481e-9883-09f0e1a95925 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:53.470590 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 921/1827] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:19:53.474964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866eb486-b6da-4c94-a21e-b1ca840827aa admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:53.485093 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866eb486-b6da-4c94-a21e-b1ca840827aa admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:53.489779 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977c28b-06ca-4f60-ae95-d94267f1a8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:53.490674 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977c28b-06ca-4f60-ae95-d94267f1a8e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:53.490957 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977c28b-06ca-4f60-ae95-d94267f1a8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:53.491234 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977c28b-06ca-4f60-ae95-d94267f1a8e0 admin admin] PATH_INFO: `/v3/projects/3c2559a248c4475880332a07511e0d25/users/5681642e0f674a9696a0f6ae5b6da080/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:53.506676 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977c28b-06ca-4f60-ae95-d94267f1a8e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c2559a248c4475880332a07511e0d25, user_id=5681642e0f674a9696a0f6ae5b6da080, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:53.509443 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977c28b-06ca-4f60-ae95-d94267f1a8e0 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:53.580801 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 907/1828] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:19:53 2022] PUT /identity/v3/projects/3c2559a248c4475880332a07511e0d25/users/5681642e0f674a9696a0f6ae5b6da080/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:19:53.584360 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0789d2f-1a3a-481e-9883-09f0e1a95925 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:53.595040 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0789d2f-1a3a-481e-9883-09f0e1a95925 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:53.615728 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:53.655158 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eaadf3-e914-408e-ac4f-282fe18c0005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:53.655845 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eaadf3-e914-408e-ac4f-282fe18c0005 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:53.656120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eaadf3-e914-408e-ac4f-282fe18c0005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:53.656402 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eaadf3-e914-408e-ac4f-282fe18c0005 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:53.657840 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eaadf3-e914-408e-ac4f-282fe18c0005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:53.659438 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eaadf3-e914-408e-ac4f-282fe18c0005 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:53.669759 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 922/1829] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:19:53.673856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977c28b-06ca-4f60-ae95-d94267f1a8e0 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:53.679370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:53.685011 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977c28b-06ca-4f60-ae95-d94267f1a8e0 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:53.689903 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12060e3-68d8-4bd1-b4f7-20d3d632b280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:53.690794 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12060e3-68d8-4bd1-b4f7-20d3d632b280 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:53.691083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12060e3-68d8-4bd1-b4f7-20d3d632b280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:53.691391 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12060e3-68d8-4bd1-b4f7-20d3d632b280 admin admin] PATH_INFO: `/v3/projects/3c2559a248c4475880332a07511e0d25/users/5681642e0f674a9696a0f6ae5b6da080/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:53.693412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12060e3-68d8-4bd1-b4f7-20d3d632b280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c2559a248c4475880332a07511e0d25, user_id=5681642e0f674a9696a0f6ae5b6da080, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:53.696111 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12060e3-68d8-4bd1-b4f7-20d3d632b280 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:53.707525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 908/1830] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:19:53 2022] PUT /identity/v3/projects/3c2559a248c4475880332a07511e0d25/users/5681642e0f674a9696a0f6ae5b6da080/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:19:53.717843 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b311a-2afa-448d-906d-f2bdff669230 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:53.718135 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b311a-2afa-448d-906d-f2bdff669230 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:53.718419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b311a-2afa-448d-906d-f2bdff669230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:53.746144 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-aa7b311a-2afa-448d-906d-f2bdff669230 None None] MFA Rules not processed for user `5681642e0f674a9696a0f6ae5b6da080`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:19:53.747362 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-aa7b311a-2afa-448d-906d-f2bdff669230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:53.819335 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 923/1831] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:19:53 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:19:53.830921 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12060e3-68d8-4bd1-b4f7-20d3d632b280 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:53.832666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-c12060e3-68d8-4bd1-b4f7-20d3d632b280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:53.893371 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12060e3-68d8-4bd1-b4f7-20d3d632b280 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:53.897780 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f24d7c-0f76-4bc4-b4fd-077a637f2f4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:53.898433 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f24d7c-0f76-4bc4-b4fd-077a637f2f4c service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:53.898724 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f24d7c-0f76-4bc4-b4fd-077a637f2f4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:53.898999 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f24d7c-0f76-4bc4-b4fd-077a637f2f4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:53.908525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f24d7c-0f76-4bc4-b4fd-077a637f2f4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:53.910001 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f24d7c-0f76-4bc4-b4fd-077a637f2f4c service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:53.919566 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 909/1832] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:19:53 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:19:54.117765 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b311a-2afa-448d-906d-f2bdff669230 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:54.127577 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b311a-2afa-448d-906d-f2bdff669230 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:54.131174 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f476ab-57e2-4f7f-9f4b-c4b19eee9f15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:54.131755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f476ab-57e2-4f7f-9f4b-c4b19eee9f15 service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:54.132032 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f476ab-57e2-4f7f-9f4b-c4b19eee9f15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:54.132306 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f476ab-57e2-4f7f-9f4b-c4b19eee9f15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:54.190621 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f476ab-57e2-4f7f-9f4b-c4b19eee9f15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:54.191490 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f476ab-57e2-4f7f-9f4b-c4b19eee9f15 service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:54.200509 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 924/1833] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:19:54 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:19:56.090803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f24d7c-0f76-4bc4-b4fd-077a637f2f4c service cinder] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:56.092478 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-55f24d7c-0f76-4bc4-b4fd-077a637f2f4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:56.188752 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f24d7c-0f76-4bc4-b4fd-077a637f2f4c service cinder] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:56.193819 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fecfc2-94d8-453c-9ee6-4a539d0476b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:56.194794 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fecfc2-94d8-453c-9ee6-4a539d0476b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:56.195148 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fecfc2-94d8-453c-9ee6-4a539d0476b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:56.195496 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fecfc2-94d8-453c-9ee6-4a539d0476b7 admin admin] PATH_INFO: `/v3/users/baf08d2a0f054436baf20a2245d67e33` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:56.196801 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fecfc2-94d8-453c-9ee6-4a539d0476b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baf08d2a0f054436baf20a2245d67e33)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:56.199548 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fecfc2-94d8-453c-9ee6-4a539d0476b7 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:56.437184 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f9fecfc2-94d8-453c-9ee6-4a539d0476b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baf08d2a0f054436baf20a2245d67e33'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:56.450884 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f9fecfc2-94d8-453c-9ee6-4a539d0476b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baf08d2a0f054436baf20a2245d67e33'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:56.522167 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f9fecfc2-94d8-453c-9ee6-4a539d0476b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baf08d2a0f054436baf20a2245d67e33'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:56.522840 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f9fecfc2-94d8-453c-9ee6-4a539d0476b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baf08d2a0f054436baf20a2245d67e33'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:56.533843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f9fecfc2-94d8-453c-9ee6-4a539d0476b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baf08d2a0f054436baf20a2245d67e33'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:56.541299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 910/1834] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:19:56 2022] DELETE /identity/v3/users/baf08d2a0f054436baf20a2245d67e33 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:19:56.546782 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47615ae-b264-42b9-9ec2-a0f79487ddf6 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:56.548678 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47615ae-b264-42b9-9ec2-a0f79487ddf6 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:56.549308 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47615ae-b264-42b9-9ec2-a0f79487ddf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:56.570133 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-b47615ae-b264-42b9-9ec2-a0f79487ddf6 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:19:56.572088 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-b47615ae-b264-42b9-9ec2-a0f79487ddf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:56.625179 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:56.647481 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 925/1835] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:19:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:19:56.657032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fecfc2-94d8-453c-9ee6-4a539d0476b7 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:56.658458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-f9fecfc2-94d8-453c-9ee6-4a539d0476b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:56.673629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:56.724769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fecfc2-94d8-453c-9ee6-4a539d0476b7 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:56.728556 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861e5ae-0f72-4438-8050-85a0b8ae2de9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:56.729923 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861e5ae-0f72-4438-8050-85a0b8ae2de9 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:56.729923 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861e5ae-0f72-4438-8050-85a0b8ae2de9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:56.729923 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861e5ae-0f72-4438-8050-85a0b8ae2de9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:56.742383 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861e5ae-0f72-4438-8050-85a0b8ae2de9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:56.743840 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861e5ae-0f72-4438-8050-85a0b8ae2de9 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:56.754632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 911/1836] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:19:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:19:57.228075 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47615ae-b264-42b9-9ec2-a0f79487ddf6 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:57.229326 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-b47615ae-b264-42b9-9ec2-a0f79487ddf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:57.241984 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47615ae-b264-42b9-9ec2-a0f79487ddf6 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:57.247096 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6a680-8728-49b8-ad43-263bcb445cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:57.248150 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6a680-8728-49b8-ad43-263bcb445cb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:57.248580 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6a680-8728-49b8-ad43-263bcb445cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:57.249068 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6a680-8728-49b8-ad43-263bcb445cb1 admin admin] PATH_INFO: `/v3/projects/96e3d21e2fc04db893767a724026859b` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:57.251041 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6a680-8728-49b8-ad43-263bcb445cb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96e3d21e2fc04db893767a724026859b)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:57.253175 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6a680-8728-49b8-ad43-263bcb445cb1 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:57.414626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b7d6a680-8728-49b8-ad43-263bcb445cb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96e3d21e2fc04db893767a724026859b', 'request_id': 'req-b7d6a680-8728-49b8-ad43-263bcb445cb1'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:57.420557 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b7d6a680-8728-49b8-ad43-263bcb445cb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96e3d21e2fc04db893767a724026859b', 'request_id': 'req-b7d6a680-8728-49b8-ad43-263bcb445cb1'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:57.539160 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b7d6a680-8728-49b8-ad43-263bcb445cb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96e3d21e2fc04db893767a724026859b', 'request_id': 'req-b7d6a680-8728-49b8-ad43-263bcb445cb1'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:57.560877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b7d6a680-8728-49b8-ad43-263bcb445cb1 admin admin] The token cache is being invalidate because project 96e3d21e2fc04db893767a724026859b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:19:57.561648 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b7d6a680-8728-49b8-ad43-263bcb445cb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:57.561969 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b7d6a680-8728-49b8-ad43-263bcb445cb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:57.563690 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 926/1837] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:19:57 2022] DELETE /identity/v3/projects/96e3d21e2fc04db893767a724026859b => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:19:57.567703 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861e5ae-0f72-4438-8050-85a0b8ae2de9 service neutron] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:57.577564 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861e5ae-0f72-4438-8050-85a0b8ae2de9 service neutron] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:57.671171 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568bc861-1e22-477c-93d3-9f0e8f8fb131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:57.673657 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568bc861-1e22-477c-93d3-9f0e8f8fb131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:57.674144 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568bc861-1e22-477c-93d3-9f0e8f8fb131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:57.674817 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568bc861-1e22-477c-93d3-9f0e8f8fb131 admin admin] PATH_INFO: `/v3/users/977e06e135a64a9d9d234ca4b502ed07` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:57.676215 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568bc861-1e22-477c-93d3-9f0e8f8fb131 admin admin] RBAC: Authorizing `identity:delete_user(user_id=977e06e135a64a9d9d234ca4b502ed07)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:57.678300 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568bc861-1e22-477c-93d3-9f0e8f8fb131 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:57.923919 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6a680-8728-49b8-ad43-263bcb445cb1 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:57.925855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-b7d6a680-8728-49b8-ad43-263bcb445cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:57.941440 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6a680-8728-49b8-ad43-263bcb445cb1 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:57.947251 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84387ae-28bf-4953-9f2b-b162b2a3e1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:57.948157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84387ae-28bf-4953-9f2b-b162b2a3e1d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:57.948430 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84387ae-28bf-4953-9f2b-b162b2a3e1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:57.948722 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84387ae-28bf-4953-9f2b-b162b2a3e1d2 admin admin] PATH_INFO: `/v3/users/8b6da39b01404ea0a4971cc39446d8c0` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:57.950060 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84387ae-28bf-4953-9f2b-b162b2a3e1d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b6da39b01404ea0a4971cc39446d8c0)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:57.952181 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84387ae-28bf-4953-9f2b-b162b2a3e1d2 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:57.999049 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-568bc861-1e22-477c-93d3-9f0e8f8fb131 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '977e06e135a64a9d9d234ca4b502ed07'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:58.012667 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-568bc861-1e22-477c-93d3-9f0e8f8fb131 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '977e06e135a64a9d9d234ca4b502ed07'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:58.081104 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-568bc861-1e22-477c-93d3-9f0e8f8fb131 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '977e06e135a64a9d9d234ca4b502ed07'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:58.082265 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-568bc861-1e22-477c-93d3-9f0e8f8fb131 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '977e06e135a64a9d9d234ca4b502ed07'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:58.090570 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-568bc861-1e22-477c-93d3-9f0e8f8fb131 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '977e06e135a64a9d9d234ca4b502ed07'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:58.098934 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 912/1838] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:19:57 2022] DELETE /identity/v3/users/977e06e135a64a9d9d234ca4b502ed07 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:19:58.189370 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-c84387ae-28bf-4953-9f2b-b162b2a3e1d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b6da39b01404ea0a4971cc39446d8c0'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:58.190061 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-c84387ae-28bf-4953-9f2b-b162b2a3e1d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b6da39b01404ea0a4971cc39446d8c0'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:58.265166 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-c84387ae-28bf-4953-9f2b-b162b2a3e1d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b6da39b01404ea0a4971cc39446d8c0'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:58.278787 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-c84387ae-28bf-4953-9f2b-b162b2a3e1d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b6da39b01404ea0a4971cc39446d8c0'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:58.286300 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-c84387ae-28bf-4953-9f2b-b162b2a3e1d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b6da39b01404ea0a4971cc39446d8c0'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:58.296509 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 927/1839] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:19:57 2022] DELETE /identity/v3/users/8b6da39b01404ea0a4971cc39446d8c0 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:19:58.298792 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c6345-515e-4b64-b594-4e4e348a1443 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:58.299088 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c6345-515e-4b64-b594-4e4e348a1443 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:58.299373 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c6345-515e-4b64-b594-4e4e348a1443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:58.319327 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-1f8c6345-515e-4b64-b594-4e4e348a1443 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:19:58.323895 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-1f8c6345-515e-4b64-b594-4e4e348a1443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:58.365774 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:58.428747 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 913/1840] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:19:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:19:58.439648 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84387ae-28bf-4953-9f2b-b162b2a3e1d2 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:58.442676 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-c84387ae-28bf-4953-9f2b-b162b2a3e1d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:58.497326 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:58.530622 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84387ae-28bf-4953-9f2b-b162b2a3e1d2 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:58.539912 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540bd72d-6a23-4caf-a785-2796fa3b8c5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:58.545995 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bd72d-6a23-4caf-a785-2796fa3b8c5b service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:58.545995 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bd72d-6a23-4caf-a785-2796fa3b8c5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:58.545995 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bd72d-6a23-4caf-a785-2796fa3b8c5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:58.557081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540bd72d-6a23-4caf-a785-2796fa3b8c5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:58.559071 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540bd72d-6a23-4caf-a785-2796fa3b8c5b service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:58.571533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 928/1841] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:19:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:19:58.762275 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c6345-515e-4b64-b594-4e4e348a1443 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:58.764008 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-1f8c6345-515e-4b64-b594-4e4e348a1443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:58.777847 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c6345-515e-4b64-b594-4e4e348a1443 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:58.785007 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb5223-cb09-4906-924d-c1db595c10d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:58.786493 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb5223-cb09-4906-924d-c1db595c10d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:58.787514 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb5223-cb09-4906-924d-c1db595c10d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:58.788021 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb5223-cb09-4906-924d-c1db595c10d4 admin admin] PATH_INFO: `/v3/projects/8f10bb00903949e5b437e000742e0b02` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:58.814617 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb5223-cb09-4906-924d-c1db595c10d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f10bb00903949e5b437e000742e0b02)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:58.823417 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb5223-cb09-4906-924d-c1db595c10d4 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:59.006575 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e4bb5223-cb09-4906-924d-c1db595c10d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f10bb00903949e5b437e000742e0b02', 'request_id': 'req-e4bb5223-cb09-4906-924d-c1db595c10d4'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:59.013746 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e4bb5223-cb09-4906-924d-c1db595c10d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f10bb00903949e5b437e000742e0b02', 'request_id': 'req-e4bb5223-cb09-4906-924d-c1db595c10d4'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:59.117001 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e4bb5223-cb09-4906-924d-c1db595c10d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f10bb00903949e5b437e000742e0b02', 'request_id': 'req-e4bb5223-cb09-4906-924d-c1db595c10d4'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:59.125744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540bd72d-6a23-4caf-a785-2796fa3b8c5b service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:59.128560 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-540bd72d-6a23-4caf-a785-2796fa3b8c5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:59.132141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e4bb5223-cb09-4906-924d-c1db595c10d4 admin admin] The token cache is being invalidate because project 8f10bb00903949e5b437e000742e0b02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:19:59.132440 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e4bb5223-cb09-4906-924d-c1db595c10d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:59.133157 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e4bb5223-cb09-4906-924d-c1db595c10d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:59.136192 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 914/1842] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:19:58 2022] DELETE /identity/v3/projects/8f10bb00903949e5b437e000742e0b02 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:19:59.143012 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c4ecf-1a4d-4dfa-a1b0-99587b41b8a3 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:59.143012 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c4ecf-1a4d-4dfa-a1b0-99587b41b8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:59.143012 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c4ecf-1a4d-4dfa-a1b0-99587b41b8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:59.164929 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-192c4ecf-1a4d-4dfa-a1b0-99587b41b8a3 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:19:59.167422 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-192c4ecf-1a4d-4dfa-a1b0-99587b41b8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:59.177174 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540bd72d-6a23-4caf-a785-2796fa3b8c5b service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:59.244617 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 915/1843] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:19:59.253391 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2bd28-f135-4534-8d07-79ffe5d0a7a9 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:59.253971 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2bd28-f135-4534-8d07-79ffe5d0a7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:59.254096 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2bd28-f135-4534-8d07-79ffe5d0a7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:59.266078 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05de9a-7aae-4e7b-b47f-98f3f67b06fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:59.267613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05de9a-7aae-4e7b-b47f-98f3f67b06fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:59.267967 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05de9a-7aae-4e7b-b47f-98f3f67b06fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:59.268347 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05de9a-7aae-4e7b-b47f-98f3f67b06fc admin admin] PATH_INFO: `/v3/projects/30034feaea6a4dd08904f67a0cee70d4` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:59.269757 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef05de9a-7aae-4e7b-b47f-98f3f67b06fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=30034feaea6a4dd08904f67a0cee70d4)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:59.271667 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef05de9a-7aae-4e7b-b47f-98f3f67b06fc admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:59.275546 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-cda2bd28-f135-4534-8d07-79ffe5d0a7a9 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:19:59.286524 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-cda2bd28-f135-4534-8d07-79ffe5d0a7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:59.295223 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 916/1844] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:19:59.299465 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2bd28-f135-4534-8d07-79ffe5d0a7a9 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:59.308864 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2bd28-f135-4534-8d07-79ffe5d0a7a9 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:59.314354 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef0620-f025-4eb7-89f3-2a830b896180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:59.321209 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef0620-f025-4eb7-89f3-2a830b896180 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:59.321209 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef0620-f025-4eb7-89f3-2a830b896180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:59.321209 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef0620-f025-4eb7-89f3-2a830b896180 admin admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:59.321209 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef0620-f025-4eb7-89f3-2a830b896180 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:19:59.321209 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef0620-f025-4eb7-89f3-2a830b896180 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:59.321209 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef0620-f025-4eb7-89f3-2a830b896180 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:59.331461 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 917/1845] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:19:59.335932 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef0620-f025-4eb7-89f3-2a830b896180 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:59.349541 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef0620-f025-4eb7-89f3-2a830b896180 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:59.354402 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990cb0a-94c8-495a-b697-c36b234bde23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:59.355097 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990cb0a-94c8-495a-b697-c36b234bde23 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:59.355385 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990cb0a-94c8-495a-b697-c36b234bde23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:59.355661 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990cb0a-94c8-495a-b697-c36b234bde23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:59.356355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990cb0a-94c8-495a-b697-c36b234bde23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:59.358320 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990cb0a-94c8-495a-b697-c36b234bde23 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:59.404061 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-ef05de9a-7aae-4e7b-b47f-98f3f67b06fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30034feaea6a4dd08904f67a0cee70d4', 'request_id': 'req-ef05de9a-7aae-4e7b-b47f-98f3f67b06fc'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:59.409607 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-ef05de9a-7aae-4e7b-b47f-98f3f67b06fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30034feaea6a4dd08904f67a0cee70d4', 'request_id': 'req-ef05de9a-7aae-4e7b-b47f-98f3f67b06fc'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:59.438915 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 918/1846] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:19:59 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:19:59.443210 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990cb0a-94c8-495a-b697-c36b234bde23 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:59.460867 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:59.493728 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-ef05de9a-7aae-4e7b-b47f-98f3f67b06fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30034feaea6a4dd08904f67a0cee70d4', 'request_id': 'req-ef05de9a-7aae-4e7b-b47f-98f3f67b06fc'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:59.505642 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990cb0a-94c8-495a-b697-c36b234bde23 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:59.507719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-ef05de9a-7aae-4e7b-b47f-98f3f67b06fc admin admin] The token cache is being invalidate because project 30034feaea6a4dd08904f67a0cee70d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:19:59.508205 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-ef05de9a-7aae-4e7b-b47f-98f3f67b06fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:59.508982 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-ef05de9a-7aae-4e7b-b47f-98f3f67b06fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:59.510629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2b722-25d0-4022-be88-fc5c0eef6761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:59.511157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 929/1847] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:19:59 2022] DELETE /identity/v3/projects/30034feaea6a4dd08904f67a0cee70d4 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:19:59.511307 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2b722-25d0-4022-be88-fc5c0eef6761 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:59.511645 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2b722-25d0-4022-be88-fc5c0eef6761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:59.511963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2b722-25d0-4022-be88-fc5c0eef6761 admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:59.512948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2b722-25d0-4022-be88-fc5c0eef6761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:59.515665 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05de9a-7aae-4e7b-b47f-98f3f67b06fc admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:59.517385 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-ef05de9a-7aae-4e7b-b47f-98f3f67b06fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:59.518769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2b722-25d0-4022-be88-fc5c0eef6761 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:59.586612 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05de9a-7aae-4e7b-b47f-98f3f67b06fc admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:59.591516 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e20ab-e41a-4aa4-9591-a2e9fb6899f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:59.592395 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e20ab-e41a-4aa4-9591-a2e9fb6899f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:59.592684 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e20ab-e41a-4aa4-9591-a2e9fb6899f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:59.593000 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e20ab-e41a-4aa4-9591-a2e9fb6899f7 admin admin] PATH_INFO: `/v3/users/5681642e0f674a9696a0f6ae5b6da080` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:59.594262 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e20ab-e41a-4aa4-9591-a2e9fb6899f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5681642e0f674a9696a0f6ae5b6da080)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:59.596275 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e20ab-e41a-4aa4-9591-a2e9fb6899f7 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:59.616851 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 919/1848] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:19:59 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:19:59.619971 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2b722-25d0-4022-be88-fc5c0eef6761 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:59.620959 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-1ab2b722-25d0-4022-be88-fc5c0eef6761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:59.633394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2b722-25d0-4022-be88-fc5c0eef6761 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:59.639081 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70337c8-5336-4054-92ea-4ba2ccfb6014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:59.639740 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70337c8-5336-4054-92ea-4ba2ccfb6014 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:59.640020 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70337c8-5336-4054-92ea-4ba2ccfb6014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:59.640294 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70337c8-5336-4054-92ea-4ba2ccfb6014 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:59.641056 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70337c8-5336-4054-92ea-4ba2ccfb6014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:59.642683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70337c8-5336-4054-92ea-4ba2ccfb6014 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:59.652705 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 920/1849] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:19:59.656476 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70337c8-5336-4054-92ea-4ba2ccfb6014 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:59.668014 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70337c8-5336-4054-92ea-4ba2ccfb6014 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:59.673489 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace6349-57f2-4aa2-a144-a0bc5e2cd7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:59.674149 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace6349-57f2-4aa2-a144-a0bc5e2cd7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:59.674563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace6349-57f2-4aa2-a144-a0bc5e2cd7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:59.674873 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace6349-57f2-4aa2-a144-a0bc5e2cd7f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:59.675645 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace6349-57f2-4aa2-a144-a0bc5e2cd7f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:59.677303 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace6349-57f2-4aa2-a144-a0bc5e2cd7f7 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:59.694176 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:59.697617 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 921/1850] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:19:59.698463 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace6349-57f2-4aa2-a144-a0bc5e2cd7f7 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:59.719623 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace6349-57f2-4aa2-a144-a0bc5e2cd7f7 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:59.720756 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7e8cd-6a98-45ac-bce1-8e40fad8c436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:59.721766 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7e8cd-6a98-45ac-bce1-8e40fad8c436 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:59.722078 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7e8cd-6a98-45ac-bce1-8e40fad8c436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:59.722419 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7e8cd-6a98-45ac-bce1-8e40fad8c436 admin admin] PATH_INFO: `/v3/projects/9d7383143f4747b4841fbb209e07074d/users/4880dfa93fb141508b411eb0db59f583/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:59.742085 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7e8cd-6a98-45ac-bce1-8e40fad8c436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d7383143f4747b4841fbb209e07074d, user_id=4880dfa93fb141508b411eb0db59f583, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:59.745159 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7e8cd-6a98-45ac-bce1-8e40fad8c436 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:59.801327 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-4b2e20ab-e41a-4aa4-9591-a2e9fb6899f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5681642e0f674a9696a0f6ae5b6da080'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:59.802713 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-4b2e20ab-e41a-4aa4-9591-a2e9fb6899f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5681642e0f674a9696a0f6ae5b6da080'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:59.816394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 922/1851] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:19:59 2022] PUT /identity/v3/projects/9d7383143f4747b4841fbb209e07074d/users/4880dfa93fb141508b411eb0db59f583/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:19:59.827042 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4388da-a629-45f7-ab6c-ec6eeb1c1ffc None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:59.827337 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4388da-a629-45f7-ab6c-ec6eeb1c1ffc None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:59.827622 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4388da-a629-45f7-ab6c-ec6eeb1c1ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:59.856797 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-9d4388da-a629-45f7-ab6c-ec6eeb1c1ffc None None] MFA Rules not processed for user `4880dfa93fb141508b411eb0db59f583`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:19:59.858800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-9d4388da-a629-45f7-ab6c-ec6eeb1c1ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:59.915499 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-4b2e20ab-e41a-4aa4-9591-a2e9fb6899f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5681642e0f674a9696a0f6ae5b6da080'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:59.933658 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-4b2e20ab-e41a-4aa4-9591-a2e9fb6899f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5681642e0f674a9696a0f6ae5b6da080'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:59.954213 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-4b2e20ab-e41a-4aa4-9591-a2e9fb6899f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5681642e0f674a9696a0f6ae5b6da080'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:59.965164 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 923/1852] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:19:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:19:59.965446 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 930/1853] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:19:59 2022] DELETE /identity/v3/users/5681642e0f674a9696a0f6ae5b6da080 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:19:59.965534 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4388da-a629-45f7-ab6c-ec6eeb1c1ffc None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:59.965534 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-9d4388da-a629-45f7-ab6c-ec6eeb1c1ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:59.972570 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e20ab-e41a-4aa4-9591-a2e9fb6899f7 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:59.975966 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-4b2e20ab-e41a-4aa4-9591-a2e9fb6899f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:00.055243 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4388da-a629-45f7-ab6c-ec6eeb1c1ffc None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:00.055632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e20ab-e41a-4aa4-9591-a2e9fb6899f7 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:00.068556 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b66d2-e370-451a-9ac7-47c80784c139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:00.068889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e4891-e114-465e-be71-fc8c1e1c8d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:00.068889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e4891-e114-465e-be71-fc8c1e1c8d16 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:00.068889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e4891-e114-465e-be71-fc8c1e1c8d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:00.068889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e4891-e114-465e-be71-fc8c1e1c8d16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:00.069245 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e4891-e114-465e-be71-fc8c1e1c8d16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:00.069336 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b66d2-e370-451a-9ac7-47c80784c139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:00.069336 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b66d2-e370-451a-9ac7-47c80784c139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:00.069336 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b66d2-e370-451a-9ac7-47c80784c139 admin admin] PATH_INFO: `/v3/users/b1fa4c7767d1429185a7e50370bb540b` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:00.069573 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e4891-e114-465e-be71-fc8c1e1c8d16 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:00.069669 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b66d2-e370-451a-9ac7-47c80784c139 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1fa4c7767d1429185a7e50370bb540b)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:00.071195 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b66d2-e370-451a-9ac7-47c80784c139 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:00.193392 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 931/1854] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:19:59 2022] POST /identity/v3/projects => generated 381 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:00.197385 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e4891-e114-465e-be71-fc8c1e1c8d16 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:00.263803 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e4891-e114-465e-be71-fc8c1e1c8d16 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:00.269248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca31fa-8d42-4260-b89c-eab8f5b3dc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:00.270100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca31fa-8d42-4260-b89c-eab8f5b3dc84 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:00.270389 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca31fa-8d42-4260-b89c-eab8f5b3dc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:00.270667 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca31fa-8d42-4260-b89c-eab8f5b3dc84 admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:00.271404 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca31fa-8d42-4260-b89c-eab8f5b3dc84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:00.273353 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca31fa-8d42-4260-b89c-eab8f5b3dc84 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:00.292378 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-ab7b66d2-e370-451a-9ac7-47c80784c139 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1fa4c7767d1429185a7e50370bb540b'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:00.304310 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-ab7b66d2-e370-451a-9ac7-47c80784c139 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1fa4c7767d1429185a7e50370bb540b'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:00.414710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 932/1855] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:00 2022] POST /identity/v3/users => generated 297 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:20:00.418939 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca31fa-8d42-4260-b89c-eab8f5b3dc84 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:00.428630 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca31fa-8d42-4260-b89c-eab8f5b3dc84 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:00.434579 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d40db5-b5f6-45c9-a520-f5e56e93ffa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:00.435281 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d40db5-b5f6-45c9-a520-f5e56e93ffa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:00.435932 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d40db5-b5f6-45c9-a520-f5e56e93ffa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:00.436219 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d40db5-b5f6-45c9-a520-f5e56e93ffa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:00.437174 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d40db5-b5f6-45c9-a520-f5e56e93ffa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:00.438793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d40db5-b5f6-45c9-a520-f5e56e93ffa4 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:00.439324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:00.447125 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-ab7b66d2-e370-451a-9ac7-47c80784c139 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1fa4c7767d1429185a7e50370bb540b'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:00.449443 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-ab7b66d2-e370-451a-9ac7-47c80784c139 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1fa4c7767d1429185a7e50370bb540b'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:00.455563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 933/1856] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:20:00.456370 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d40db5-b5f6-45c9-a520-f5e56e93ffa4 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:00.459113 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-ab7b66d2-e370-451a-9ac7-47c80784c139 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1fa4c7767d1429185a7e50370bb540b'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:00.459758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-48d40db5-b5f6-45c9-a520-f5e56e93ffa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:00.466834 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 924/1857] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:19:59 2022] DELETE /identity/v3/users/b1fa4c7767d1429185a7e50370bb540b => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:00.467201 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b66d2-e370-451a-9ac7-47c80784c139 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:00.468669 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-ab7b66d2-e370-451a-9ac7-47c80784c139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:00.477642 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d40db5-b5f6-45c9-a520-f5e56e93ffa4 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:00.536093 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd62da0-4bc4-4ee6-9150-3cde298788e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:00.536364 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b66d2-e370-451a-9ac7-47c80784c139 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:00.537005 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd62da0-4bc4-4ee6-9150-3cde298788e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:00.537295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd62da0-4bc4-4ee6-9150-3cde298788e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:00.537625 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd62da0-4bc4-4ee6-9150-3cde298788e3 admin admin] PATH_INFO: `/v3/projects/3c2559a248c4475880332a07511e0d25` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:00.538856 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd62da0-4bc4-4ee6-9150-3cde298788e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c2559a248c4475880332a07511e0d25)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:00.540767 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd62da0-4bc4-4ee6-9150-3cde298788e3 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:00.542293 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b025fc9-279b-461b-ac33-49e3448a54ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:00.542293 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b025fc9-279b-461b-ac33-49e3448a54ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:00.542648 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b025fc9-279b-461b-ac33-49e3448a54ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:00.542931 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b025fc9-279b-461b-ac33-49e3448a54ac admin admin] PATH_INFO: `/v3/projects/f26c74360f954a35a1fb4e652e8748e7/users/487f42be30084b8fa52e239fe669c02e/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:00.557880 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b025fc9-279b-461b-ac33-49e3448a54ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=f26c74360f954a35a1fb4e652e8748e7, user_id=487f42be30084b8fa52e239fe669c02e, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:00.560689 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b025fc9-279b-461b-ac33-49e3448a54ac admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:00.649082 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 925/1858] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:00 2022] PUT /identity/v3/projects/f26c74360f954a35a1fb4e652e8748e7/users/487f42be30084b8fa52e239fe669c02e/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:00.650381 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ab159-79d9-45a2-984e-4f09d2da57ae None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:00.650665 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ab159-79d9-45a2-984e-4f09d2da57ae None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:00.650937 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ab159-79d9-45a2-984e-4f09d2da57ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:00.668853 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-464ab159-79d9-45a2-984e-4f09d2da57ae None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:00.669987 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-464ab159-79d9-45a2-984e-4f09d2da57ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:00.685350 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9dd62da0-4bc4-4ee6-9150-3cde298788e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c2559a248c4475880332a07511e0d25', 'request_id': 'req-9dd62da0-4bc4-4ee6-9150-3cde298788e3'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:00.691622 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9dd62da0-4bc4-4ee6-9150-3cde298788e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c2559a248c4475880332a07511e0d25', 'request_id': 'req-9dd62da0-4bc4-4ee6-9150-3cde298788e3'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:00.722468 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=86,keystone:DELETE=9,keystone:INSERT=5 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:00.730763 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 926/1859] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:00.731754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ab159-79d9-45a2-984e-4f09d2da57ae None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:00.741684 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ab159-79d9-45a2-984e-4f09d2da57ae None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:00.774111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9dd62da0-4bc4-4ee6-9150-3cde298788e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c2559a248c4475880332a07511e0d25', 'request_id': 'req-9dd62da0-4bc4-4ee6-9150-3cde298788e3'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:00.788330 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9dd62da0-4bc4-4ee6-9150-3cde298788e3 admin admin] The token cache is being invalidate because project 3c2559a248c4475880332a07511e0d25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:20:00.788634 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9dd62da0-4bc4-4ee6-9150-3cde298788e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:00.789352 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9dd62da0-4bc4-4ee6-9150-3cde298788e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:00.790902 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 934/1860] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:20:00 2022] DELETE /identity/v3/projects/3c2559a248c4475880332a07511e0d25 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:00.791671 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd62da0-4bc4-4ee6-9150-3cde298788e3 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:00.793000 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-9dd62da0-4bc4-4ee6-9150-3cde298788e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:00.803325 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19316845-7b33-4b86-ae9c-45580ef721ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:00.804024 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19316845-7b33-4b86-ae9c-45580ef721ad admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:00.804024 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19316845-7b33-4b86-ae9c-45580ef721ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:00.804275 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19316845-7b33-4b86-ae9c-45580ef721ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:00.805019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19316845-7b33-4b86-ae9c-45580ef721ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:00.806612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19316845-7b33-4b86-ae9c-45580ef721ad admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:00.818951 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 927/1861] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:00.818951 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57b800-6ca4-4ec3-8052-667465a45e95 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:00.824673 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57b800-6ca4-4ec3-8052-667465a45e95 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:00.824673 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57b800-6ca4-4ec3-8052-667465a45e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:00.838052 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-1b57b800-6ca4-4ec3-8052-667465a45e95 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:00.839274 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-1b57b800-6ca4-4ec3-8052-667465a45e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:00.848052 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 928/1862] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:00.848871 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57b800-6ca4-4ec3-8052-667465a45e95 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:00.850314 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-1b57b800-6ca4-4ec3-8052-667465a45e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:00.850938 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd62da0-4bc4-4ee6-9150-3cde298788e3 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:00.854783 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d41951-a59a-4849-9b81-25678614a6e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:00.855444 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d41951-a59a-4849-9b81-25678614a6e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:00.855756 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d41951-a59a-4849-9b81-25678614a6e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:00.856131 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d41951-a59a-4849-9b81-25678614a6e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:00.857955 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-74d41951-a59a-4849-9b81-25678614a6e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:00.862647 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57b800-6ca4-4ec3-8052-667465a45e95 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:00.867648 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69cb77e-fae6-48a5-9b62-9ed8e38c4ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:00.868783 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cb77e-fae6-48a5-9b62-9ed8e38c4ace admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:00.869113 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cb77e-fae6-48a5-9b62-9ed8e38c4ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:00.869397 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cb77e-fae6-48a5-9b62-9ed8e38c4ace admin admin] PATH_INFO: `/v3/projects/f26c74360f954a35a1fb4e652e8748e7/users/487f42be30084b8fa52e239fe669c02e/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:00.870386 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d41951-a59a-4849-9b81-25678614a6e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:00.871544 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69cb77e-fae6-48a5-9b62-9ed8e38c4ace admin admin] RBAC: Authorizing `identity:create_grant(project_id=f26c74360f954a35a1fb4e652e8748e7, user_id=487f42be30084b8fa52e239fe669c02e, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:00.871811 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d41951-a59a-4849-9b81-25678614a6e8 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:00.874324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69cb77e-fae6-48a5-9b62-9ed8e38c4ace admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:00.882887 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 935/1863] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:00.885453 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0759b7f-40ea-4f48-a0ef-4f608f14c7c8 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:00.885453 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0759b7f-40ea-4f48-a0ef-4f608f14c7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:00.885453 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0759b7f-40ea-4f48-a0ef-4f608f14c7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:00.886737 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 929/1864] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:00 2022] PUT /identity/v3/projects/f26c74360f954a35a1fb4e652e8748e7/users/487f42be30084b8fa52e239fe669c02e/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:00.899011 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1e1f4-1bee-491b-80be-93e94d806d08 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:00.899443 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1e1f4-1bee-491b-80be-93e94d806d08 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:00.899902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1e1f4-1bee-491b-80be-93e94d806d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:00.906569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-b0759b7f-40ea-4f48-a0ef-4f608f14c7c8 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:00.907814 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-b0759b7f-40ea-4f48-a0ef-4f608f14c7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:00.934009 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-8de1e1f4-1bee-491b-80be-93e94d806d08 None None] MFA Rules not processed for user `487f42be30084b8fa52e239fe669c02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:00.935655 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-8de1e1f4-1bee-491b-80be-93e94d806d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:00.991628 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 936/1865] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:00.993333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0759b7f-40ea-4f48-a0ef-4f608f14c7c8 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:01.005063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0759b7f-40ea-4f48-a0ef-4f608f14c7c8 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:01.010843 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83480fb2-c3b9-4b6a-a683-cdd4f79344a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:01.011733 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83480fb2-c3b9-4b6a-a683-cdd4f79344a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:01.019010 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83480fb2-c3b9-4b6a-a683-cdd4f79344a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:01.019010 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83480fb2-c3b9-4b6a-a683-cdd4f79344a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:01.019010 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83480fb2-c3b9-4b6a-a683-cdd4f79344a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:20:01.019010 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83480fb2-c3b9-4b6a-a683-cdd4f79344a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:01.019010 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83480fb2-c3b9-4b6a-a683-cdd4f79344a7 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:01.032877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 937/1866] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:20:01.035714 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 930/1867] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:20:01.036036 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83480fb2-c3b9-4b6a-a683-cdd4f79344a7 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:01.044289 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:01.049956 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83480fb2-c3b9-4b6a-a683-cdd4f79344a7 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:01.052375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1e1f4-1bee-491b-80be-93e94d806d08 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:01.054059 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-8de1e1f4-1bee-491b-80be-93e94d806d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:01.058085 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f35b5b-4693-4628-be5d-f51215755a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:01.059374 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f35b5b-4693-4628-be5d-f51215755a2c admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:01.059374 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f35b5b-4693-4628-be5d-f51215755a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:01.059723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f35b5b-4693-4628-be5d-f51215755a2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:01.060432 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f35b5b-4693-4628-be5d-f51215755a2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:01.063479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f35b5b-4693-4628-be5d-f51215755a2c admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:01.118492 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1e1f4-1bee-491b-80be-93e94d806d08 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:01.124376 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0f701-17c0-4178-9711-dd2fb99dea6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:01.125105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0f701-17c0-4178-9711-dd2fb99dea6f service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:01.125445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0f701-17c0-4178-9711-dd2fb99dea6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:01.125735 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0f701-17c0-4178-9711-dd2fb99dea6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:01.142665 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0f701-17c0-4178-9711-dd2fb99dea6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:01.145614 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0f701-17c0-4178-9711-dd2fb99dea6f service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:01.160065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 931/1868] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:20:01.232042 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 938/1869] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:01 2022] POST /identity/v3/projects => generated 401 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:01.236300 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0f701-17c0-4178-9711-dd2fb99dea6f service cinder] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:01.265548 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0f701-17c0-4178-9711-dd2fb99dea6f service cinder] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:01.339890 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c800c4a-6652-4104-b718-278a4bbb4024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:01.340996 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c800c4a-6652-4104-b718-278a4bbb4024 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:01.341213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c800c4a-6652-4104-b718-278a4bbb4024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:01.341445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c800c4a-6652-4104-b718-278a4bbb4024 admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:01.346640 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c800c4a-6652-4104-b718-278a4bbb4024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:01.348955 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c800c4a-6652-4104-b718-278a4bbb4024 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:01.382071 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f35b5b-4693-4628-be5d-f51215755a2c admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:01.384101 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-08f35b5b-4693-4628-be5d-f51215755a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:01.404565 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f35b5b-4693-4628-be5d-f51215755a2c admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:01.410601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155154d-2bd6-41cb-9e32-b3f5861c0298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:01.411353 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155154d-2bd6-41cb-9e32-b3f5861c0298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:01.411665 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155154d-2bd6-41cb-9e32-b3f5861c0298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:01.411920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155154d-2bd6-41cb-9e32-b3f5861c0298 admin admin] PATH_INFO: `/v3/projects/097244bbea2d44a8b025c7dd6dfbaeef` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:01.413233 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155154d-2bd6-41cb-9e32-b3f5861c0298 admin admin] RBAC: Authorizing `identity:delete_project(project_id=097244bbea2d44a8b025c7dd6dfbaeef)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:01.415484 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155154d-2bd6-41cb-9e32-b3f5861c0298 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:01.428055 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 932/1870] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:01 2022] POST /identity/v3/users => generated 301 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:01.431962 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c800c4a-6652-4104-b718-278a4bbb4024 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:01.444192 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c800c4a-6652-4104-b718-278a4bbb4024 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:01.449636 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b3e39-0ce6-4b3c-b11f-721053878541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:01.450311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b3e39-0ce6-4b3c-b11f-721053878541 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:01.450598 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b3e39-0ce6-4b3c-b11f-721053878541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:01.450877 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b3e39-0ce6-4b3c-b11f-721053878541 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:01.451742 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b3e39-0ce6-4b3c-b11f-721053878541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:01.453399 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b3e39-0ce6-4b3c-b11f-721053878541 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:01.464136 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 933/1871] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:20:01.472183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b3e39-0ce6-4b3c-b11f-721053878541 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:01.478144 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b3e39-0ce6-4b3c-b11f-721053878541 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:01.483168 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b537c-ce9b-4b0c-94bf-d0c4bc606b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:01.483828 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b537c-ce9b-4b0c-94bf-d0c4bc606b7f admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:01.484142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b537c-ce9b-4b0c-94bf-d0c4bc606b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:01.484421 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b537c-ce9b-4b0c-94bf-d0c4bc606b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:01.485203 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b537c-ce9b-4b0c-94bf-d0c4bc606b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:01.486972 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b537c-ce9b-4b0c-94bf-d0c4bc606b7f admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:01.499141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 934/1872] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:20:01.503720 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b537c-ce9b-4b0c-94bf-d0c4bc606b7f admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:01.513919 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b537c-ce9b-4b0c-94bf-d0c4bc606b7f admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:01.524282 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:01.528724 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-a155154d-2bd6-41cb-9e32-b3f5861c0298 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '097244bbea2d44a8b025c7dd6dfbaeef', 'request_id': 'req-a155154d-2bd6-41cb-9e32-b3f5861c0298'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:01.535507 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-a155154d-2bd6-41cb-9e32-b3f5861c0298 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '097244bbea2d44a8b025c7dd6dfbaeef', 'request_id': 'req-a155154d-2bd6-41cb-9e32-b3f5861c0298'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:01.570542 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597c612-b426-458c-89f7-6aa373fc1b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:01.571430 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597c612-b426-458c-89f7-6aa373fc1b32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:01.571742 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597c612-b426-458c-89f7-6aa373fc1b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:01.572025 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597c612-b426-458c-89f7-6aa373fc1b32 admin admin] PATH_INFO: `/v3/projects/9ee5042427184b9bb14e481653f105dd/users/553d44a3d1f74a94a9133468ff2773a7/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:01.586664 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597c612-b426-458c-89f7-6aa373fc1b32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ee5042427184b9bb14e481653f105dd, user_id=553d44a3d1f74a94a9133468ff2773a7, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:01.589451 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597c612-b426-458c-89f7-6aa373fc1b32 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:01.597087 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-a155154d-2bd6-41cb-9e32-b3f5861c0298 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '097244bbea2d44a8b025c7dd6dfbaeef', 'request_id': 'req-a155154d-2bd6-41cb-9e32-b3f5861c0298'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:01.609600 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-a155154d-2bd6-41cb-9e32-b3f5861c0298 admin admin] The token cache is being invalidate because project 097244bbea2d44a8b025c7dd6dfbaeef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:20:01.609885 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-a155154d-2bd6-41cb-9e32-b3f5861c0298 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:01.611144 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-a155154d-2bd6-41cb-9e32-b3f5861c0298 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:01.612757 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 939/1873] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:20:01 2022] DELETE /identity/v3/projects/097244bbea2d44a8b025c7dd6dfbaeef => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:20:01.616664 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155154d-2bd6-41cb-9e32-b3f5861c0298 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:01.618084 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-a155154d-2bd6-41cb-9e32-b3f5861c0298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:01.630552 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155154d-2bd6-41cb-9e32-b3f5861c0298 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:01.635509 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9be95-2448-4e24-8b94-2322ab365001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:01.636425 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9be95-2448-4e24-8b94-2322ab365001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:01.636745 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9be95-2448-4e24-8b94-2322ab365001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:01.637084 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9be95-2448-4e24-8b94-2322ab365001 admin admin] PATH_INFO: `/v3/users/c6feb4f7a72940ac8d45340412cb4b0f` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:01.638603 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9be95-2448-4e24-8b94-2322ab365001 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6feb4f7a72940ac8d45340412cb4b0f)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:01.640565 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9be95-2448-4e24-8b94-2322ab365001 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:01.672041 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 935/1874] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:01 2022] PUT /identity/v3/projects/9ee5042427184b9bb14e481653f105dd/users/553d44a3d1f74a94a9133468ff2773a7/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:20:01.683376 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61ad5f-e0ce-4990-b05d-4fa1f40fd1f3 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:01.683665 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61ad5f-e0ce-4990-b05d-4fa1f40fd1f3 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:01.683949 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61ad5f-e0ce-4990-b05d-4fa1f40fd1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:01.709899 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-6a61ad5f-e0ce-4990-b05d-4fa1f40fd1f3 None None] MFA Rules not processed for user `553d44a3d1f74a94a9133468ff2773a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:01.711101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-6a61ad5f-e0ce-4990-b05d-4fa1f40fd1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:01.775254 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 936/1875] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:20:01.779915 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61ad5f-e0ce-4990-b05d-4fa1f40fd1f3 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:01.781428 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-6a61ad5f-e0ce-4990-b05d-4fa1f40fd1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:01.833515 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-f0a9be95-2448-4e24-8b94-2322ab365001 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6feb4f7a72940ac8d45340412cb4b0f'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:01.834305 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-f0a9be95-2448-4e24-8b94-2322ab365001 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6feb4f7a72940ac8d45340412cb4b0f'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:01.843123 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:01.847680 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61ad5f-e0ce-4990-b05d-4fa1f40fd1f3 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:01.852421 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73db266-49b1-4f4a-bd6a-d0405e01864b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:01.853108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73db266-49b1-4f4a-bd6a-d0405e01864b admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:01.853426 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73db266-49b1-4f4a-bd6a-d0405e01864b admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:01.853701 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73db266-49b1-4f4a-bd6a-d0405e01864b admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:01.854386 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73db266-49b1-4f4a-bd6a-d0405e01864b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:01.856334 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73db266-49b1-4f4a-bd6a-d0405e01864b admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:01.894328 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-f0a9be95-2448-4e24-8b94-2322ab365001 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6feb4f7a72940ac8d45340412cb4b0f'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:01.906693 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-f0a9be95-2448-4e24-8b94-2322ab365001 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6feb4f7a72940ac8d45340412cb4b0f'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:01.913559 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-f0a9be95-2448-4e24-8b94-2322ab365001 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6feb4f7a72940ac8d45340412cb4b0f'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:01.919888 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 940/1876] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:20:01 2022] DELETE /identity/v3/users/c6feb4f7a72940ac8d45340412cb4b0f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:20:01.982225 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 937/1877] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:01 2022] POST /identity/v3/projects => generated 401 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:20:01.987419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9be95-2448-4e24-8b94-2322ab365001 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:01.989651 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-f0a9be95-2448-4e24-8b94-2322ab365001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:02.060259 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9be95-2448-4e24-8b94-2322ab365001 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:02.124325 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746de767-8204-468d-bbe2-9996f077bd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:02.127693 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746de767-8204-468d-bbe2-9996f077bd53 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:02.127693 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746de767-8204-468d-bbe2-9996f077bd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:02.127693 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746de767-8204-468d-bbe2-9996f077bd53 admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:02.127693 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746de767-8204-468d-bbe2-9996f077bd53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:02.133864 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746de767-8204-468d-bbe2-9996f077bd53 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:02.170203 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73db266-49b1-4f4a-bd6a-d0405e01864b admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:02.172115 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-c73db266-49b1-4f4a-bd6a-d0405e01864b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:02.206941 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 941/1878] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:01 2022] POST /identity/v3/users => generated 307 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:20:02.209787 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746de767-8204-468d-bbe2-9996f077bd53 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:02.222456 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746de767-8204-468d-bbe2-9996f077bd53 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:02.244513 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe93f97-0e53-4e6f-858d-62c21d3860aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:02.245745 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe93f97-0e53-4e6f-858d-62c21d3860aa admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:02.245745 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe93f97-0e53-4e6f-858d-62c21d3860aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:02.245937 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe93f97-0e53-4e6f-858d-62c21d3860aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:02.246618 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe93f97-0e53-4e6f-858d-62c21d3860aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:02.248229 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe93f97-0e53-4e6f-858d-62c21d3860aa admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:02.252793 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73db266-49b1-4f4a-bd6a-d0405e01864b admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:02.258546 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d18f25-1f89-498c-96a7-bc4017b3f896 tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487f42be30084b8fa52e239fe669c02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f26c74360f954a35a1fb4e652e8748e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:02.259319 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d18f25-1f89-498c-96a7-bc4017b3f896 tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:02.259619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d18f25-1f89-498c-96a7-bc4017b3f896 tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:02.259903 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d18f25-1f89-498c-96a7-bc4017b3f896 tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:02.260845 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d18f25-1f89-498c-96a7-bc4017b3f896 tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:20:02.261136 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 942/1879] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:02.265069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d18f25-1f89-498c-96a7-bc4017b3f896 tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:02.265754 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe93f97-0e53-4e6f-858d-62c21d3860aa admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:02.266904 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d18f25-1f89-498c-96a7-bc4017b3f896 tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:02.281189 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 938/1880] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:20:02.285341 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d18f25-1f89-498c-96a7-bc4017b3f896 tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:02.301985 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe93f97-0e53-4e6f-858d-62c21d3860aa admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:02.305759 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=80,keystone:INSERT=3,keystone:DELETE=17 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:02.310612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d18f25-1f89-498c-96a7-bc4017b3f896 tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:02.315537 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d977e-d86b-4904-b079-aa6402d59765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:02.316543 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d977e-d86b-4904-b079-aa6402d59765 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:02.316856 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d977e-d86b-4904-b079-aa6402d59765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:02.317187 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d977e-d86b-4904-b079-aa6402d59765 admin admin] PATH_INFO: `/v3/projects/0b102b82e4b44cc09554659e53fbc0bb/users/e0f197bb8e664802b577b5837dcde546/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:02.317408 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bd8c1-a59f-45f6-a366-a7483301cf25 tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487f42be30084b8fa52e239fe669c02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f26c74360f954a35a1fb4e652e8748e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:02.318250 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bd8c1-a59f-45f6-a366-a7483301cf25 tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:02.318552 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bd8c1-a59f-45f6-a366-a7483301cf25 tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:02.318840 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bd8c1-a59f-45f6-a366-a7483301cf25 tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:02.319609 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4bd8c1-a59f-45f6-a366-a7483301cf25 tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:02.324519 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4bd8c1-a59f-45f6-a366-a7483301cf25 tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:02.335996 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d977e-d86b-4904-b079-aa6402d59765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b102b82e4b44cc09554659e53fbc0bb, user_id=e0f197bb8e664802b577b5837dcde546, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:02.338870 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d977e-d86b-4904-b079-aa6402d59765 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:02.386627 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:02.438179 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 943/1881] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:02 2022] PUT /identity/v3/projects/0b102b82e4b44cc09554659e53fbc0bb/users/e0f197bb8e664802b577b5837dcde546/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:02.441810 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d977e-d86b-4904-b079-aa6402d59765 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:02.443697 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-768d977e-d86b-4904-b079-aa6402d59765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:02.500034 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 939/1882] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:02 2022] POST /identity/v3/projects => generated 354 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:02.501429 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bd8c1-a59f-45f6-a366-a7483301cf25 tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:02.533857 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d977e-d86b-4904-b079-aa6402d59765 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:02.589426 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bd8c1-a59f-45f6-a366-a7483301cf25 tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:02.595865 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285ff52-66c5-4212-bdf7-b9fdfd2e7828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:02.596665 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285ff52-66c5-4212-bdf7-b9fdfd2e7828 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:02.597152 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285ff52-66c5-4212-bdf7-b9fdfd2e7828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:02.597469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285ff52-66c5-4212-bdf7-b9fdfd2e7828 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:02.598385 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285ff52-66c5-4212-bdf7-b9fdfd2e7828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:02.598892 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c538526-9dd7-4018-9dba-854089b1d9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:02.599766 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c538526-9dd7-4018-9dba-854089b1d9f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:02.600020 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285ff52-66c5-4212-bdf7-b9fdfd2e7828 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:02.600131 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c538526-9dd7-4018-9dba-854089b1d9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:02.600320 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c538526-9dd7-4018-9dba-854089b1d9f7 admin admin] PATH_INFO: `/v3/projects/7344ebdd4fd5473eb76e1936b05529ba` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:02.601583 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c538526-9dd7-4018-9dba-854089b1d9f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7344ebdd4fd5473eb76e1936b05529ba)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:02.603482 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c538526-9dd7-4018-9dba-854089b1d9f7 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:02.611043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 940/1883] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:02.611910 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285ff52-66c5-4212-bdf7-b9fdfd2e7828 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:02.688400 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285ff52-66c5-4212-bdf7-b9fdfd2e7828 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:02.690380 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-3c538526-9dd7-4018-9dba-854089b1d9f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7344ebdd4fd5473eb76e1936b05529ba', 'request_id': 'req-3c538526-9dd7-4018-9dba-854089b1d9f7'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:02.696042 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-3c538526-9dd7-4018-9dba-854089b1d9f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7344ebdd4fd5473eb76e1936b05529ba', 'request_id': 'req-3c538526-9dd7-4018-9dba-854089b1d9f7'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:02.746741 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bbfba-e5f2-4440-9ec5-68e670b236ec tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487f42be30084b8fa52e239fe669c02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f26c74360f954a35a1fb4e652e8748e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:02.747335 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bbfba-e5f2-4440-9ec5-68e670b236ec tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:02.747625 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bbfba-e5f2-4440-9ec5-68e670b236ec tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:02.747906 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bbfba-e5f2-4440-9ec5-68e670b236ec tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:02.748633 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13bbfba-e5f2-4440-9ec5-68e670b236ec tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:20:02.748988 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13bbfba-e5f2-4440-9ec5-68e670b236ec tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:02.753210 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13bbfba-e5f2-4440-9ec5-68e670b236ec tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:02.765254 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 941/1884] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:20:02.765254 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bbfba-e5f2-4440-9ec5-68e670b236ec tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:02.766284 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-3c538526-9dd7-4018-9dba-854089b1d9f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7344ebdd4fd5473eb76e1936b05529ba', 'request_id': 'req-3c538526-9dd7-4018-9dba-854089b1d9f7'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:02.777755 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:02.781486 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-3c538526-9dd7-4018-9dba-854089b1d9f7 admin admin] The token cache is being invalidate because project 7344ebdd4fd5473eb76e1936b05529ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:20:02.781932 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-3c538526-9dd7-4018-9dba-854089b1d9f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:02.783172 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-3c538526-9dd7-4018-9dba-854089b1d9f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:02.788485 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 944/1885] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:20:02 2022] DELETE /identity/v3/projects/7344ebdd4fd5473eb76e1936b05529ba => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:20:02.793698 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e28a02-5858-46ac-9043-41766ef17bf8 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:02.793698 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e28a02-5858-46ac-9043-41766ef17bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:02.793698 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e28a02-5858-46ac-9043-41766ef17bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:02.811945 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-a1e28a02-5858-46ac-9043-41766ef17bf8 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:02.816735 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-a1e28a02-5858-46ac-9043-41766ef17bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:02.835842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bbfba-e5f2-4440-9ec5-68e670b236ec tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:02.841103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97412ffd-f6fd-4bcd-b234-dbb682ce61ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:02.841999 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97412ffd-f6fd-4bcd-b234-dbb682ce61ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:02.842286 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97412ffd-f6fd-4bcd-b234-dbb682ce61ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:02.842569 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97412ffd-f6fd-4bcd-b234-dbb682ce61ab admin admin] PATH_INFO: `/v3/projects/0b102b82e4b44cc09554659e53fbc0bb/users/e0f197bb8e664802b577b5837dcde546/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:02.844656 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97412ffd-f6fd-4bcd-b234-dbb682ce61ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b102b82e4b44cc09554659e53fbc0bb, user_id=e0f197bb8e664802b577b5837dcde546, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:02.847912 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97412ffd-f6fd-4bcd-b234-dbb682ce61ab admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:02.864671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 942/1886] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:02 2022] PUT /identity/v3/projects/0b102b82e4b44cc09554659e53fbc0bb/users/e0f197bb8e664802b577b5837dcde546/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:02.864671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97412ffd-f6fd-4bcd-b234-dbb682ce61ab admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:02.864671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-97412ffd-f6fd-4bcd-b234-dbb682ce61ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:02.883394 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:02.885325 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 945/1887] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:20:02.886983 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb0a8b-388d-4627-b225-f804fb381316 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:02.887425 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb0a8b-388d-4627-b225-f804fb381316 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:02.887870 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb0a8b-388d-4627-b225-f804fb381316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:02.914658 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-f9cb0a8b-388d-4627-b225-f804fb381316 None None] MFA Rules not processed for user `e0f197bb8e664802b577b5837dcde546`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:02.915909 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-f9cb0a8b-388d-4627-b225-f804fb381316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:02.929533 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97412ffd-f6fd-4bcd-b234-dbb682ce61ab admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:02.940080 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bab68f-a893-4a71-8864-b20d11077de3 tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '487f42be30084b8fa52e239fe669c02e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f26c74360f954a35a1fb4e652e8748e7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:02.940984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bab68f-a893-4a71-8864-b20d11077de3 tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:02.941274 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bab68f-a893-4a71-8864-b20d11077de3 tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:02.941545 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bab68f-a893-4a71-8864-b20d11077de3 tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] PATH_INFO: `/v3/projects/87611ee8244f4f5682fde7332dd7ca59` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:02.942773 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bab68f-a893-4a71-8864-b20d11077de3 tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] RBAC: Authorizing `identity:delete_project(project_id=87611ee8244f4f5682fde7332dd7ca59)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:02.944650 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bab68f-a893-4a71-8864-b20d11077de3 tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:02.988574 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 946/1888] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:02 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:02.993233 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d92767-7a31-47da-867a-6ee322f4b440 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:02.993528 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d92767-7a31-47da-867a-6ee322f4b440 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:02.993810 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d92767-7a31-47da-867a-6ee322f4b440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:03.012813 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-54d92767-7a31-47da-867a-6ee322f4b440 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:03.014225 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-54d92767-7a31-47da-867a-6ee322f4b440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:03.033311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:03.039447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-90bab68f-a893-4a71-8864-b20d11077de3 tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87611ee8244f4f5682fde7332dd7ca59', 'request_id': 'req-90bab68f-a893-4a71-8864-b20d11077de3'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:03.045607 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-90bab68f-a893-4a71-8864-b20d11077de3 tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87611ee8244f4f5682fde7332dd7ca59', 'request_id': 'req-90bab68f-a893-4a71-8864-b20d11077de3'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:03.073853 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 947/1889] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:03.074872 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d92767-7a31-47da-867a-6ee322f4b440 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:03.077670 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:03.078294 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-54d92767-7a31-47da-867a-6ee322f4b440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:03.094273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-90bab68f-a893-4a71-8864-b20d11077de3 tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87611ee8244f4f5682fde7332dd7ca59', 'request_id': 'req-90bab68f-a893-4a71-8864-b20d11077de3'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:03.105712 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-90bab68f-a893-4a71-8864-b20d11077de3 tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] The token cache is being invalidate because project 87611ee8244f4f5682fde7332dd7ca59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:20:03.106001 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-90bab68f-a893-4a71-8864-b20d11077de3 tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:03.106680 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-90bab68f-a893-4a71-8864-b20d11077de3 tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:03.108372 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 943/1890] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:20:02 2022] DELETE /identity/v3/projects/87611ee8244f4f5682fde7332dd7ca59 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:03.109305 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bab68f-a893-4a71-8864-b20d11077de3 tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:03.113527 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-90bab68f-a893-4a71-8864-b20d11077de3 tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:03.142672 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d92767-7a31-47da-867a-6ee322f4b440 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:03.196925 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e377f8-d2f4-4160-ab0e-c6440a2ddcda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:03.197584 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e377f8-d2f4-4160-ab0e-c6440a2ddcda service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:03.197867 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e377f8-d2f4-4160-ab0e-c6440a2ddcda service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:03.198147 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e377f8-d2f4-4160-ab0e-c6440a2ddcda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:03.198262 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bab68f-a893-4a71-8864-b20d11077de3 tempest-VolumeQuotaClassesTest-1117268546 tempest-VolumeQuotaClassesTest-1117268546-project-admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:03.199951 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-a9e377f8-d2f4-4160-ab0e-c6440a2ddcda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:03.203151 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85444062-c38f-4a1a-8aa4-829bbe5ebb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:03.203813 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85444062-c38f-4a1a-8aa4-829bbe5ebb15 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:03.204098 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85444062-c38f-4a1a-8aa4-829bbe5ebb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:03.204413 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85444062-c38f-4a1a-8aa4-829bbe5ebb15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:03.205749 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85444062-c38f-4a1a-8aa4-829bbe5ebb15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:20:03.206061 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85444062-c38f-4a1a-8aa4-829bbe5ebb15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:03.207674 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85444062-c38f-4a1a-8aa4-829bbe5ebb15 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:03.221939 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 944/1891] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:20:03.226382 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85444062-c38f-4a1a-8aa4-829bbe5ebb15 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:03.237055 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85444062-c38f-4a1a-8aa4-829bbe5ebb15 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:03.242286 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0632943-973b-4d0b-b294-0e4ed8812544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:03.243305 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0632943-973b-4d0b-b294-0e4ed8812544 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:03.243602 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0632943-973b-4d0b-b294-0e4ed8812544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:03.243883 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0632943-973b-4d0b-b294-0e4ed8812544 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:03.244583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0632943-973b-4d0b-b294-0e4ed8812544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:03.246634 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0632943-973b-4d0b-b294-0e4ed8812544 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:03.278596 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e377f8-d2f4-4160-ab0e-c6440a2ddcda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:03.279934 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e377f8-d2f4-4160-ab0e-c6440a2ddcda service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:03.291409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 948/1892] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:03 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:03.358135 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:03.371052 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 945/1893] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:03 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:20:03.372768 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e377f8-d2f4-4160-ab0e-c6440a2ddcda service cinder] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:03.386688 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e377f8-d2f4-4160-ab0e-c6440a2ddcda service cinder] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:03.468765 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0077d-1b9d-4537-878f-638753fa7d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:03.469545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0077d-1b9d-4537-878f-638753fa7d28 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:03.469875 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0077d-1b9d-4537-878f-638753fa7d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:03.470212 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0077d-1b9d-4537-878f-638753fa7d28 admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:03.471428 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0077d-1b9d-4537-878f-638753fa7d28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:03.473371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0077d-1b9d-4537-878f-638753fa7d28 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:03.508437 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0632943-973b-4d0b-b294-0e4ed8812544 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:03.510909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-a0632943-973b-4d0b-b294-0e4ed8812544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:03.522523 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:03.549115 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 949/1894] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:03 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:03.554950 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0077d-1b9d-4537-878f-638753fa7d28 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:03.579200 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0077d-1b9d-4537-878f-638753fa7d28 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:03.586113 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0632943-973b-4d0b-b294-0e4ed8812544 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:03.593124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f51e3-46a0-41cc-b229-c8f6500b2999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:03.594938 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f51e3-46a0-41cc-b229-c8f6500b2999 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:03.594938 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f51e3-46a0-41cc-b229-c8f6500b2999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:03.594938 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f51e3-46a0-41cc-b229-c8f6500b2999 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:03.595952 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f51e3-46a0-41cc-b229-c8f6500b2999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:03.597620 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f51e3-46a0-41cc-b229-c8f6500b2999 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:03.598447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391bb25-f2a7-40b3-81c2-d3ea168890b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:03.599702 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391bb25-f2a7-40b3-81c2-d3ea168890b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:03.600200 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391bb25-f2a7-40b3-81c2-d3ea168890b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:03.600647 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391bb25-f2a7-40b3-81c2-d3ea168890b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:03.602740 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-8391bb25-f2a7-40b3-81c2-d3ea168890b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:03.620912 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 950/1895] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:20:03.630244 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f51e3-46a0-41cc-b229-c8f6500b2999 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:03.640982 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f51e3-46a0-41cc-b229-c8f6500b2999 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:03.647065 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d818c9-39c2-42f3-a5ea-49ffa2bfc977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:03.648220 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d818c9-39c2-42f3-a5ea-49ffa2bfc977 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:03.648703 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d818c9-39c2-42f3-a5ea-49ffa2bfc977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:03.649185 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d818c9-39c2-42f3-a5ea-49ffa2bfc977 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:03.651874 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d818c9-39c2-42f3-a5ea-49ffa2bfc977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:03.653655 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d818c9-39c2-42f3-a5ea-49ffa2bfc977 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:03.678084 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 951/1896] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:03.683943 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391bb25-f2a7-40b3-81c2-d3ea168890b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:03.683943 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391bb25-f2a7-40b3-81c2-d3ea168890b8 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:03.685240 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d818c9-39c2-42f3-a5ea-49ffa2bfc977 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:03.696439 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d818c9-39c2-42f3-a5ea-49ffa2bfc977 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:03.700332 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 946/1897] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:03 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:20:03.712763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1b117-6b33-44f3-9f90-1ee65b8ca145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:03.714082 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1b117-6b33-44f3-9f90-1ee65b8ca145 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:03.714448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1b117-6b33-44f3-9f90-1ee65b8ca145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:03.715228 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1b117-6b33-44f3-9f90-1ee65b8ca145 admin admin] PATH_INFO: `/v3/projects/be1dd89376fa431894c7d4b7f0d4ada3/users/a9cff2bf1d9a4bdfb6176ce84b370800/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:03.733543 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1b117-6b33-44f3-9f90-1ee65b8ca145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be1dd89376fa431894c7d4b7f0d4ada3, user_id=a9cff2bf1d9a4bdfb6176ce84b370800, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:03.737177 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1b117-6b33-44f3-9f90-1ee65b8ca145 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:03.785729 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391bb25-f2a7-40b3-81c2-d3ea168890b8 service cinder] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:03.788540 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-8391bb25-f2a7-40b3-81c2-d3ea168890b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:03.805259 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391bb25-f2a7-40b3-81c2-d3ea168890b8 service cinder] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:03.811312 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6fc03c-7e1d-48b8-8e4b-e4cb5fa1f345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:03.812521 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fc03c-7e1d-48b8-8e4b-e4cb5fa1f345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:03.812984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fc03c-7e1d-48b8-8e4b-e4cb5fa1f345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:03.813357 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fc03c-7e1d-48b8-8e4b-e4cb5fa1f345 admin admin] PATH_INFO: `/v3/users/4880dfa93fb141508b411eb0db59f583` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:03.815219 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6fc03c-7e1d-48b8-8e4b-e4cb5fa1f345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4880dfa93fb141508b411eb0db59f583)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:03.817291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6fc03c-7e1d-48b8-8e4b-e4cb5fa1f345 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:03.836407 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 952/1898] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:03 2022] PUT /identity/v3/projects/be1dd89376fa431894c7d4b7f0d4ada3/users/a9cff2bf1d9a4bdfb6176ce84b370800/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:03.848049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e908be3-9a7e-480c-bd9f-3817a68df821 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:03.848345 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e908be3-9a7e-480c-bd9f-3817a68df821 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:03.848618 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e908be3-9a7e-480c-bd9f-3817a68df821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:03.878360 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-9e908be3-9a7e-480c-bd9f-3817a68df821 None None] MFA Rules not processed for user `a9cff2bf1d9a4bdfb6176ce84b370800`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:03.879670 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-9e908be3-9a7e-480c-bd9f-3817a68df821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:03.935485 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:03.946001 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 953/1899] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:20:03.951452 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e908be3-9a7e-480c-bd9f-3817a68df821 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:04.017499 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e908be3-9a7e-480c-bd9f-3817a68df821 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:04.022541 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93bda1-7da9-4e08-bd08-14459b889178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:04.023213 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93bda1-7da9-4e08-bd08-14459b889178 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:04.023487 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93bda1-7da9-4e08-bd08-14459b889178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:04.023763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93bda1-7da9-4e08-bd08-14459b889178 admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:04.024460 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93bda1-7da9-4e08-bd08-14459b889178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:04.026391 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93bda1-7da9-4e08-bd08-14459b889178 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:04.121113 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-cb6fc03c-7e1d-48b8-8e4b-e4cb5fa1f345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4880dfa93fb141508b411eb0db59f583'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:04.135379 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-cb6fc03c-7e1d-48b8-8e4b-e4cb5fa1f345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4880dfa93fb141508b411eb0db59f583'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:04.138873 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 954/1900] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:03 2022] POST /identity/v3/projects => generated 387 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:20:04.143159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93bda1-7da9-4e08-bd08-14459b889178 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:04.204170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93bda1-7da9-4e08-bd08-14459b889178 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:04.208762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b16ee-b1b7-4f3e-b838-a7e7d5c5cd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:04.209454 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b16ee-b1b7-4f3e-b838-a7e7d5c5cd6d admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:04.209736 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b16ee-b1b7-4f3e-b838-a7e7d5c5cd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:04.210007 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b16ee-b1b7-4f3e-b838-a7e7d5c5cd6d admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:04.210683 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b16ee-b1b7-4f3e-b838-a7e7d5c5cd6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:04.212594 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b16ee-b1b7-4f3e-b838-a7e7d5c5cd6d admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:04.255538 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-cb6fc03c-7e1d-48b8-8e4b-e4cb5fa1f345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4880dfa93fb141508b411eb0db59f583'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:04.256073 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-cb6fc03c-7e1d-48b8-8e4b-e4cb5fa1f345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4880dfa93fb141508b411eb0db59f583'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:04.267366 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-cb6fc03c-7e1d-48b8-8e4b-e4cb5fa1f345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4880dfa93fb141508b411eb0db59f583'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:04.273648 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 947/1901] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:20:03 2022] DELETE /identity/v3/users/4880dfa93fb141508b411eb0db59f583 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:04.284437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 955/1902] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:04 2022] POST /identity/v3/users => generated 300 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:04.288416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25c777-68c5-4e56-be64-6300282bc30f None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:04.289466 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b16ee-b1b7-4f3e-b838-a7e7d5c5cd6d admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:04.290146 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25c777-68c5-4e56-be64-6300282bc30f None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:04.290435 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25c777-68c5-4e56-be64-6300282bc30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:04.291489 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-4d3b16ee-b1b7-4f3e-b838-a7e7d5c5cd6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:04.304170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b16ee-b1b7-4f3e-b838-a7e7d5c5cd6d admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:04.309800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-da25c777-68c5-4e56-be64-6300282bc30f None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:04.310966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-da25c777-68c5-4e56-be64-6300282bc30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:04.341089 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:04.362650 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a35f1-440b-4274-af9f-cc5fb1dc64c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:04.363350 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a35f1-440b-4274-af9f-cc5fb1dc64c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:04.363695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a35f1-440b-4274-af9f-cc5fb1dc64c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:04.363979 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a35f1-440b-4274-af9f-cc5fb1dc64c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:04.364920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a35f1-440b-4274-af9f-cc5fb1dc64c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:04.366491 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a35f1-440b-4274-af9f-cc5fb1dc64c6 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:04.375385 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 948/1903] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:04.377227 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 956/1904] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:04.384055 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25c777-68c5-4e56-be64-6300282bc30f None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:04.393818 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a35f1-440b-4274-af9f-cc5fb1dc64c6 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:04.396001 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-2a5a35f1-440b-4274-af9f-cc5fb1dc64c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:04.398463 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25c777-68c5-4e56-be64-6300282bc30f None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:04.403869 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:04.410408 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0baba-5b08-4ebd-b2b5-872f61fd7385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:04.410408 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0baba-5b08-4ebd-b2b5-872f61fd7385 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:04.410408 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0baba-5b08-4ebd-b2b5-872f61fd7385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:04.410408 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0baba-5b08-4ebd-b2b5-872f61fd7385 admin admin] PATH_INFO: `/v3/projects/ea5a8b18527944edb4e9ad4edcb580ee/users/95e744f4cf0240bf87c70d701ae0ec30/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:04.427234 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0baba-5b08-4ebd-b2b5-872f61fd7385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea5a8b18527944edb4e9ad4edcb580ee, user_id=95e744f4cf0240bf87c70d701ae0ec30, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:04.430059 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0baba-5b08-4ebd-b2b5-872f61fd7385 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:04.461035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a35f1-440b-4274-af9f-cc5fb1dc64c6 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:04.464751 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f112ee-2e4e-41d7-aa15-79e176cd9abc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:04.465445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f112ee-2e4e-41d7-aa15-79e176cd9abc service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:04.465706 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f112ee-2e4e-41d7-aa15-79e176cd9abc service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:04.465981 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f112ee-2e4e-41d7-aa15-79e176cd9abc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:04.475249 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f112ee-2e4e-41d7-aa15-79e176cd9abc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:04.476675 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f112ee-2e4e-41d7-aa15-79e176cd9abc service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:04.486965 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 957/1905] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:20:04.515688 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 949/1906] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:04 2022] PUT /identity/v3/projects/ea5a8b18527944edb4e9ad4edcb580ee/users/95e744f4cf0240bf87c70d701ae0ec30/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:20:04.519835 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f112ee-2e4e-41d7-aa15-79e176cd9abc service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:04.534919 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f112ee-2e4e-41d7-aa15-79e176cd9abc service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:04.686216 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c382a-0265-404f-8fbb-fb284a261c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:04.687008 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c382a-0265-404f-8fbb-fb284a261c33 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:04.687301 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c382a-0265-404f-8fbb-fb284a261c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:04.687586 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c382a-0265-404f-8fbb-fb284a261c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:04.688327 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c382a-0265-404f-8fbb-fb284a261c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:04.691975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c382a-0265-404f-8fbb-fb284a261c33 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:04.720660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 958/1907] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:04.733932 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0baba-5b08-4ebd-b2b5-872f61fd7385 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:04.756512 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0baba-5b08-4ebd-b2b5-872f61fd7385 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:04.788284 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236ffb6-c327-4404-8422-8caa8905e3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:04.789520 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236ffb6-c327-4404-8422-8caa8905e3b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:04.789977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236ffb6-c327-4404-8422-8caa8905e3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:04.790461 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236ffb6-c327-4404-8422-8caa8905e3b2 admin admin] PATH_INFO: `/v3/projects/ea5a8b18527944edb4e9ad4edcb580ee/users/95e744f4cf0240bf87c70d701ae0ec30/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:04.808423 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236ffb6-c327-4404-8422-8caa8905e3b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea5a8b18527944edb4e9ad4edcb580ee, user_id=95e744f4cf0240bf87c70d701ae0ec30, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:04.811386 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236ffb6-c327-4404-8422-8caa8905e3b2 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:04.842138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 950/1908] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:04 2022] PUT /identity/v3/projects/ea5a8b18527944edb4e9ad4edcb580ee/users/95e744f4cf0240bf87c70d701ae0ec30/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:04.844338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6448f7-3d94-437e-abdb-6119b9f7ff65 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:04.844804 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6448f7-3d94-437e-abdb-6119b9f7ff65 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:04.845252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6448f7-3d94-437e-abdb-6119b9f7ff65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:04.877421 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-aa6448f7-3d94-437e-abdb-6119b9f7ff65 None None] MFA Rules not processed for user `95e744f4cf0240bf87c70d701ae0ec30`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:04.878865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-aa6448f7-3d94-437e-abdb-6119b9f7ff65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:04.970296 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 959/1909] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:04.978897 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236ffb6-c327-4404-8422-8caa8905e3b2 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:04.981089 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-c236ffb6-c327-4404-8422-8caa8905e3b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:05.085774 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236ffb6-c327-4404-8422-8caa8905e3b2 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:05.090140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0051a65-d0f4-4f0f-8838-7764e1944568 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:05.092666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0051a65-d0f4-4f0f-8838-7764e1944568 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:05.092666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0051a65-d0f4-4f0f-8838-7764e1944568 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:05.092666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0051a65-d0f4-4f0f-8838-7764e1944568 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:05.105302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0051a65-d0f4-4f0f-8838-7764e1944568 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:05.105462 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0051a65-d0f4-4f0f-8838-7764e1944568 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:05.133197 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 951/1910] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:05.206279 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6448f7-3d94-437e-abdb-6119b9f7ff65 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:05.244568 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:05.331658 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6448f7-3d94-437e-abdb-6119b9f7ff65 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:05.338035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ab5b9-f869-4a50-b243-463a5eeddce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:05.338946 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ab5b9-f869-4a50-b243-463a5eeddce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:05.339715 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ab5b9-f869-4a50-b243-463a5eeddce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:05.340008 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ab5b9-f869-4a50-b243-463a5eeddce6 admin admin] PATH_INFO: `/v3/users/a9cff2bf1d9a4bdfb6176ce84b370800` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:05.341590 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ab5b9-f869-4a50-b243-463a5eeddce6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9cff2bf1d9a4bdfb6176ce84b370800)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:05.344133 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ab5b9-f869-4a50-b243-463a5eeddce6 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:05.476060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0051a65-d0f4-4f0f-8838-7764e1944568 service cinder] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:05.477366 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-d0051a65-d0f4-4f0f-8838-7764e1944568 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:05.492687 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0051a65-d0f4-4f0f-8838-7764e1944568 service cinder] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:05.499300 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69996d0-f29f-4e9b-becd-adadf6e4ebc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:05.500341 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69996d0-f29f-4e9b-becd-adadf6e4ebc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:05.500733 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69996d0-f29f-4e9b-becd-adadf6e4ebc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:05.501513 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69996d0-f29f-4e9b-becd-adadf6e4ebc0 admin admin] PATH_INFO: `/v3/projects/9d7383143f4747b4841fbb209e07074d` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:05.503135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69996d0-f29f-4e9b-becd-adadf6e4ebc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d7383143f4747b4841fbb209e07074d)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:05.505370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69996d0-f29f-4e9b-becd-adadf6e4ebc0 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:05.580660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-831ab5b9-f869-4a50-b243-463a5eeddce6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9cff2bf1d9a4bdfb6176ce84b370800'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:05.582073 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-831ab5b9-f869-4a50-b243-463a5eeddce6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9cff2bf1d9a4bdfb6176ce84b370800'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:05.650475 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-a69996d0-f29f-4e9b-becd-adadf6e4ebc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d7383143f4747b4841fbb209e07074d', 'request_id': 'req-a69996d0-f29f-4e9b-becd-adadf6e4ebc0'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:05.658884 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-a69996d0-f29f-4e9b-becd-adadf6e4ebc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d7383143f4747b4841fbb209e07074d', 'request_id': 'req-a69996d0-f29f-4e9b-becd-adadf6e4ebc0'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:05.678234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-831ab5b9-f869-4a50-b243-463a5eeddce6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9cff2bf1d9a4bdfb6176ce84b370800'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:05.694978 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-831ab5b9-f869-4a50-b243-463a5eeddce6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9cff2bf1d9a4bdfb6176ce84b370800'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:05.699767 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-831ab5b9-f869-4a50-b243-463a5eeddce6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9cff2bf1d9a4bdfb6176ce84b370800'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:05.706230 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 960/1911] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:20:05 2022] DELETE /identity/v3/users/a9cff2bf1d9a4bdfb6176ce84b370800 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:05.710656 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0a37b-3569-4b68-8451-e363c84c5d7d None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:05.710940 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0a37b-3569-4b68-8451-e363c84c5d7d None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:05.719575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0a37b-3569-4b68-8451-e363c84c5d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:05.729007 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-55b0a37b-3569-4b68-8451-e363c84c5d7d None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:05.730239 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-55b0a37b-3569-4b68-8451-e363c84c5d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:05.781084 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-a69996d0-f29f-4e9b-becd-adadf6e4ebc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d7383143f4747b4841fbb209e07074d', 'request_id': 'req-a69996d0-f29f-4e9b-becd-adadf6e4ebc0'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:05.802000 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-a69996d0-f29f-4e9b-becd-adadf6e4ebc0 admin admin] The token cache is being invalidate because project 9d7383143f4747b4841fbb209e07074d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:20:05.802663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-a69996d0-f29f-4e9b-becd-adadf6e4ebc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:05.803404 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-a69996d0-f29f-4e9b-becd-adadf6e4ebc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:05.805189 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 952/1912] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:20:05 2022] DELETE /identity/v3/projects/9d7383143f4747b4841fbb209e07074d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:20:05.805887 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 961/1913] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:05.809562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69996d0-f29f-4e9b-becd-adadf6e4ebc0 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:05.812881 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-a69996d0-f29f-4e9b-becd-adadf6e4ebc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:05.815920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0a37b-3569-4b68-8451-e363c84c5d7d None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:05.817451 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-55b0a37b-3569-4b68-8451-e363c84c5d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:05.840136 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:05.884412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69996d0-f29f-4e9b-becd-adadf6e4ebc0 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:05.890845 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096725e-e117-4d10-baf6-fd14bca95e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:05.891887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096725e-e117-4d10-baf6-fd14bca95e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:05.892472 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:05.892592 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096725e-e117-4d10-baf6-fd14bca95e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:05.892844 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096725e-e117-4d10-baf6-fd14bca95e85 admin admin] PATH_INFO: `/v3/users/487f42be30084b8fa52e239fe669c02e` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:05.894396 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096725e-e117-4d10-baf6-fd14bca95e85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=487f42be30084b8fa52e239fe669c02e)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:05.896402 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096725e-e117-4d10-baf6-fd14bca95e85 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:05.897491 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0a37b-3569-4b68-8451-e363c84c5d7d None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:05.902715 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07b757-f29b-4a93-b755-2b528e1faf6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:05.903460 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07b757-f29b-4a93-b755-2b528e1faf6c service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:05.903737 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07b757-f29b-4a93-b755-2b528e1faf6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:05.904013 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07b757-f29b-4a93-b755-2b528e1faf6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:05.906109 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-5d07b757-f29b-4a93-b755-2b528e1faf6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:05.919145 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07b757-f29b-4a93-b755-2b528e1faf6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:05.920570 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07b757-f29b-4a93-b755-2b528e1faf6c service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:05.930365 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 962/1914] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:20:06.105549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-b096725e-e117-4d10-baf6-fd14bca95e85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '487f42be30084b8fa52e239fe669c02e'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:06.121779 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-b096725e-e117-4d10-baf6-fd14bca95e85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '487f42be30084b8fa52e239fe669c02e'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:06.192397 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-b096725e-e117-4d10-baf6-fd14bca95e85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '487f42be30084b8fa52e239fe669c02e'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:06.193220 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-b096725e-e117-4d10-baf6-fd14bca95e85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '487f42be30084b8fa52e239fe669c02e'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:06.200746 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-b096725e-e117-4d10-baf6-fd14bca95e85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '487f42be30084b8fa52e239fe669c02e'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:06.207573 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 953/1915] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:20:05 2022] DELETE /identity/v3/users/487f42be30084b8fa52e239fe669c02e => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:06.325322 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07b757-f29b-4a93-b755-2b528e1faf6c service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:06.326959 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-5d07b757-f29b-4a93-b755-2b528e1faf6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:06.347803 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07b757-f29b-4a93-b755-2b528e1faf6c service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:06.415995 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60cc1c-dbb9-4247-bffa-38eb5e12c36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:06.416507 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60cc1c-dbb9-4247-bffa-38eb5e12c36c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:06.416895 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60cc1c-dbb9-4247-bffa-38eb5e12c36c admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:06.417196 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60cc1c-dbb9-4247-bffa-38eb5e12c36c admin admin] PATH_INFO: `/v3/projects/be1dd89376fa431894c7d4b7f0d4ada3` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:06.418495 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd60cc1c-dbb9-4247-bffa-38eb5e12c36c admin admin] RBAC: Authorizing `identity:delete_project(project_id=be1dd89376fa431894c7d4b7f0d4ada3)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:06.420390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd60cc1c-dbb9-4247-bffa-38eb5e12c36c admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:06.550647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-cd60cc1c-dbb9-4247-bffa-38eb5e12c36c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be1dd89376fa431894c7d4b7f0d4ada3', 'request_id': 'req-cd60cc1c-dbb9-4247-bffa-38eb5e12c36c'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:06.556238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-cd60cc1c-dbb9-4247-bffa-38eb5e12c36c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be1dd89376fa431894c7d4b7f0d4ada3', 'request_id': 'req-cd60cc1c-dbb9-4247-bffa-38eb5e12c36c'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:06.643527 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-cd60cc1c-dbb9-4247-bffa-38eb5e12c36c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be1dd89376fa431894c7d4b7f0d4ada3', 'request_id': 'req-cd60cc1c-dbb9-4247-bffa-38eb5e12c36c'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:06.652088 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096725e-e117-4d10-baf6-fd14bca95e85 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:06.652338 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-b096725e-e117-4d10-baf6-fd14bca95e85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:06.660569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-cd60cc1c-dbb9-4247-bffa-38eb5e12c36c admin admin] The token cache is being invalidate because project be1dd89376fa431894c7d4b7f0d4ada3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:20:06.661154 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-cd60cc1c-dbb9-4247-bffa-38eb5e12c36c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:06.662130 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-cd60cc1c-dbb9-4247-bffa-38eb5e12c36c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:06.664849 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 963/1916] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:20:06 2022] DELETE /identity/v3/projects/be1dd89376fa431894c7d4b7f0d4ada3 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:06.668641 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60cc1c-dbb9-4247-bffa-38eb5e12c36c admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:06.670453 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-cd60cc1c-dbb9-4247-bffa-38eb5e12c36c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:06.688662 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096725e-e117-4d10-baf6-fd14bca95e85 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:06.775413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60cc1c-dbb9-4247-bffa-38eb5e12c36c admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:06.781928 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b6f96-2f81-4fce-8b79-44398b88b9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:06.783023 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b6f96-2f81-4fce-8b79-44398b88b9da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:06.784036 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b6f96-2f81-4fce-8b79-44398b88b9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:06.784334 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b6f96-2f81-4fce-8b79-44398b88b9da admin admin] PATH_INFO: `/v3/users/95e744f4cf0240bf87c70d701ae0ec30` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:06.785957 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b6f96-2f81-4fce-8b79-44398b88b9da admin admin] RBAC: Authorizing `identity:delete_user(user_id=95e744f4cf0240bf87c70d701ae0ec30)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:06.788537 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b6f96-2f81-4fce-8b79-44398b88b9da admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:06.832630 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:06.847204 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f071e-6bb5-4130-a8c9-d3e7e015a7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:06.848449 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f071e-6bb5-4130-a8c9-d3e7e015a7d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:06.849160 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f071e-6bb5-4130-a8c9-d3e7e015a7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:06.849496 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f071e-6bb5-4130-a8c9-d3e7e015a7d7 admin admin] PATH_INFO: `/v3/projects/f26c74360f954a35a1fb4e652e8748e7` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:06.852594 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f071e-6bb5-4130-a8c9-d3e7e015a7d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f26c74360f954a35a1fb4e652e8748e7)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:06.855115 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f071e-6bb5-4130-a8c9-d3e7e015a7d7 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:07.026916 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:07.029880 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-ba7b6f96-2f81-4fce-8b79-44398b88b9da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95e744f4cf0240bf87c70d701ae0ec30'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:07.030531 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-ba7b6f96-2f81-4fce-8b79-44398b88b9da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95e744f4cf0240bf87c70d701ae0ec30'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:07.030650 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-2b8f071e-6bb5-4130-a8c9-d3e7e015a7d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f26c74360f954a35a1fb4e652e8748e7', 'request_id': 'req-2b8f071e-6bb5-4130-a8c9-d3e7e015a7d7'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:07.037140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-2b8f071e-6bb5-4130-a8c9-d3e7e015a7d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f26c74360f954a35a1fb4e652e8748e7', 'request_id': 'req-2b8f071e-6bb5-4130-a8c9-d3e7e015a7d7'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:07.112227 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-ba7b6f96-2f81-4fce-8b79-44398b88b9da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95e744f4cf0240bf87c70d701ae0ec30'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:07.124915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-ba7b6f96-2f81-4fce-8b79-44398b88b9da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95e744f4cf0240bf87c70d701ae0ec30'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:07.136053 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-ba7b6f96-2f81-4fce-8b79-44398b88b9da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95e744f4cf0240bf87c70d701ae0ec30'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:07.143985 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 964/1917] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:20:06 2022] DELETE /identity/v3/users/95e744f4cf0240bf87c70d701ae0ec30 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:07.182033 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-2b8f071e-6bb5-4130-a8c9-d3e7e015a7d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f26c74360f954a35a1fb4e652e8748e7', 'request_id': 'req-2b8f071e-6bb5-4130-a8c9-d3e7e015a7d7'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:07.197016 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-2b8f071e-6bb5-4130-a8c9-d3e7e015a7d7 admin admin] The token cache is being invalidate because project f26c74360f954a35a1fb4e652e8748e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:20:07.197683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-2b8f071e-6bb5-4130-a8c9-d3e7e015a7d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:07.198030 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-2b8f071e-6bb5-4130-a8c9-d3e7e015a7d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:07.199767 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 954/1918] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:20:06 2022] DELETE /identity/v3/projects/f26c74360f954a35a1fb4e652e8748e7 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:20:07.204529 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e52f50-8ec3-45c9-b88d-ff5e31e7f2f1 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:07.205177 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e52f50-8ec3-45c9-b88d-ff5e31e7f2f1 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:07.206114 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e52f50-8ec3-45c9-b88d-ff5e31e7f2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:07.232066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-36e52f50-8ec3-45c9-b88d-ff5e31e7f2f1 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:07.233468 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-36e52f50-8ec3-45c9-b88d-ff5e31e7f2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:07.353630 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 965/1919] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:07.355505 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10527f8-c11f-459f-af99-4d7313a4fe17 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:07.355872 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10527f8-c11f-459f-af99-4d7313a4fe17 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:07.356972 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10527f8-c11f-459f-af99-4d7313a4fe17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:07.395469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-e10527f8-c11f-459f-af99-4d7313a4fe17 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:07.398719 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-e10527f8-c11f-459f-af99-4d7313a4fe17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:07.426394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 955/1920] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:07.431946 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e52f50-8ec3-45c9-b88d-ff5e31e7f2f1 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:07.458774 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e52f50-8ec3-45c9-b88d-ff5e31e7f2f1 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:07.463778 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b3ae6-973b-471c-b4c2-9e399e4dc88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:07.468949 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b3ae6-973b-471c-b4c2-9e399e4dc88b admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:07.468949 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b3ae6-973b-471c-b4c2-9e399e4dc88b admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:07.468949 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b3ae6-973b-471c-b4c2-9e399e4dc88b admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:07.468949 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b3ae6-973b-471c-b4c2-9e399e4dc88b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:20:07.468949 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b3ae6-973b-471c-b4c2-9e399e4dc88b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:07.468949 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b3ae6-973b-471c-b4c2-9e399e4dc88b admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:07.482967 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 966/1921] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:20:07.487800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10527f8-c11f-459f-af99-4d7313a4fe17 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:07.499044 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10527f8-c11f-459f-af99-4d7313a4fe17 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:07.505808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639d27f-f66b-4291-a1c2-bcd0c4facd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:07.506572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639d27f-f66b-4291-a1c2-bcd0c4facd7e admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:07.506922 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639d27f-f66b-4291-a1c2-bcd0c4facd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:07.507411 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639d27f-f66b-4291-a1c2-bcd0c4facd7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:07.508535 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639d27f-f66b-4291-a1c2-bcd0c4facd7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:07.510868 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639d27f-f66b-4291-a1c2-bcd0c4facd7e admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:07.632625 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 956/1922] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:07 2022] POST /identity/v3/projects => generated 381 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:07.633962 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b3ae6-973b-471c-b4c2-9e399e4dc88b admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:07.646590 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b3ae6-973b-471c-b4c2-9e399e4dc88b admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:07.662576 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639d27f-f66b-4291-a1c2-bcd0c4facd7e admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:07.669175 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-5639d27f-f66b-4291-a1c2-bcd0c4facd7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:07.759251 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae584a6-ef54-4e1a-8a95-7fe184f485ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:07.759940 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae584a6-ef54-4e1a-8a95-7fe184f485ca admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:07.760231 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae584a6-ef54-4e1a-8a95-7fe184f485ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:07.760513 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae584a6-ef54-4e1a-8a95-7fe184f485ca admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:07.761265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae584a6-ef54-4e1a-8a95-7fe184f485ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:07.763212 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae584a6-ef54-4e1a-8a95-7fe184f485ca admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:07.765015 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639d27f-f66b-4291-a1c2-bcd0c4facd7e admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:07.770634 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149e3b9-77bc-46ec-948e-2b0f894c3f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:07.771660 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149e3b9-77bc-46ec-948e-2b0f894c3f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:07.771947 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149e3b9-77bc-46ec-948e-2b0f894c3f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:07.772232 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149e3b9-77bc-46ec-948e-2b0f894c3f47 admin admin] PATH_INFO: `/v3/projects/ea5a8b18527944edb4e9ad4edcb580ee` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:07.773738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149e3b9-77bc-46ec-948e-2b0f894c3f47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea5a8b18527944edb4e9ad4edcb580ee)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:07.779114 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149e3b9-77bc-46ec-948e-2b0f894c3f47 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:07.916576 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 967/1923] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:07 2022] POST /identity/v3/users => generated 291 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:07.918907 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae584a6-ef54-4e1a-8a95-7fe184f485ca admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:07.932945 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-d149e3b9-77bc-46ec-948e-2b0f894c3f47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea5a8b18527944edb4e9ad4edcb580ee', 'request_id': 'req-d149e3b9-77bc-46ec-948e-2b0f894c3f47'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:07.934783 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae584a6-ef54-4e1a-8a95-7fe184f485ca admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:07.957838 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-d149e3b9-77bc-46ec-948e-2b0f894c3f47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea5a8b18527944edb4e9ad4edcb580ee', 'request_id': 'req-d149e3b9-77bc-46ec-948e-2b0f894c3f47'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:08.009839 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba1ef5b-0df8-4c74-88a9-0c4e39a85e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:08.010518 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1ef5b-0df8-4c74-88a9-0c4e39a85e5f admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:08.010821 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1ef5b-0df8-4c74-88a9-0c4e39a85e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:08.011134 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1ef5b-0df8-4c74-88a9-0c4e39a85e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:08.011886 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba1ef5b-0df8-4c74-88a9-0c4e39a85e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:08.014544 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba1ef5b-0df8-4c74-88a9-0c4e39a85e5f admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:08.027478 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 968/1924] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:20:08.028036 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-d149e3b9-77bc-46ec-948e-2b0f894c3f47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea5a8b18527944edb4e9ad4edcb580ee', 'request_id': 'req-d149e3b9-77bc-46ec-948e-2b0f894c3f47'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:08.037125 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba1ef5b-0df8-4c74-88a9-0c4e39a85e5f admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:08.051509 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba1ef5b-0df8-4c74-88a9-0c4e39a85e5f admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:08.055306 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-d149e3b9-77bc-46ec-948e-2b0f894c3f47 admin admin] The token cache is being invalidate because project ea5a8b18527944edb4e9ad4edcb580ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:20:08.056880 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e8250-b324-4f12-84fb-c37b93a02213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:08.057613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e8250-b324-4f12-84fb-c37b93a02213 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:08.064109 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e8250-b324-4f12-84fb-c37b93a02213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:08.064246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-d149e3b9-77bc-46ec-948e-2b0f894c3f47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:08.064339 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e8250-b324-4f12-84fb-c37b93a02213 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:08.064339 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e8250-b324-4f12-84fb-c37b93a02213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:08.064487 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-d149e3b9-77bc-46ec-948e-2b0f894c3f47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:08.064582 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e8250-b324-4f12-84fb-c37b93a02213 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:08.064696 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 957/1925] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:20:07 2022] DELETE /identity/v3/projects/ea5a8b18527944edb4e9ad4edcb580ee => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:08.068044 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b561416-d399-4458-b7a3-a3e657c9d834 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:08.069169 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b561416-d399-4458-b7a3-a3e657c9d834 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:08.069671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b561416-d399-4458-b7a3-a3e657c9d834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:08.081231 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 969/1926] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:08.084748 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:08.089176 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e8250-b324-4f12-84fb-c37b93a02213 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:08.091743 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-372e8250-b324-4f12-84fb-c37b93a02213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:08.100123 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-5b561416-d399-4458-b7a3-a3e657c9d834 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:08.101408 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-5b561416-d399-4458-b7a3-a3e657c9d834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:08.108101 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e8250-b324-4f12-84fb-c37b93a02213 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:08.112980 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 958/1927] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:20:08.114382 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011d330-8da9-487a-8a1d-ea3d4b345693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:08.114986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011d330-8da9-487a-8a1d-ea3d4b345693 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:08.115512 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011d330-8da9-487a-8a1d-ea3d4b345693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:08.115913 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011d330-8da9-487a-8a1d-ea3d4b345693 admin admin] PATH_INFO: `/v3/projects/6a558e8d629e449c8a8de77ae607e356/users/ffd2a27c453249a1a22f46b1d26bc549/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:08.118588 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d06853-e018-4f4f-9653-ef163a3ba144 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:08.118880 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d06853-e018-4f4f-9653-ef163a3ba144 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:08.119323 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d06853-e018-4f4f-9653-ef163a3ba144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:08.135186 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011d330-8da9-487a-8a1d-ea3d4b345693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a558e8d629e449c8a8de77ae607e356, user_id=ffd2a27c453249a1a22f46b1d26bc549, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:08.139767 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011d330-8da9-487a-8a1d-ea3d4b345693 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:08.151027 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-01d06853-e018-4f4f-9653-ef163a3ba144 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:08.152435 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-01d06853-e018-4f4f-9653-ef163a3ba144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:08.160937 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 959/1928] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:08.165397 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d06853-e018-4f4f-9653-ef163a3ba144 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:08.181594 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d06853-e018-4f4f-9653-ef163a3ba144 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:08.187455 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7e8fd-3595-4737-bc97-66a0ce978b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:08.188311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7e8fd-3595-4737-bc97-66a0ce978b18 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:08.188604 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7e8fd-3595-4737-bc97-66a0ce978b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:08.188917 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7e8fd-3595-4737-bc97-66a0ce978b18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:08.189682 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7e8fd-3595-4737-bc97-66a0ce978b18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:20:08.190023 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7e8fd-3595-4737-bc97-66a0ce978b18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:08.191735 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7e8fd-3595-4737-bc97-66a0ce978b18 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:08.212860 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 960/1929] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:20:08.214750 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7e8fd-3595-4737-bc97-66a0ce978b18 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:08.225945 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7e8fd-3595-4737-bc97-66a0ce978b18 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:08.231653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58597e27-cd5b-483d-a1e1-5a538c7891b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:08.232548 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58597e27-cd5b-483d-a1e1-5a538c7891b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:08.232761 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58597e27-cd5b-483d-a1e1-5a538c7891b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:08.232897 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58597e27-cd5b-483d-a1e1-5a538c7891b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:08.233568 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58597e27-cd5b-483d-a1e1-5a538c7891b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:08.235486 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58597e27-cd5b-483d-a1e1-5a538c7891b0 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:08.248400 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 970/1930] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:08 2022] PUT /identity/v3/projects/6a558e8d629e449c8a8de77ae607e356/users/ffd2a27c453249a1a22f46b1d26bc549/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:08.260169 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c3a06-9743-4cb1-b47f-7b3f81726c68 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:08.260467 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c3a06-9743-4cb1-b47f-7b3f81726c68 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:08.260750 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c3a06-9743-4cb1-b47f-7b3f81726c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:08.302827 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-578c3a06-9743-4cb1-b47f-7b3f81726c68 None None] MFA Rules not processed for user `ffd2a27c453249a1a22f46b1d26bc549`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:08.304549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 961/1931] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:08 2022] POST /identity/v3/projects => generated 391 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:08.305997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:08.306575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-578c3a06-9743-4cb1-b47f-7b3f81726c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:08.307765 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58597e27-cd5b-483d-a1e1-5a538c7891b0 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:08.385932 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 971/1932] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:20:08.386487 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58597e27-cd5b-483d-a1e1-5a538c7891b0 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:08.391887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf60fc-7206-4b72-b1fa-d34635e5d2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:08.392183 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c3a06-9743-4cb1-b47f-7b3f81726c68 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:08.392571 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf60fc-7206-4b72-b1fa-d34635e5d2f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:08.393858 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf60fc-7206-4b72-b1fa-d34635e5d2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:08.394296 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf60fc-7206-4b72-b1fa-d34635e5d2f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:08.395006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf60fc-7206-4b72-b1fa-d34635e5d2f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:08.397233 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf60fc-7206-4b72-b1fa-d34635e5d2f0 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:08.405209 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c3a06-9743-4cb1-b47f-7b3f81726c68 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:08.410850 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdc40b-888d-46c6-81b5-183a1a0362aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:08.412271 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdc40b-888d-46c6-81b5-183a1a0362aa admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:08.412271 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdc40b-888d-46c6-81b5-183a1a0362aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:08.412271 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdc40b-888d-46c6-81b5-183a1a0362aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:08.413081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdc40b-888d-46c6-81b5-183a1a0362aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:08.415059 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdc40b-888d-46c6-81b5-183a1a0362aa admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:08.522587 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 962/1933] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:08 2022] POST /identity/v3/users => generated 296 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:08.523098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 972/1934] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:08 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:08.527478 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf60fc-7206-4b72-b1fa-d34635e5d2f0 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:08.528425 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdc40b-888d-46c6-81b5-183a1a0362aa admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:08.553998 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf60fc-7206-4b72-b1fa-d34635e5d2f0 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:08.689069 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdc40b-888d-46c6-81b5-183a1a0362aa admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:08.704711 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d06700-281f-40fb-b4fb-703f6de76a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:08.705157 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa4c8d-c679-4106-a38a-049359105322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:08.708856 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d06700-281f-40fb-b4fb-703f6de76a8e admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:08.708856 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d06700-281f-40fb-b4fb-703f6de76a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:08.709351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa4c8d-c679-4106-a38a-049359105322 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:08.709524 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d06700-281f-40fb-b4fb-703f6de76a8e admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:08.709611 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa4c8d-c679-4106-a38a-049359105322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:08.709611 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa4c8d-c679-4106-a38a-049359105322 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:08.709768 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d06700-281f-40fb-b4fb-703f6de76a8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:08.709848 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa4c8d-c679-4106-a38a-049359105322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:08.709936 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d06700-281f-40fb-b4fb-703f6de76a8e admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:08.710517 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa4c8d-c679-4106-a38a-049359105322 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:08.728096 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 963/1935] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:08.730556 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa4c8d-c679-4106-a38a-049359105322 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:08.748595 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa4c8d-c679-4106-a38a-049359105322 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:08.756883 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd88ad0-cb4b-496e-ad35-49ef16ead491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:08.757731 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd88ad0-cb4b-496e-ad35-49ef16ead491 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:08.758137 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd88ad0-cb4b-496e-ad35-49ef16ead491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:08.758563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd88ad0-cb4b-496e-ad35-49ef16ead491 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:08.759508 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd88ad0-cb4b-496e-ad35-49ef16ead491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:08.761823 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd88ad0-cb4b-496e-ad35-49ef16ead491 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:08.778865 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 964/1936] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:08.780531 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd88ad0-cb4b-496e-ad35-49ef16ead491 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:08.797470 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd88ad0-cb4b-496e-ad35-49ef16ead491 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:08.803614 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 973/1937] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:08 2022] POST /identity/v3/users => generated 298 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:08.806688 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d8bc7-0763-4a42-905d-30eda46dbf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:08.806688 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d8bc7-0763-4a42-905d-30eda46dbf96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:08.806688 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d8bc7-0763-4a42-905d-30eda46dbf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:08.806688 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d8bc7-0763-4a42-905d-30eda46dbf96 admin admin] PATH_INFO: `/v3/projects/8b3c0155041a4eb59e42497aeda86c91/users/464933f599c2458680e417c20f61e0dd/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:08.809281 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d06700-281f-40fb-b4fb-703f6de76a8e admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:08.829066 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d8bc7-0763-4a42-905d-30eda46dbf96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b3c0155041a4eb59e42497aeda86c91, user_id=464933f599c2458680e417c20f61e0dd, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:08.831587 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d06700-281f-40fb-b4fb-703f6de76a8e admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:08.836407 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d8bc7-0763-4a42-905d-30eda46dbf96 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:08.852864 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48b827-0eee-4ed6-bb80-76266d7ca6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:08.853566 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48b827-0eee-4ed6-bb80-76266d7ca6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:08.853831 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48b827-0eee-4ed6-bb80-76266d7ca6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:08.854084 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48b827-0eee-4ed6-bb80-76266d7ca6e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:08.854736 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48b827-0eee-4ed6-bb80-76266d7ca6e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:08.856330 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48b827-0eee-4ed6-bb80-76266d7ca6e5 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:08.874317 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 974/1938] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:20:08.879071 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48b827-0eee-4ed6-bb80-76266d7ca6e5 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:08.896481 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48b827-0eee-4ed6-bb80-76266d7ca6e5 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:08.902011 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2dbc2-5242-4309-b512-cc1ba0913292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:08.902913 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2dbc2-5242-4309-b512-cc1ba0913292 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:08.903194 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2dbc2-5242-4309-b512-cc1ba0913292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:08.903469 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2dbc2-5242-4309-b512-cc1ba0913292 admin admin] PATH_INFO: `/v3/projects/c0bc46f89ef346af8ed0568ced617ea0/users/5a843207764143da92e390c5981e0d00/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:08.919309 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2dbc2-5242-4309-b512-cc1ba0913292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0bc46f89ef346af8ed0568ced617ea0, user_id=5a843207764143da92e390c5981e0d00, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:08.921889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2dbc2-5242-4309-b512-cc1ba0913292 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:08.936536 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 965/1939] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:08 2022] PUT /identity/v3/projects/8b3c0155041a4eb59e42497aeda86c91/users/464933f599c2458680e417c20f61e0dd/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:20:08.950255 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf8b3d-1162-42f5-a58d-c642cf404d10 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:08.950703 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf8b3d-1162-42f5-a58d-c642cf404d10 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:08.950974 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf8b3d-1162-42f5-a58d-c642cf404d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:08.986377 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-c3bf8b3d-1162-42f5-a58d-c642cf404d10 None None] MFA Rules not processed for user `464933f599c2458680e417c20f61e0dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:08.988215 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-c3bf8b3d-1162-42f5-a58d-c642cf404d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:08.999500 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 975/1940] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:08 2022] PUT /identity/v3/projects/c0bc46f89ef346af8ed0568ced617ea0/users/5a843207764143da92e390c5981e0d00/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:20:09.003978 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2dbc2-5242-4309-b512-cc1ba0913292 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:09.067518 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 966/1941] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:09.078085 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf8b3d-1162-42f5-a58d-c642cf404d10 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:09.107421 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2dbc2-5242-4309-b512-cc1ba0913292 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:09.120001 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48f4c2-944c-4d84-9742-a2063837521d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:09.120686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48f4c2-944c-4d84-9742-a2063837521d admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:09.121000 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48f4c2-944c-4d84-9742-a2063837521d admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:09.121281 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48f4c2-944c-4d84-9742-a2063837521d admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:09.122061 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48f4c2-944c-4d84-9742-a2063837521d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:09.123670 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48f4c2-944c-4d84-9742-a2063837521d admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:09.140105 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:09.152004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 976/1942] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:09.157977 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48f4c2-944c-4d84-9742-a2063837521d admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:09.180258 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48f4c2-944c-4d84-9742-a2063837521d admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:09.188319 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe3a25-c91e-407b-9381-11de90adc884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:09.190638 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe3a25-c91e-407b-9381-11de90adc884 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:09.191606 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe3a25-c91e-407b-9381-11de90adc884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:09.193725 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe3a25-c91e-407b-9381-11de90adc884 admin admin] PATH_INFO: `/v3/projects/c0bc46f89ef346af8ed0568ced617ea0/users/5a843207764143da92e390c5981e0d00/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:09.201520 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbe3a25-c91e-407b-9381-11de90adc884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0bc46f89ef346af8ed0568ced617ea0, user_id=5a843207764143da92e390c5981e0d00, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:09.204979 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbe3a25-c91e-407b-9381-11de90adc884 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:09.207719 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf8b3d-1162-42f5-a58d-c642cf404d10 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:09.213659 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e54e3-71ab-4950-b58a-720d7a885f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:09.214349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e54e3-71ab-4950-b58a-720d7a885f3d admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:09.214627 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e54e3-71ab-4950-b58a-720d7a885f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:09.214912 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e54e3-71ab-4950-b58a-720d7a885f3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:09.215628 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e54e3-71ab-4950-b58a-720d7a885f3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:09.217601 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e54e3-71ab-4950-b58a-720d7a885f3d admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:09.218180 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 977/1943] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:09 2022] PUT /identity/v3/projects/c0bc46f89ef346af8ed0568ced617ea0/users/5a843207764143da92e390c5981e0d00/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:09.228652 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c7f65-774d-4277-9f4a-de440102c6f5 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:09.229107 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c7f65-774d-4277-9f4a-de440102c6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:09.229266 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c7f65-774d-4277-9f4a-de440102c6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:09.262779 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-3f5c7f65-774d-4277-9f4a-de440102c6f5 None None] MFA Rules not processed for user `5a843207764143da92e390c5981e0d00`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:09.264037 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-3f5c7f65-774d-4277-9f4a-de440102c6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:09.335073 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 978/1944] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:09.347242 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c7f65-774d-4277-9f4a-de440102c6f5 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:09.348688 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-3f5c7f65-774d-4277-9f4a-de440102c6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:09.351164 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 967/1945] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:09 2022] POST /identity/v3/projects => generated 393 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:20:09.355601 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e54e3-71ab-4950-b58a-720d7a885f3d admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:09.411792 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:09.415746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c7f65-774d-4277-9f4a-de440102c6f5 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:09.437639 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e54e3-71ab-4950-b58a-720d7a885f3d admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:09.442588 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e26313-af31-4de4-be08-7f6e08cfa1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:09.443341 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e26313-af31-4de4-be08-7f6e08cfa1dc admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:09.443696 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e26313-af31-4de4-be08-7f6e08cfa1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:09.444048 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e26313-af31-4de4-be08-7f6e08cfa1dc admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:09.444808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e26313-af31-4de4-be08-7f6e08cfa1dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:09.447007 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e26313-af31-4de4-be08-7f6e08cfa1dc admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:09.468229 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcbf3b-89fb-482a-9cdf-81f3f1cbcaf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:09.468914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcbf3b-89fb-482a-9cdf-81f3f1cbcaf6 service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:09.469200 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcbf3b-89fb-482a-9cdf-81f3f1cbcaf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:09.469476 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcbf3b-89fb-482a-9cdf-81f3f1cbcaf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:09.533511 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebcbf3b-89fb-482a-9cdf-81f3f1cbcaf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:09.535148 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebcbf3b-89fb-482a-9cdf-81f3f1cbcaf6 service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:09.545547 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 979/1946] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:09.568294 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 968/1947] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:09 2022] POST /identity/v3/users => generated 303 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:20:09.572475 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcbf3b-89fb-482a-9cdf-81f3f1cbcaf6 service cinder] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:09.585843 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcbf3b-89fb-482a-9cdf-81f3f1cbcaf6 service cinder] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:09.598347 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b5b42-1199-44a6-a679-5a72c18c1d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:09.600789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b5b42-1199-44a6-a679-5a72c18c1d71 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:09.600789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b5b42-1199-44a6-a679-5a72c18c1d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:09.600789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b5b42-1199-44a6-a679-5a72c18c1d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:09.600789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b5b42-1199-44a6-a679-5a72c18c1d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:09.602823 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b5b42-1199-44a6-a679-5a72c18c1d71 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:09.616010 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 980/1948] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:09.623145 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e26313-af31-4de4-be08-7f6e08cfa1dc admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:09.634526 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e26313-af31-4de4-be08-7f6e08cfa1dc admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:09.647220 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6834e8c-8a32-4a47-bf63-cc9d3be2314e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:09.648151 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6834e8c-8a32-4a47-bf63-cc9d3be2314e admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:09.648873 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6834e8c-8a32-4a47-bf63-cc9d3be2314e admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:09.648873 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6834e8c-8a32-4a47-bf63-cc9d3be2314e admin admin] PATH_INFO: `/v3/projects/fd98b602f8ff45d4949ed5948e8b00ef/users/6f49cf50e2b544328c019fbf10c163b6/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:09.656759 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b5b42-1199-44a6-a679-5a72c18c1d71 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:09.670173 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b5b42-1199-44a6-a679-5a72c18c1d71 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:09.671633 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6834e8c-8a32-4a47-bf63-cc9d3be2314e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd98b602f8ff45d4949ed5948e8b00ef, user_id=6f49cf50e2b544328c019fbf10c163b6, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:09.674753 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb5c21-aaee-4bb2-b4d9-99df3dd519de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:09.675429 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb5c21-aaee-4bb2-b4d9-99df3dd519de service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:09.675642 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6834e8c-8a32-4a47-bf63-cc9d3be2314e admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:09.675751 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb5c21-aaee-4bb2-b4d9-99df3dd519de service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:09.676009 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb5c21-aaee-4bb2-b4d9-99df3dd519de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:09.746645 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb5c21-aaee-4bb2-b4d9-99df3dd519de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:09.748021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb5c21-aaee-4bb2-b4d9-99df3dd519de service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:09.758532 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 981/1949] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:20:09.781695 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 969/1950] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:09 2022] PUT /identity/v3/projects/fd98b602f8ff45d4949ed5948e8b00ef/users/6f49cf50e2b544328c019fbf10c163b6/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:09.786203 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb5c21-aaee-4bb2-b4d9-99df3dd519de service cinder] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:09.796700 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb5c21-aaee-4bb2-b4d9-99df3dd519de service cinder] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:09.872437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c67a0f-aecf-4cfe-b5a0-b33e99de44b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:09.873451 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c67a0f-aecf-4cfe-b5a0-b33e99de44b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:09.873780 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c67a0f-aecf-4cfe-b5a0-b33e99de44b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:09.874227 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c67a0f-aecf-4cfe-b5a0-b33e99de44b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:09.875004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c67a0f-aecf-4cfe-b5a0-b33e99de44b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:09.876633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c67a0f-aecf-4cfe-b5a0-b33e99de44b0 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:09.888149 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 982/1951] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:09.892269 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6834e8c-8a32-4a47-bf63-cc9d3be2314e admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:09.904868 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6834e8c-8a32-4a47-bf63-cc9d3be2314e admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:09.911012 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6260ce-056e-4b72-8186-ec6ea3138920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:09.912170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6260ce-056e-4b72-8186-ec6ea3138920 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:09.913702 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6260ce-056e-4b72-8186-ec6ea3138920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:09.913702 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6260ce-056e-4b72-8186-ec6ea3138920 admin admin] PATH_INFO: `/v3/projects/fd98b602f8ff45d4949ed5948e8b00ef/users/6f49cf50e2b544328c019fbf10c163b6/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:09.915116 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6260ce-056e-4b72-8186-ec6ea3138920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd98b602f8ff45d4949ed5948e8b00ef, user_id=6f49cf50e2b544328c019fbf10c163b6, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:09.917966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6260ce-056e-4b72-8186-ec6ea3138920 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:09.929453 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 970/1952] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:09 2022] PUT /identity/v3/projects/fd98b602f8ff45d4949ed5948e8b00ef/users/6f49cf50e2b544328c019fbf10c163b6/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:20:09.939978 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7205cc-6f24-4129-93b0-a6ee90560fb8 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:09.940942 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7205cc-6f24-4129-93b0-a6ee90560fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:09.941260 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7205cc-6f24-4129-93b0-a6ee90560fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:09.972013 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-9d7205cc-6f24-4129-93b0-a6ee90560fb8 None None] MFA Rules not processed for user `6f49cf50e2b544328c019fbf10c163b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:09.972013 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-9d7205cc-6f24-4129-93b0-a6ee90560fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:10.050367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:10.060027 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 983/1953] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:09 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:10.071061 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6260ce-056e-4b72-8186-ec6ea3138920 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:10.073333 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-6b6260ce-056e-4b72-8186-ec6ea3138920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:10.152807 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6260ce-056e-4b72-8186-ec6ea3138920 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:10.156683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c2d5a-022d-4d71-89ef-def3afcb6cc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:10.157372 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c2d5a-022d-4d71-89ef-def3afcb6cc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:10.157707 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c2d5a-022d-4d71-89ef-def3afcb6cc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:10.160218 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c2d5a-022d-4d71-89ef-def3afcb6cc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:10.171161 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c2d5a-022d-4d71-89ef-def3afcb6cc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:10.172668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c2d5a-022d-4d71-89ef-def3afcb6cc1 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:10.181099 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:10.186419 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 971/1954] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:10.489856 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7205cc-6f24-4129-93b0-a6ee90560fb8 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:10.501790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7205cc-6f24-4129-93b0-a6ee90560fb8 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:10.506835 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85236e1-3872-4264-89f0-7a1165f7bf33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:10.507783 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85236e1-3872-4264-89f0-7a1165f7bf33 service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:10.508572 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85236e1-3872-4264-89f0-7a1165f7bf33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:10.509054 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85236e1-3872-4264-89f0-7a1165f7bf33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:10.535321 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:10.605363 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85236e1-3872-4264-89f0-7a1165f7bf33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:10.606914 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85236e1-3872-4264-89f0-7a1165f7bf33 service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:10.622081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 984/1955] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:10.893120 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c2d5a-022d-4d71-89ef-def3afcb6cc1 service cinder] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:10.897452 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-f53c2d5a-022d-4d71-89ef-def3afcb6cc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:10.946491 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85236e1-3872-4264-89f0-7a1165f7bf33 service cinder] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:10.947970 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-e85236e1-3872-4264-89f0-7a1165f7bf33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:10.973479 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c2d5a-022d-4d71-89ef-def3afcb6cc1 service cinder] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:10.978011 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:10.978894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36b9e1-bc12-4860-b000-a308f1c091ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:10.980458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36b9e1-bc12-4860-b000-a308f1c091ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:10.980458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36b9e1-bc12-4860-b000-a308f1c091ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:10.980458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36b9e1-bc12-4860-b000-a308f1c091ab admin admin] PATH_INFO: `/v3/users/553d44a3d1f74a94a9133468ff2773a7` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:10.981650 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f36b9e1-bc12-4860-b000-a308f1c091ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=553d44a3d1f74a94a9133468ff2773a7)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:10.983585 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f36b9e1-bc12-4860-b000-a308f1c091ab admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:11.030277 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85236e1-3872-4264-89f0-7a1165f7bf33 service cinder] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:11.035626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29208e9-c185-40a5-a916-5c49029b0df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:11.036512 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29208e9-c185-40a5-a916-5c49029b0df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:11.036794 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29208e9-c185-40a5-a916-5c49029b0df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:11.037145 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29208e9-c185-40a5-a916-5c49029b0df3 admin admin] PATH_INFO: `/v3/users/169ea4f12e9e4ba686193143358ba2b3` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:11.038299 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29208e9-c185-40a5-a916-5c49029b0df3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=169ea4f12e9e4ba686193143358ba2b3)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:11.040205 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29208e9-c185-40a5-a916-5c49029b0df3 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:11.203343 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-4f36b9e1-bc12-4860-b000-a308f1c091ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '553d44a3d1f74a94a9133468ff2773a7'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:11.219438 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-4f36b9e1-bc12-4860-b000-a308f1c091ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '553d44a3d1f74a94a9133468ff2773a7'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:11.232926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-c29208e9-c185-40a5-a916-5c49029b0df3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '169ea4f12e9e4ba686193143358ba2b3'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:11.237503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-c29208e9-c185-40a5-a916-5c49029b0df3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '169ea4f12e9e4ba686193143358ba2b3'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:11.313313 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-4f36b9e1-bc12-4860-b000-a308f1c091ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '553d44a3d1f74a94a9133468ff2773a7'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:11.314097 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-4f36b9e1-bc12-4860-b000-a308f1c091ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '553d44a3d1f74a94a9133468ff2773a7'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:11.325350 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-4f36b9e1-bc12-4860-b000-a308f1c091ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '553d44a3d1f74a94a9133468ff2773a7'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:11.332555 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 972/1956] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:20:10 2022] DELETE /identity/v3/users/553d44a3d1f74a94a9133468ff2773a7 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:11.337043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f279b9-913d-47e1-9122-d61e5c5840db None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:11.337418 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f279b9-913d-47e1-9122-d61e5c5840db None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:11.337776 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f279b9-913d-47e1-9122-d61e5c5840db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:11.371900 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-c29208e9-c185-40a5-a916-5c49029b0df3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '169ea4f12e9e4ba686193143358ba2b3'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:11.390589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-c29208e9-c185-40a5-a916-5c49029b0df3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '169ea4f12e9e4ba686193143358ba2b3'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:11.407105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-b7f279b9-913d-47e1-9122-d61e5c5840db None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:11.408844 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-b7f279b9-913d-47e1-9122-d61e5c5840db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:11.415807 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-c29208e9-c185-40a5-a916-5c49029b0df3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '169ea4f12e9e4ba686193143358ba2b3'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:11.424121 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 985/1957] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:20:10 2022] DELETE /identity/v3/users/169ea4f12e9e4ba686193143358ba2b3 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:20:11.429569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713302b-3701-46f7-ad77-39a004ffdc17 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:11.429950 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713302b-3701-46f7-ad77-39a004ffdc17 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:11.430231 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713302b-3701-46f7-ad77-39a004ffdc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:11.431297 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:11.475088 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-d713302b-3701-46f7-ad77-39a004ffdc17 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:11.478396 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-d713302b-3701-46f7-ad77-39a004ffdc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:11.485846 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 973/1958] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:11.497203 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f279b9-913d-47e1-9122-d61e5c5840db None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:11.502952 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-b7f279b9-913d-47e1-9122-d61e5c5840db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:11.568446 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 986/1959] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:20:11.579458 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713302b-3701-46f7-ad77-39a004ffdc17 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:11.580709 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-d713302b-3701-46f7-ad77-39a004ffdc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:11.596984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f279b9-913d-47e1-9122-d61e5c5840db None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:11.635946 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:11.652963 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713302b-3701-46f7-ad77-39a004ffdc17 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:11.656047 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8ba6c-512e-402a-841b-aa881cf5e298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:11.656708 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8ba6c-512e-402a-841b-aa881cf5e298 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:11.657195 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8ba6c-512e-402a-841b-aa881cf5e298 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:11.657631 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8ba6c-512e-402a-841b-aa881cf5e298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:11.687159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d8ba6c-512e-402a-841b-aa881cf5e298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:11.687159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d8ba6c-512e-402a-841b-aa881cf5e298 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:11.687468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8ddc1-7419-40ad-99d1-5d828efedd4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:11.687662 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8ddc1-7419-40ad-99d1-5d828efedd4c service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:11.688062 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8ddc1-7419-40ad-99d1-5d828efedd4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:11.688443 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8ddc1-7419-40ad-99d1-5d828efedd4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:11.697573 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 987/1960] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:11.701576 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b8ddc1-7419-40ad-99d1-5d828efedd4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:11.703164 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b8ddc1-7419-40ad-99d1-5d828efedd4c service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:11.742595 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 974/1961] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:12.280602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8ba6c-512e-402a-841b-aa881cf5e298 service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:12.282286 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-59d8ba6c-512e-402a-841b-aa881cf5e298 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:12.298039 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8ba6c-512e-402a-841b-aa881cf5e298 service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:12.304742 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617ffba-1185-4d5e-b096-478b00164821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:12.305789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617ffba-1185-4d5e-b096-478b00164821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:12.306070 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617ffba-1185-4d5e-b096-478b00164821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:12.306347 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617ffba-1185-4d5e-b096-478b00164821 admin admin] PATH_INFO: `/v3/projects/115b6bd8b1764d5f933b22950b98b727` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:12.307806 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617ffba-1185-4d5e-b096-478b00164821 admin admin] RBAC: Authorizing `identity:delete_project(project_id=115b6bd8b1764d5f933b22950b98b727)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:12.309938 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617ffba-1185-4d5e-b096-478b00164821 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:12.418516 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-2617ffba-1185-4d5e-b096-478b00164821 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '115b6bd8b1764d5f933b22950b98b727', 'request_id': 'req-2617ffba-1185-4d5e-b096-478b00164821'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:12.424606 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-2617ffba-1185-4d5e-b096-478b00164821 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '115b6bd8b1764d5f933b22950b98b727', 'request_id': 'req-2617ffba-1185-4d5e-b096-478b00164821'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:12.473783 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-2617ffba-1185-4d5e-b096-478b00164821 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '115b6bd8b1764d5f933b22950b98b727', 'request_id': 'req-2617ffba-1185-4d5e-b096-478b00164821'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:12.488712 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-2617ffba-1185-4d5e-b096-478b00164821 admin admin] The token cache is being invalidate because project 115b6bd8b1764d5f933b22950b98b727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:20:12.490688 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-2617ffba-1185-4d5e-b096-478b00164821 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:12.491601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-2617ffba-1185-4d5e-b096-478b00164821 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:12.493781 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 988/1962] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:20:12 2022] DELETE /identity/v3/projects/115b6bd8b1764d5f933b22950b98b727 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:12.499942 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97df286-635a-471b-afa0-79dca4914d50 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:12.500543 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97df286-635a-471b-afa0-79dca4914d50 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:12.500681 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97df286-635a-471b-afa0-79dca4914d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:12.521915 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-e97df286-635a-471b-afa0-79dca4914d50 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:12.523192 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-e97df286-635a-471b-afa0-79dca4914d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:12.611245 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 975/1963] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:12.620005 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca95da-e031-4af3-9c0d-f571c2fe8db4 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:12.620508 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca95da-e031-4af3-9c0d-f571c2fe8db4 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:12.621515 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca95da-e031-4af3-9c0d-f571c2fe8db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:12.641742 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-b6ca95da-e031-4af3-9c0d-f571c2fe8db4 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:12.642968 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-b6ca95da-e031-4af3-9c0d-f571c2fe8db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:12.651744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 989/1964] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:12.656144 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97df286-635a-471b-afa0-79dca4914d50 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:12.667637 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97df286-635a-471b-afa0-79dca4914d50 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:12.672602 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58163189-378c-4ae1-8e5f-c386b7aa4aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:12.673318 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58163189-378c-4ae1-8e5f-c386b7aa4aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:12.673602 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58163189-378c-4ae1-8e5f-c386b7aa4aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:12.673881 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58163189-378c-4ae1-8e5f-c386b7aa4aa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:12.674677 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58163189-378c-4ae1-8e5f-c386b7aa4aa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:20:12.675490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58163189-378c-4ae1-8e5f-c386b7aa4aa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:12.677256 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58163189-378c-4ae1-8e5f-c386b7aa4aa2 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:12.691076 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 976/1965] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:20:12.695545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca95da-e031-4af3-9c0d-f571c2fe8db4 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:12.705974 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca95da-e031-4af3-9c0d-f571c2fe8db4 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:12.714682 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efd03e-1fd7-4b5a-aa64-c8626ced7e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:12.715465 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efd03e-1fd7-4b5a-aa64-c8626ced7e3b admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:12.715816 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efd03e-1fd7-4b5a-aa64-c8626ced7e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:12.716153 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efd03e-1fd7-4b5a-aa64-c8626ced7e3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:12.718892 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efd03e-1fd7-4b5a-aa64-c8626ced7e3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:12.720940 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efd03e-1fd7-4b5a-aa64-c8626ced7e3b admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:12.850109 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 990/1966] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:12 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:12.851210 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58163189-378c-4ae1-8e5f-c386b7aa4aa2 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:12.870665 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58163189-378c-4ae1-8e5f-c386b7aa4aa2 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:12.891989 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efd03e-1fd7-4b5a-aa64-c8626ced7e3b admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:12.892741 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:12.897479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-d5efd03e-1fd7-4b5a-aa64-c8626ced7e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:12.973180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655254ab-4982-4d71-bfa0-fe4a9c47b5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:12.974214 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655254ab-4982-4d71-bfa0-fe4a9c47b5bb admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:12.974450 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655254ab-4982-4d71-bfa0-fe4a9c47b5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:12.975560 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655254ab-4982-4d71-bfa0-fe4a9c47b5bb admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:12.976281 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655254ab-4982-4d71-bfa0-fe4a9c47b5bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:12.983391 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655254ab-4982-4d71-bfa0-fe4a9c47b5bb admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:13.047702 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efd03e-1fd7-4b5a-aa64-c8626ced7e3b admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:13.061405 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdde93-16c5-4344-8b31-37998d58db18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:13.062714 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdde93-16c5-4344-8b31-37998d58db18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:13.063906 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdde93-16c5-4344-8b31-37998d58db18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:13.063906 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdde93-16c5-4344-8b31-37998d58db18 admin admin] PATH_INFO: `/v3/projects/9ee5042427184b9bb14e481653f105dd` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:13.065324 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdde93-16c5-4344-8b31-37998d58db18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ee5042427184b9bb14e481653f105dd)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:13.067936 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdde93-16c5-4344-8b31-37998d58db18 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:13.074324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 977/1967] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:12 2022] POST /identity/v3/users => generated 287 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:13.074324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655254ab-4982-4d71-bfa0-fe4a9c47b5bb admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:13.078726 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-655254ab-4982-4d71-bfa0-fe4a9c47b5bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:13.112273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655254ab-4982-4d71-bfa0-fe4a9c47b5bb admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:13.118753 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba4dc3-57c4-46a8-b02b-57cb9ec675f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:13.119638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba4dc3-57c4-46a8-b02b-57cb9ec675f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:13.119922 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba4dc3-57c4-46a8-b02b-57cb9ec675f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:13.120196 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba4dc3-57c4-46a8-b02b-57cb9ec675f2 admin admin] PATH_INFO: `/v3/users/ffd2a27c453249a1a22f46b1d26bc549` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:13.121454 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba4dc3-57c4-46a8-b02b-57cb9ec675f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffd2a27c453249a1a22f46b1d26bc549)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:13.123665 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba4dc3-57c4-46a8-b02b-57cb9ec675f2 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:13.202997 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:13.212002 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-85fdde93-16c5-4344-8b31-37998d58db18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ee5042427184b9bb14e481653f105dd', 'request_id': 'req-85fdde93-16c5-4344-8b31-37998d58db18'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:13.217706 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-85fdde93-16c5-4344-8b31-37998d58db18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ee5042427184b9bb14e481653f105dd', 'request_id': 'req-85fdde93-16c5-4344-8b31-37998d58db18'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:13.308416 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-85fdde93-16c5-4344-8b31-37998d58db18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ee5042427184b9bb14e481653f105dd', 'request_id': 'req-85fdde93-16c5-4344-8b31-37998d58db18'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:13.320959 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-85fdde93-16c5-4344-8b31-37998d58db18 admin admin] The token cache is being invalidate because project 9ee5042427184b9bb14e481653f105dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:20:13.321301 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-85fdde93-16c5-4344-8b31-37998d58db18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:13.322017 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-85fdde93-16c5-4344-8b31-37998d58db18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:13.323017 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-90ba4dc3-57c4-46a8-b02b-57cb9ec675f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffd2a27c453249a1a22f46b1d26bc549'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:13.323829 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 991/1968] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:20:12 2022] DELETE /identity/v3/projects/9ee5042427184b9bb14e481653f105dd => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:20:13.324389 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdde93-16c5-4344-8b31-37998d58db18 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:13.325709 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-85fdde93-16c5-4344-8b31-37998d58db18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:13.338166 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-90ba4dc3-57c4-46a8-b02b-57cb9ec675f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffd2a27c453249a1a22f46b1d26bc549'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:13.396030 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdde93-16c5-4344-8b31-37998d58db18 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:13.401953 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f4d69-b5dd-4e79-80e9-577730da5378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:13.402759 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f4d69-b5dd-4e79-80e9-577730da5378 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:13.403049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f4d69-b5dd-4e79-80e9-577730da5378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:13.403339 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f4d69-b5dd-4e79-80e9-577730da5378 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:13.404078 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f4d69-b5dd-4e79-80e9-577730da5378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:13.405703 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f4d69-b5dd-4e79-80e9-577730da5378 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:13.419729 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 992/1969] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:13.419729 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f4d69-b5dd-4e79-80e9-577730da5378 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:13.420013 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-7f1f4d69-b5dd-4e79-80e9-577730da5378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:13.435055 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f4d69-b5dd-4e79-80e9-577730da5378 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:13.440585 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c38871-08c1-4259-b313-99cca07de0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:13.441631 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c38871-08c1-4259-b313-99cca07de0c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:13.441978 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c38871-08c1-4259-b313-99cca07de0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:13.442364 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c38871-08c1-4259-b313-99cca07de0c3 admin admin] PATH_INFO: `/v3/users/e0f197bb8e664802b577b5837dcde546` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:13.443629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c38871-08c1-4259-b313-99cca07de0c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0f197bb8e664802b577b5837dcde546)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:13.445615 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c38871-08c1-4259-b313-99cca07de0c3 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:13.456676 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-90ba4dc3-57c4-46a8-b02b-57cb9ec675f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffd2a27c453249a1a22f46b1d26bc549'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:13.457877 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-90ba4dc3-57c4-46a8-b02b-57cb9ec675f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffd2a27c453249a1a22f46b1d26bc549'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:13.469932 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-90ba4dc3-57c4-46a8-b02b-57cb9ec675f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffd2a27c453249a1a22f46b1d26bc549'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:13.479895 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 978/1970] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:20:13 2022] DELETE /identity/v3/users/ffd2a27c453249a1a22f46b1d26bc549 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:13.481220 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba4dc3-57c4-46a8-b02b-57cb9ec675f2 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:13.485305 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-90ba4dc3-57c4-46a8-b02b-57cb9ec675f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:13.564504 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba4dc3-57c4-46a8-b02b-57cb9ec675f2 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:13.569543 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d10f40-f3e6-4d18-9e0a-fce38c3eaf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:13.570627 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d10f40-f3e6-4d18-9e0a-fce38c3eaf7b admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:13.570908 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d10f40-f3e6-4d18-9e0a-fce38c3eaf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:13.571184 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d10f40-f3e6-4d18-9e0a-fce38c3eaf7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:13.571923 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d10f40-f3e6-4d18-9e0a-fce38c3eaf7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:13.573584 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d10f40-f3e6-4d18-9e0a-fce38c3eaf7b admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:13.588403 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 979/1971] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:13.590076 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07f9e9-4f10-4393-9ad1-ee588c3fc132 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:13.590528 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07f9e9-4f10-4393-9ad1-ee588c3fc132 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:13.590807 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07f9e9-4f10-4393-9ad1-ee588c3fc132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:13.610705 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-da07f9e9-4f10-4393-9ad1-ee588c3fc132 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:13.612078 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-da07f9e9-4f10-4393-9ad1-ee588c3fc132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:13.621972 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 980/1972] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:13.626037 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07f9e9-4f10-4393-9ad1-ee588c3fc132 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:13.627817 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b0c38871-08c1-4259-b313-99cca07de0c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0f197bb8e664802b577b5837dcde546'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:13.629294 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b0c38871-08c1-4259-b313-99cca07de0c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0f197bb8e664802b577b5837dcde546'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:13.631046 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:13.637103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07f9e9-4f10-4393-9ad1-ee588c3fc132 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:13.642433 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5a059-ae76-4a03-90d6-111b455fe419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:13.645026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5a059-ae76-4a03-90d6-111b455fe419 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:13.645026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5a059-ae76-4a03-90d6-111b455fe419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:13.645026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5a059-ae76-4a03-90d6-111b455fe419 admin admin] PATH_INFO: `/v3/projects/9e06f1a9b667414b8d663033c7053b76/users/c2e02737f0cc423d95db9c3324f7215e/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:13.667882 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5a059-ae76-4a03-90d6-111b455fe419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e06f1a9b667414b8d663033c7053b76, user_id=c2e02737f0cc423d95db9c3324f7215e, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:13.671241 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5a059-ae76-4a03-90d6-111b455fe419 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:13.731527 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b0c38871-08c1-4259-b313-99cca07de0c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0f197bb8e664802b577b5837dcde546'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:13.745620 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b0c38871-08c1-4259-b313-99cca07de0c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0f197bb8e664802b577b5837dcde546'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:13.753187 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b0c38871-08c1-4259-b313-99cca07de0c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0f197bb8e664802b577b5837dcde546'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:13.760252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 993/1973] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:20:13 2022] DELETE /identity/v3/users/e0f197bb8e664802b577b5837dcde546 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:13.764208 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c38871-08c1-4259-b313-99cca07de0c3 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:13.766045 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-b0c38871-08c1-4259-b313-99cca07de0c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:13.799774 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 981/1974] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:13 2022] PUT /identity/v3/projects/9e06f1a9b667414b8d663033c7053b76/users/c2e02737f0cc423d95db9c3324f7215e/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:13.805224 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf8369-148a-4a2f-91a3-225d5994d4e7 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:13.805514 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf8369-148a-4a2f-91a3-225d5994d4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:13.805792 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf8369-148a-4a2f-91a3-225d5994d4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:13.819589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:13.827685 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-26cf8369-148a-4a2f-91a3-225d5994d4e7 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:13.829846 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-26cf8369-148a-4a2f-91a3-225d5994d4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:13.843756 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c38871-08c1-4259-b313-99cca07de0c3 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:13.910981 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 982/1975] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:20:13.917901 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7d543-e8a2-4341-b531-ff8ea5b21c66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:13.918999 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7d543-e8a2-4341-b531-ff8ea5b21c66 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:13.919473 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7d543-e8a2-4341-b531-ff8ea5b21c66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:13.919932 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7d543-e8a2-4341-b531-ff8ea5b21c66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:13.922305 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-a2f7d543-e8a2-4341-b531-ff8ea5b21c66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:13.923017 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf8369-148a-4a2f-91a3-225d5994d4e7 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:13.937423 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf8369-148a-4a2f-91a3-225d5994d4e7 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:13.938942 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7d543-e8a2-4341-b531-ff8ea5b21c66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:13.941294 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7d543-e8a2-4341-b531-ff8ea5b21c66 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:13.942507 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa2b46-12d1-4582-963e-5b34550b3006 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:13.943185 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa2b46-12d1-4582-963e-5b34550b3006 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:13.943507 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa2b46-12d1-4582-963e-5b34550b3006 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:13.943793 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa2b46-12d1-4582-963e-5b34550b3006 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:13.955660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 994/1976] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:13.973013 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fa2b46-12d1-4582-963e-5b34550b3006 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:13.974801 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fa2b46-12d1-4582-963e-5b34550b3006 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:13.992096 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 983/1977] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:20:14.276656 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7d543-e8a2-4341-b531-ff8ea5b21c66 service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:14.278598 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-a2f7d543-e8a2-4341-b531-ff8ea5b21c66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:14.299059 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7d543-e8a2-4341-b531-ff8ea5b21c66 service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:14.317123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb261ee-a04b-4ec1-83b8-dbc2a0db21b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:14.317974 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb261ee-a04b-4ec1-83b8-dbc2a0db21b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:14.318172 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb261ee-a04b-4ec1-83b8-dbc2a0db21b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:14.318454 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb261ee-a04b-4ec1-83b8-dbc2a0db21b2 admin admin] PATH_INFO: `/v3/projects/0b102b82e4b44cc09554659e53fbc0bb` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:14.321939 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb261ee-a04b-4ec1-83b8-dbc2a0db21b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b102b82e4b44cc09554659e53fbc0bb)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:14.328909 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb261ee-a04b-4ec1-83b8-dbc2a0db21b2 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:14.541541 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-2fb261ee-a04b-4ec1-83b8-dbc2a0db21b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b102b82e4b44cc09554659e53fbc0bb', 'request_id': 'req-2fb261ee-a04b-4ec1-83b8-dbc2a0db21b2'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:14.550334 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-2fb261ee-a04b-4ec1-83b8-dbc2a0db21b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b102b82e4b44cc09554659e53fbc0bb', 'request_id': 'req-2fb261ee-a04b-4ec1-83b8-dbc2a0db21b2'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:14.639155 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-2fb261ee-a04b-4ec1-83b8-dbc2a0db21b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b102b82e4b44cc09554659e53fbc0bb', 'request_id': 'req-2fb261ee-a04b-4ec1-83b8-dbc2a0db21b2'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:14.653194 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-2fb261ee-a04b-4ec1-83b8-dbc2a0db21b2 admin admin] The token cache is being invalidate because project 0b102b82e4b44cc09554659e53fbc0bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:20:14.653485 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-2fb261ee-a04b-4ec1-83b8-dbc2a0db21b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:14.654164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-2fb261ee-a04b-4ec1-83b8-dbc2a0db21b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:14.655768 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 995/1978] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:20:14 2022] DELETE /identity/v3/projects/0b102b82e4b44cc09554659e53fbc0bb => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:20:14.660948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef8c3a-56b5-4081-806a-ce696183b655 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:14.662091 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef8c3a-56b5-4081-806a-ce696183b655 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:14.662624 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef8c3a-56b5-4081-806a-ce696183b655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:14.684637 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-2cef8c3a-56b5-4081-806a-ce696183b655 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:14.684777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb261ee-a04b-4ec1-83b8-dbc2a0db21b2 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:14.686172 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-2fb261ee-a04b-4ec1-83b8-dbc2a0db21b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:14.686432 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-2cef8c3a-56b5-4081-806a-ce696183b655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:14.819292 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 984/1979] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:14.826711 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb261ee-a04b-4ec1-83b8-dbc2a0db21b2 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:14.828760 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48555b2c-f4ff-427a-b694-cc52f806ce66 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:14.829085 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48555b2c-f4ff-427a-b694-cc52f806ce66 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:14.829371 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48555b2c-f4ff-427a-b694-cc52f806ce66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:14.832804 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46769e4-b57d-4bc4-89d4-d30c805e6207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:14.833807 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46769e4-b57d-4bc4-89d4-d30c805e6207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:14.834953 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46769e4-b57d-4bc4-89d4-d30c805e6207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:14.834953 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46769e4-b57d-4bc4-89d4-d30c805e6207 admin admin] PATH_INFO: `/v3/projects/6a558e8d629e449c8a8de77ae607e356` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:14.838057 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46769e4-b57d-4bc4-89d4-d30c805e6207 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a558e8d629e449c8a8de77ae607e356)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:14.840067 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46769e4-b57d-4bc4-89d4-d30c805e6207 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:14.850482 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-48555b2c-f4ff-427a-b694-cc52f806ce66 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:14.851869 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-48555b2c-f4ff-427a-b694-cc52f806ce66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:14.860514 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 985/1980] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:14.865161 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48555b2c-f4ff-427a-b694-cc52f806ce66 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:14.869547 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:14.880410 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48555b2c-f4ff-427a-b694-cc52f806ce66 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:14.885482 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a984ed-7eca-498c-ae2f-56e6445786cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:14.886156 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a984ed-7eca-498c-ae2f-56e6445786cd admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:14.886437 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a984ed-7eca-498c-ae2f-56e6445786cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:14.886710 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a984ed-7eca-498c-ae2f-56e6445786cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:14.887451 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a984ed-7eca-498c-ae2f-56e6445786cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:20:14.887761 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a984ed-7eca-498c-ae2f-56e6445786cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:14.889453 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a984ed-7eca-498c-ae2f-56e6445786cd admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:14.905131 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 986/1981] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:20:14.909268 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a984ed-7eca-498c-ae2f-56e6445786cd admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:14.921423 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a984ed-7eca-498c-ae2f-56e6445786cd admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:14.931293 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631b69d-cfad-41cc-8aed-6e59ea6410e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:14.931293 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631b69d-cfad-41cc-8aed-6e59ea6410e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:14.931293 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631b69d-cfad-41cc-8aed-6e59ea6410e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:14.931293 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631b69d-cfad-41cc-8aed-6e59ea6410e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:14.931607 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631b69d-cfad-41cc-8aed-6e59ea6410e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:14.931847 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631b69d-cfad-41cc-8aed-6e59ea6410e7 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:14.964713 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b46769e4-b57d-4bc4-89d4-d30c805e6207 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a558e8d629e449c8a8de77ae607e356', 'request_id': 'req-b46769e4-b57d-4bc4-89d4-d30c805e6207'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:14.972435 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b46769e4-b57d-4bc4-89d4-d30c805e6207 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a558e8d629e449c8a8de77ae607e356', 'request_id': 'req-b46769e4-b57d-4bc4-89d4-d30c805e6207'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:15.028563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b46769e4-b57d-4bc4-89d4-d30c805e6207 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a558e8d629e449c8a8de77ae607e356', 'request_id': 'req-b46769e4-b57d-4bc4-89d4-d30c805e6207'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:15.041087 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 987/1982] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:14 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:15.042416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631b69d-cfad-41cc-8aed-6e59ea6410e7 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:15.051689 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b46769e4-b57d-4bc4-89d4-d30c805e6207 admin admin] The token cache is being invalidate because project 6a558e8d629e449c8a8de77ae607e356 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:20:15.052387 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b46769e4-b57d-4bc4-89d4-d30c805e6207 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:15.054623 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b46769e4-b57d-4bc4-89d4-d30c805e6207 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:15.062652 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 996/1983] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:20:14 2022] DELETE /identity/v3/projects/6a558e8d629e449c8a8de77ae607e356 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:15.064749 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46769e4-b57d-4bc4-89d4-d30c805e6207 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:15.068263 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-b46769e4-b57d-4bc4-89d4-d30c805e6207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:15.095586 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:15.152442 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631b69d-cfad-41cc-8aed-6e59ea6410e7 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:15.158237 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a49d9-cd93-4b43-8cd3-c6c18c6d33aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:15.160295 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a49d9-cd93-4b43-8cd3-c6c18c6d33aa admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:15.160653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a49d9-cd93-4b43-8cd3-c6c18c6d33aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:15.161061 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a49d9-cd93-4b43-8cd3-c6c18c6d33aa admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:15.162128 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a49d9-cd93-4b43-8cd3-c6c18c6d33aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:15.164113 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a49d9-cd93-4b43-8cd3-c6c18c6d33aa admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:15.164527 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46769e4-b57d-4bc4-89d4-d30c805e6207 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:15.170465 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a6ad0-28ca-4efb-b188-abbdf8684128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:15.171055 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a6ad0-28ca-4efb-b188-abbdf8684128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:15.171343 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a6ad0-28ca-4efb-b188-abbdf8684128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:15.171619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a6ad0-28ca-4efb-b188-abbdf8684128 admin admin] PATH_INFO: `/v3/users/5a843207764143da92e390c5981e0d00` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:15.172913 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a6ad0-28ca-4efb-b188-abbdf8684128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a843207764143da92e390c5981e0d00)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:15.175424 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a6ad0-28ca-4efb-b188-abbdf8684128 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:15.240429 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 988/1984] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:15 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:15.244852 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a49d9-cd93-4b43-8cd3-c6c18c6d33aa admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:15.246812 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-0c8a49d9-cd93-4b43-8cd3-c6c18c6d33aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:15.261251 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a49d9-cd93-4b43-8cd3-c6c18c6d33aa admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:15.270217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af930d3-b417-44c6-9fb0-beb6851ff33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:15.270969 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af930d3-b417-44c6-9fb0-beb6851ff33d admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:15.271394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af930d3-b417-44c6-9fb0-beb6851ff33d admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:15.271675 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af930d3-b417-44c6-9fb0-beb6851ff33d admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:15.272495 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af930d3-b417-44c6-9fb0-beb6851ff33d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:15.274213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af930d3-b417-44c6-9fb0-beb6851ff33d admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:15.291262 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 989/1985] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:15.297881 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af930d3-b417-44c6-9fb0-beb6851ff33d admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:15.308959 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af930d3-b417-44c6-9fb0-beb6851ff33d admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:15.313840 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe46574-d810-449b-b618-94474403a402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:15.315420 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe46574-d810-449b-b618-94474403a402 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:15.315420 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe46574-d810-449b-b618-94474403a402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:15.315420 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe46574-d810-449b-b618-94474403a402 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:15.316509 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe46574-d810-449b-b618-94474403a402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:15.318345 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe46574-d810-449b-b618-94474403a402 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:15.334205 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 990/1986] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:15.335104 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe46574-d810-449b-b618-94474403a402 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:15.345089 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe46574-d810-449b-b618-94474403a402 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:15.350107 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622130e1-9b1b-46ce-9ac3-b6911beb49c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:15.351015 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622130e1-9b1b-46ce-9ac3-b6911beb49c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:15.351305 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622130e1-9b1b-46ce-9ac3-b6911beb49c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:15.351588 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622130e1-9b1b-46ce-9ac3-b6911beb49c6 admin admin] PATH_INFO: `/v3/projects/169297ae35e347f8b6e3d9ab08455b96/users/c56b4e0df8ef4daeaab38c26accfe16d/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:15.372483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622130e1-9b1b-46ce-9ac3-b6911beb49c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=169297ae35e347f8b6e3d9ab08455b96, user_id=c56b4e0df8ef4daeaab38c26accfe16d, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:15.375228 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622130e1-9b1b-46ce-9ac3-b6911beb49c6 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:15.388792 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-e43a6ad0-28ca-4efb-b188-abbdf8684128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a843207764143da92e390c5981e0d00'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:15.389568 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-e43a6ad0-28ca-4efb-b188-abbdf8684128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a843207764143da92e390c5981e0d00'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:15.491371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-e43a6ad0-28ca-4efb-b188-abbdf8684128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a843207764143da92e390c5981e0d00'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:15.499957 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 991/1987] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:15 2022] PUT /identity/v3/projects/169297ae35e347f8b6e3d9ab08455b96/users/c56b4e0df8ef4daeaab38c26accfe16d/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:15.506415 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-e43a6ad0-28ca-4efb-b188-abbdf8684128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a843207764143da92e390c5981e0d00'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:15.511135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ad8f2-72fd-44af-89f5-74c9c1d88d34 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:15.511513 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ad8f2-72fd-44af-89f5-74c9c1d88d34 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:15.511697 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ad8f2-72fd-44af-89f5-74c9c1d88d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:15.514922 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-e43a6ad0-28ca-4efb-b188-abbdf8684128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a843207764143da92e390c5981e0d00'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:15.522779 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 997/1988] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:20:15 2022] DELETE /identity/v3/users/5a843207764143da92e390c5981e0d00 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:15.542275 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-c59ad8f2-72fd-44af-89f5-74c9c1d88d34 None None] MFA Rules not processed for user `c56b4e0df8ef4daeaab38c26accfe16d`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:15.543518 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-c59ad8f2-72fd-44af-89f5-74c9c1d88d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:15.637015 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 992/1989] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:20:15.641893 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a6ad0-28ca-4efb-b188-abbdf8684128 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:15.643869 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-e43a6ad0-28ca-4efb-b188-abbdf8684128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:15.700394 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:15.745834 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a6ad0-28ca-4efb-b188-abbdf8684128 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:15.750832 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca3937-79ba-412c-8104-9da93dedc66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:15.751584 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca3937-79ba-412c-8104-9da93dedc66d admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:15.751875 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca3937-79ba-412c-8104-9da93dedc66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:15.752147 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca3937-79ba-412c-8104-9da93dedc66d admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:15.752912 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ca3937-79ba-412c-8104-9da93dedc66d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:15.763859 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ca3937-79ba-412c-8104-9da93dedc66d admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:15.884027 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 998/1990] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:15 2022] POST /identity/v3/projects => generated 387 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:15.890638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ad8f2-72fd-44af-89f5-74c9c1d88d34 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:15.923981 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ad8f2-72fd-44af-89f5-74c9c1d88d34 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:16.015930 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:16.024570 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14ba08-a3c9-4edc-be95-25b5b2009d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:16.025710 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14ba08-a3c9-4edc-be95-25b5b2009d6a admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:16.026253 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14ba08-a3c9-4edc-be95-25b5b2009d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:16.026643 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14ba08-a3c9-4edc-be95-25b5b2009d6a admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:16.027503 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14ba08-a3c9-4edc-be95-25b5b2009d6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:16.030331 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14ba08-a3c9-4edc-be95-25b5b2009d6a admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:16.036114 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e623f-7c8e-4015-ba82-8ae2c34170c2 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:16.036413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e623f-7c8e-4015-ba82-8ae2c34170c2 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:16.036724 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e623f-7c8e-4015-ba82-8ae2c34170c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:16.076065 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-037e623f-7c8e-4015-ba82-8ae2c34170c2 None None] MFA Rules not processed for user `c2e02737f0cc423d95db9c3324f7215e`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:16.078323 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-037e623f-7c8e-4015-ba82-8ae2c34170c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:16.117342 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 993/1991] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:15 2022] POST /identity/v3/users => generated 300 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:16.118303 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14ba08-a3c9-4edc-be95-25b5b2009d6a admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:16.120060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-6c14ba08-a3c9-4edc-be95-25b5b2009d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:16.133733 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14ba08-a3c9-4edc-be95-25b5b2009d6a admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:16.141315 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed90def-1509-4001-b27d-6e235c1acdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:16.142250 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed90def-1509-4001-b27d-6e235c1acdb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:16.142535 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed90def-1509-4001-b27d-6e235c1acdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:16.142811 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed90def-1509-4001-b27d-6e235c1acdb4 admin admin] PATH_INFO: `/v3/users/464933f599c2458680e417c20f61e0dd` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:16.144582 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed90def-1509-4001-b27d-6e235c1acdb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=464933f599c2458680e417c20f61e0dd)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:16.146815 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed90def-1509-4001-b27d-6e235c1acdb4 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:16.204665 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 999/1992] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:16.205637 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e623f-7c8e-4015-ba82-8ae2c34170c2 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:16.208371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-037e623f-7c8e-4015-ba82-8ae2c34170c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:16.226101 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e623f-7c8e-4015-ba82-8ae2c34170c2 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:16.231579 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1a231-e8ad-4f77-bfa7-f3b7c81b9137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:16.232471 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1a231-e8ad-4f77-bfa7-f3b7c81b9137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:16.232757 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1a231-e8ad-4f77-bfa7-f3b7c81b9137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:16.233351 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1a231-e8ad-4f77-bfa7-f3b7c81b9137 admin admin] PATH_INFO: `/v3/projects/c0bc46f89ef346af8ed0568ced617ea0` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:16.234612 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1a231-e8ad-4f77-bfa7-f3b7c81b9137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0bc46f89ef346af8ed0568ced617ea0)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:16.236773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1a231-e8ad-4f77-bfa7-f3b7c81b9137 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:16.362603 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-2ed90def-1509-4001-b27d-6e235c1acdb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '464933f599c2458680e417c20f61e0dd'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:16.368490 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b7b1a231-e8ad-4f77-bfa7-f3b7c81b9137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0bc46f89ef346af8ed0568ced617ea0', 'request_id': 'req-b7b1a231-e8ad-4f77-bfa7-f3b7c81b9137'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:16.376648 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-2ed90def-1509-4001-b27d-6e235c1acdb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '464933f599c2458680e417c20f61e0dd'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:16.377796 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b7b1a231-e8ad-4f77-bfa7-f3b7c81b9137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0bc46f89ef346af8ed0568ced617ea0', 'request_id': 'req-b7b1a231-e8ad-4f77-bfa7-f3b7c81b9137'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:16.457043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-2ed90def-1509-4001-b27d-6e235c1acdb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '464933f599c2458680e417c20f61e0dd'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:16.457663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-2ed90def-1509-4001-b27d-6e235c1acdb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '464933f599c2458680e417c20f61e0dd'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:16.464999 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-2ed90def-1509-4001-b27d-6e235c1acdb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '464933f599c2458680e417c20f61e0dd'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:16.470897 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 994/1993] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:20:16 2022] DELETE /identity/v3/users/464933f599c2458680e417c20f61e0dd => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:16.471737 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed90def-1509-4001-b27d-6e235c1acdb4 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:16.473251 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-2ed90def-1509-4001-b27d-6e235c1acdb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:16.545538 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed90def-1509-4001-b27d-6e235c1acdb4 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:16.550243 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0bc8e-7c2c-4ba7-a4fd-f097373ba543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:16.551437 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0bc8e-7c2c-4ba7-a4fd-f097373ba543 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:16.551720 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0bc8e-7c2c-4ba7-a4fd-f097373ba543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:16.551997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0bc8e-7c2c-4ba7-a4fd-f097373ba543 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:16.552736 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0bc8e-7c2c-4ba7-a4fd-f097373ba543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:16.554385 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0bc8e-7c2c-4ba7-a4fd-f097373ba543 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:16.564275 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 995/1994] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:16.565291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0bc8e-7c2c-4ba7-a4fd-f097373ba543 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:16.567445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-ece0bc8e-7c2c-4ba7-a4fd-f097373ba543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:16.571219 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b7b1a231-e8ad-4f77-bfa7-f3b7c81b9137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0bc46f89ef346af8ed0568ced617ea0', 'request_id': 'req-b7b1a231-e8ad-4f77-bfa7-f3b7c81b9137'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:16.588237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b7b1a231-e8ad-4f77-bfa7-f3b7c81b9137 admin admin] The token cache is being invalidate because project c0bc46f89ef346af8ed0568ced617ea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:20:16.588237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b7b1a231-e8ad-4f77-bfa7-f3b7c81b9137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:16.588237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b7b1a231-e8ad-4f77-bfa7-f3b7c81b9137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:16.588237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1000/1995] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:20:16 2022] DELETE /identity/v3/projects/c0bc46f89ef346af8ed0568ced617ea0 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:16.588237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6885ee-ba5b-4224-bca6-fb6594819841 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:16.588674 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6885ee-ba5b-4224-bca6-fb6594819841 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:16.588674 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6885ee-ba5b-4224-bca6-fb6594819841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:16.606254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-eb6885ee-ba5b-4224-bca6-fb6594819841 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:16.607455 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-eb6885ee-ba5b-4224-bca6-fb6594819841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:16.615844 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1001/1996] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:16.616618 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6885ee-ba5b-4224-bca6-fb6594819841 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:16.617878 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-eb6885ee-ba5b-4224-bca6-fb6594819841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:16.627435 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0bc8e-7c2c-4ba7-a4fd-f097373ba543 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:16.630384 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6885ee-ba5b-4224-bca6-fb6594819841 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:16.631738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94957a08-8372-462c-82da-1a702bd8fa98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:16.632611 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94957a08-8372-462c-82da-1a702bd8fa98 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:16.632875 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94957a08-8372-462c-82da-1a702bd8fa98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:16.633158 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94957a08-8372-462c-82da-1a702bd8fa98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:16.634921 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-94957a08-8372-462c-82da-1a702bd8fa98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:16.635188 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b27703-e485-4531-a996-8281701fc417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:16.636076 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b27703-e485-4531-a996-8281701fc417 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:16.636357 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b27703-e485-4531-a996-8281701fc417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:16.636635 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b27703-e485-4531-a996-8281701fc417 admin admin] PATH_INFO: `/v3/projects/85b4a0b79d204e9d8ccff86e96462873/users/440788e144c34bb3bf125a6940c2c177/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:16.652016 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b27703-e485-4531-a996-8281701fc417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85b4a0b79d204e9d8ccff86e96462873, user_id=440788e144c34bb3bf125a6940c2c177, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:16.654732 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b27703-e485-4531-a996-8281701fc417 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:16.657972 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:16.679677 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:16.697851 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94957a08-8372-462c-82da-1a702bd8fa98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:16.699334 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94957a08-8372-462c-82da-1a702bd8fa98 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:16.708534 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 996/1997] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:16.709821 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389786e5-ce36-44a2-87a6-cac9dda931ad None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:16.710170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389786e5-ce36-44a2-87a6-cac9dda931ad None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:16.714617 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389786e5-ce36-44a2-87a6-cac9dda931ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:16.728264 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-389786e5-ce36-44a2-87a6-cac9dda931ad None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:16.729619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-389786e5-ce36-44a2-87a6-cac9dda931ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:16.739940 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1002/1998] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:16 2022] PUT /identity/v3/projects/85b4a0b79d204e9d8ccff86e96462873/users/440788e144c34bb3bf125a6940c2c177/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:16.741888 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b27703-e485-4531-a996-8281701fc417 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:16.746073 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-e8b27703-e485-4531-a996-8281701fc417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:16.850499 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 997/1999] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:16.852172 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389786e5-ce36-44a2-87a6-cac9dda931ad None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:16.858483 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b27703-e485-4531-a996-8281701fc417 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:16.862829 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b777a-2944-4c1b-bb5d-8d13c68f1f57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:16.868508 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b777a-2944-4c1b-bb5d-8d13c68f1f57 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:16.869143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b777a-2944-4c1b-bb5d-8d13c68f1f57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:16.869702 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b777a-2944-4c1b-bb5d-8d13c68f1f57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:16.870506 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389786e5-ce36-44a2-87a6-cac9dda931ad None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:16.877875 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff99c0b-0d5a-4ee5-aba8-23b8b5db5090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:16.878613 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff99c0b-0d5a-4ee5-aba8-23b8b5db5090 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:16.882980 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff99c0b-0d5a-4ee5-aba8-23b8b5db5090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:16.882980 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff99c0b-0d5a-4ee5-aba8-23b8b5db5090 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:16.882980 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff99c0b-0d5a-4ee5-aba8-23b8b5db5090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:16.883421 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b777a-2944-4c1b-bb5d-8d13c68f1f57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:16.883503 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff99c0b-0d5a-4ee5-aba8-23b8b5db5090 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:16.883576 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b777a-2944-4c1b-bb5d-8d13c68f1f57 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:16.894272 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1003/2000] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:16.896015 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d653bc-433d-41f8-8e8e-4e46332bec0e None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:16.896379 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d653bc-433d-41f8-8e8e-4e46332bec0e None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:16.896760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d653bc-433d-41f8-8e8e-4e46332bec0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:16.900908 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 998/2001] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:16.902345 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff99c0b-0d5a-4ee5-aba8-23b8b5db5090 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:16.913554 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff99c0b-0d5a-4ee5-aba8-23b8b5db5090 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:16.917188 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-82d653bc-433d-41f8-8e8e-4e46332bec0e None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:16.918475 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-82d653bc-433d-41f8-8e8e-4e46332bec0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:16.919296 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e550538-2884-45cf-a327-26a8c1e2ca56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:16.920267 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e550538-2884-45cf-a327-26a8c1e2ca56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:16.920558 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e550538-2884-45cf-a327-26a8c1e2ca56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:16.922382 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e550538-2884-45cf-a327-26a8c1e2ca56 admin admin] PATH_INFO: `/v3/projects/85b4a0b79d204e9d8ccff86e96462873/users/440788e144c34bb3bf125a6940c2c177/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:16.929451 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1004/2002] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:16.932345 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e550538-2884-45cf-a327-26a8c1e2ca56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85b4a0b79d204e9d8ccff86e96462873, user_id=440788e144c34bb3bf125a6940c2c177, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:16.933689 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d653bc-433d-41f8-8e8e-4e46332bec0e None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:16.938270 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e550538-2884-45cf-a327-26a8c1e2ca56 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:16.943193 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d653bc-433d-41f8-8e8e-4e46332bec0e None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:16.950112 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 999/2003] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:16 2022] PUT /identity/v3/projects/85b4a0b79d204e9d8ccff86e96462873/users/440788e144c34bb3bf125a6940c2c177/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:16.961504 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436e44c-08c9-4088-aa6c-1688711e1308 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:16.961802 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436e44c-08c9-4088-aa6c-1688711e1308 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:16.962108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436e44c-08c9-4088-aa6c-1688711e1308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:16.994634 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-9436e44c-08c9-4088-aa6c-1688711e1308 None None] MFA Rules not processed for user `440788e144c34bb3bf125a6940c2c177`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:16.996540 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-9436e44c-08c9-4088-aa6c-1688711e1308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:17.024058 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68985e1a-1336-4a66-82e9-1fb8e5b8ca6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:17.024794 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68985e1a-1336-4a66-82e9-1fb8e5b8ca6c admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:17.025115 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68985e1a-1336-4a66-82e9-1fb8e5b8ca6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:17.025398 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68985e1a-1336-4a66-82e9-1fb8e5b8ca6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:17.026145 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68985e1a-1336-4a66-82e9-1fb8e5b8ca6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:20:17.026460 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68985e1a-1336-4a66-82e9-1fb8e5b8ca6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:17.028368 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68985e1a-1336-4a66-82e9-1fb8e5b8ca6c admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:17.042797 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1005/2004] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:20:17.055000 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68985e1a-1336-4a66-82e9-1fb8e5b8ca6c admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:17.073432 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68985e1a-1336-4a66-82e9-1fb8e5b8ca6c admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:17.078498 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08e6af-cf8c-43df-afba-a496fe1951e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:17.079199 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08e6af-cf8c-43df-afba-a496fe1951e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:17.079539 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08e6af-cf8c-43df-afba-a496fe1951e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:17.079779 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08e6af-cf8c-43df-afba-a496fe1951e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:17.080658 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08e6af-cf8c-43df-afba-a496fe1951e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:17.082647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08e6af-cf8c-43df-afba-a496fe1951e4 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:17.094005 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1000/2005] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:20:17.113749 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436e44c-08c9-4088-aa6c-1688711e1308 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:17.115240 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-9436e44c-08c9-4088-aa6c-1688711e1308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:17.179724 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436e44c-08c9-4088-aa6c-1688711e1308 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:17.184004 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37543054-f62c-482b-941d-4be4c4bd485b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:17.184671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37543054-f62c-482b-941d-4be4c4bd485b service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:17.184982 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37543054-f62c-482b-941d-4be4c4bd485b service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:17.185256 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37543054-f62c-482b-941d-4be4c4bd485b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:17.197806 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1006/2006] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:17 2022] POST /identity/v3/projects => generated 409 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:17.201464 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08e6af-cf8c-43df-afba-a496fe1951e4 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:17.219282 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37543054-f62c-482b-941d-4be4c4bd485b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:17.220843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37543054-f62c-482b-941d-4be4c4bd485b service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:17.234372 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1001/2007] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:17.290283 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08e6af-cf8c-43df-afba-a496fe1951e4 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:17.295361 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3add976-0a6f-41cd-aa6e-7900f8a7583f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:17.295949 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3add976-0a6f-41cd-aa6e-7900f8a7583f admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:17.296234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3add976-0a6f-41cd-aa6e-7900f8a7583f admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:17.296517 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3add976-0a6f-41cd-aa6e-7900f8a7583f admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:17.299297 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3add976-0a6f-41cd-aa6e-7900f8a7583f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:17.299674 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3add976-0a6f-41cd-aa6e-7900f8a7583f admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:17.308295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:17.319235 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:17.389236 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1007/2008] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:17 2022] POST /identity/v3/users => generated 305 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:17.393891 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37543054-f62c-482b-941d-4be4c4bd485b service cinder] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:17.405552 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37543054-f62c-482b-941d-4be4c4bd485b service cinder] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:17.410974 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cf436-0a4d-4251-8ff5-cd4b50c23117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:17.411650 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cf436-0a4d-4251-8ff5-cd4b50c23117 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:17.411933 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cf436-0a4d-4251-8ff5-cd4b50c23117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:17.412231 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cf436-0a4d-4251-8ff5-cd4b50c23117 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:17.413012 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759cf436-0a4d-4251-8ff5-cd4b50c23117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:17.414712 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759cf436-0a4d-4251-8ff5-cd4b50c23117 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:17.425066 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1002/2009] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:17.429168 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3add976-0a6f-41cd-aa6e-7900f8a7583f admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:17.439156 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3add976-0a6f-41cd-aa6e-7900f8a7583f admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:17.443780 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd420990-6e6c-4f94-8f6b-da977be1cf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:17.444433 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd420990-6e6c-4f94-8f6b-da977be1cf88 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:17.444739 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd420990-6e6c-4f94-8f6b-da977be1cf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:17.445037 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd420990-6e6c-4f94-8f6b-da977be1cf88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:17.445790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd420990-6e6c-4f94-8f6b-da977be1cf88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:17.447420 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd420990-6e6c-4f94-8f6b-da977be1cf88 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:17.457744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1008/2010] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:17.461877 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cf436-0a4d-4251-8ff5-cd4b50c23117 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:17.472109 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cf436-0a4d-4251-8ff5-cd4b50c23117 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:17.477453 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7738235-bdf6-4647-a268-29431cc46574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:17.481046 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7738235-bdf6-4647-a268-29431cc46574 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:17.481343 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7738235-bdf6-4647-a268-29431cc46574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:17.481665 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7738235-bdf6-4647-a268-29431cc46574 admin admin] PATH_INFO: `/v3/projects/644e43f453a54b108b796a64b536065f/users/dd0acf5ba82f4ef190a5ca49ff91afbc/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:17.499313 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7738235-bdf6-4647-a268-29431cc46574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=644e43f453a54b108b796a64b536065f, user_id=dd0acf5ba82f4ef190a5ca49ff91afbc, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:17.502365 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7738235-bdf6-4647-a268-29431cc46574 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:17.545817 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd420990-6e6c-4f94-8f6b-da977be1cf88 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:17.548324 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-fd420990-6e6c-4f94-8f6b-da977be1cf88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:17.564176 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd420990-6e6c-4f94-8f6b-da977be1cf88 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:17.572300 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb2c0e9-72f3-49ec-9704-1303688cebe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:17.573915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2c0e9-72f3-49ec-9704-1303688cebe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:17.574114 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2c0e9-72f3-49ec-9704-1303688cebe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:17.580334 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2c0e9-72f3-49ec-9704-1303688cebe6 admin admin] PATH_INFO: `/v3/projects/8b3c0155041a4eb59e42497aeda86c91` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:17.583388 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb2c0e9-72f3-49ec-9704-1303688cebe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b3c0155041a4eb59e42497aeda86c91)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:17.585545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb2c0e9-72f3-49ec-9704-1303688cebe6 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:17.625140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1003/2011] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:17 2022] PUT /identity/v3/projects/644e43f453a54b108b796a64b536065f/users/dd0acf5ba82f4ef190a5ca49ff91afbc/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:17.636296 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d5a62-6aca-44a1-80f8-70952c1540bd None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:17.636597 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d5a62-6aca-44a1-80f8-70952c1540bd None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:17.637201 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d5a62-6aca-44a1-80f8-70952c1540bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:17.670872 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-544d5a62-6aca-44a1-80f8-70952c1540bd None None] MFA Rules not processed for user `dd0acf5ba82f4ef190a5ca49ff91afbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:17.672732 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-544d5a62-6aca-44a1-80f8-70952c1540bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:17.778431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1004/2012] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:17 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:20:17.783173 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d5a62-6aca-44a1-80f8-70952c1540bd None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:17.793922 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-0fb2c0e9-72f3-49ec-9704-1303688cebe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b3c0155041a4eb59e42497aeda86c91', 'request_id': 'req-0fb2c0e9-72f3-49ec-9704-1303688cebe6'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:17.802851 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-0fb2c0e9-72f3-49ec-9704-1303688cebe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b3c0155041a4eb59e42497aeda86c91', 'request_id': 'req-0fb2c0e9-72f3-49ec-9704-1303688cebe6'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:17.857470 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d5a62-6aca-44a1-80f8-70952c1540bd None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:17.870286 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:17.902663 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-0fb2c0e9-72f3-49ec-9704-1303688cebe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b3c0155041a4eb59e42497aeda86c91', 'request_id': 'req-0fb2c0e9-72f3-49ec-9704-1303688cebe6'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:17.915345 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-0fb2c0e9-72f3-49ec-9704-1303688cebe6 admin admin] The token cache is being invalidate because project 8b3c0155041a4eb59e42497aeda86c91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:20:17.915630 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-0fb2c0e9-72f3-49ec-9704-1303688cebe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:17.916649 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-0fb2c0e9-72f3-49ec-9704-1303688cebe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:17.917650 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a90c44-09d4-474d-ac4e-11794788759e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:17.918263 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1009/2013] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:20:17 2022] DELETE /identity/v3/projects/8b3c0155041a4eb59e42497aeda86c91 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:17.918394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a90c44-09d4-474d-ac4e-11794788759e admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:17.918817 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a90c44-09d4-474d-ac4e-11794788759e admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:17.919104 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a90c44-09d4-474d-ac4e-11794788759e admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:17.919855 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a90c44-09d4-474d-ac4e-11794788759e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:17.921876 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a90c44-09d4-474d-ac4e-11794788759e admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:17.922242 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb2c0e9-72f3-49ec-9704-1303688cebe6 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:17.923566 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-0fb2c0e9-72f3-49ec-9704-1303688cebe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:17.937246 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb2c0e9-72f3-49ec-9704-1303688cebe6 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:17.947807 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328988d-bd24-48c5-ae38-bbf5b20ac00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:17.948690 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328988d-bd24-48c5-ae38-bbf5b20ac00e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:17.949049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328988d-bd24-48c5-ae38-bbf5b20ac00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:17.949365 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328988d-bd24-48c5-ae38-bbf5b20ac00e admin admin] PATH_INFO: `/v3/users/6f49cf50e2b544328c019fbf10c163b6` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:17.950679 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328988d-bd24-48c5-ae38-bbf5b20ac00e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f49cf50e2b544328c019fbf10c163b6)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:17.952925 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328988d-bd24-48c5-ae38-bbf5b20ac00e admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:18.001627 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1005/2014] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:17 2022] POST /identity/v3/projects => generated 407 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:18.007285 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a90c44-09d4-474d-ac4e-11794788759e admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:18.009458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-a1a90c44-09d4-474d-ac4e-11794788759e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:18.078562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a90c44-09d4-474d-ac4e-11794788759e admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:18.083582 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afeee30-55d5-44e5-9572-904516f39ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:18.084329 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afeee30-55d5-44e5-9572-904516f39ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:18.084612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afeee30-55d5-44e5-9572-904516f39ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:18.084923 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afeee30-55d5-44e5-9572-904516f39ba9 admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:18.085625 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afeee30-55d5-44e5-9572-904516f39ba9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:18.087575 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afeee30-55d5-44e5-9572-904516f39ba9 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:18.135333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-e328988d-bd24-48c5-ae38-bbf5b20ac00e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f49cf50e2b544328c019fbf10c163b6'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:18.136011 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-e328988d-bd24-48c5-ae38-bbf5b20ac00e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f49cf50e2b544328c019fbf10c163b6'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:18.149388 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1006/2015] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:18 2022] POST /identity/v3/users => generated 310 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:20:18.156162 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afeee30-55d5-44e5-9572-904516f39ba9 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:18.156162 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-7afeee30-55d5-44e5-9572-904516f39ba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:18.167056 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afeee30-55d5-44e5-9572-904516f39ba9 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:18.171865 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7056d1-a6c1-46ed-a888-e08723136c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:18.172530 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7056d1-a6c1-46ed-a888-e08723136c00 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:18.172925 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7056d1-a6c1-46ed-a888-e08723136c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:18.173231 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7056d1-a6c1-46ed-a888-e08723136c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:18.174007 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7056d1-a6c1-46ed-a888-e08723136c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:18.176181 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7056d1-a6c1-46ed-a888-e08723136c00 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:18.186374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1007/2016] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:20:18.190503 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7056d1-a6c1-46ed-a888-e08723136c00 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:18.201492 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7056d1-a6c1-46ed-a888-e08723136c00 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:18.206431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c11d2-bf1d-44d6-bec6-6dfa9e42ddde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:18.207359 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c11d2-bf1d-44d6-bec6-6dfa9e42ddde admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:18.207646 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c11d2-bf1d-44d6-bec6-6dfa9e42ddde admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:18.207927 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c11d2-bf1d-44d6-bec6-6dfa9e42ddde admin admin] PATH_INFO: `/v3/projects/8b889b4d757844948c95bed8c1b59862/users/7519f1c19cd34f619e7c0eb1777b03a8/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:18.222393 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-e328988d-bd24-48c5-ae38-bbf5b20ac00e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f49cf50e2b544328c019fbf10c163b6'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:18.224726 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c11d2-bf1d-44d6-bec6-6dfa9e42ddde admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b889b4d757844948c95bed8c1b59862, user_id=7519f1c19cd34f619e7c0eb1777b03a8, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:18.227593 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c11d2-bf1d-44d6-bec6-6dfa9e42ddde admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:18.237651 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-e328988d-bd24-48c5-ae38-bbf5b20ac00e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f49cf50e2b544328c019fbf10c163b6'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:18.245372 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-e328988d-bd24-48c5-ae38-bbf5b20ac00e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f49cf50e2b544328c019fbf10c163b6'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:18.251673 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1010/2017] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:20:17 2022] DELETE /identity/v3/users/6f49cf50e2b544328c019fbf10c163b6 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:20:18.315710 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1008/2018] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:18 2022] PUT /identity/v3/projects/8b889b4d757844948c95bed8c1b59862/users/7519f1c19cd34f619e7c0eb1777b03a8/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:20:18.319629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328988d-bd24-48c5-ae38-bbf5b20ac00e admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:18.361343 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:INSERT=3,keystone:SELECT=80,keystone:DELETE=17 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:18.383266 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328988d-bd24-48c5-ae38-bbf5b20ac00e admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:18.448924 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d389e-93e3-4988-a9ca-10e37ef118a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:18.449613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d389e-93e3-4988-a9ca-10e37ef118a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:18.449926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d389e-93e3-4988-a9ca-10e37ef118a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:18.450208 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d389e-93e3-4988-a9ca-10e37ef118a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:18.450946 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d389e-93e3-4988-a9ca-10e37ef118a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:18.452713 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d389e-93e3-4988-a9ca-10e37ef118a6 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:18.466773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1011/2019] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:18.467775 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c11d2-bf1d-44d6-bec6-6dfa9e42ddde admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:18.478954 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c11d2-bf1d-44d6-bec6-6dfa9e42ddde admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:18.484761 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bd451-cb15-4f5a-96d2-16a148eada76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:18.485719 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bd451-cb15-4f5a-96d2-16a148eada76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:18.486003 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bd451-cb15-4f5a-96d2-16a148eada76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:18.486279 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bd451-cb15-4f5a-96d2-16a148eada76 admin admin] PATH_INFO: `/v3/projects/8b889b4d757844948c95bed8c1b59862/users/7519f1c19cd34f619e7c0eb1777b03a8/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:18.488328 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bd451-cb15-4f5a-96d2-16a148eada76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b889b4d757844948c95bed8c1b59862, user_id=7519f1c19cd34f619e7c0eb1777b03a8, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:18.491117 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bd451-cb15-4f5a-96d2-16a148eada76 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:18.510311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1009/2020] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:18 2022] PUT /identity/v3/projects/8b889b4d757844948c95bed8c1b59862/users/7519f1c19cd34f619e7c0eb1777b03a8/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:20:18.514567 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1fa93-cf66-407c-9382-202cee90c568 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:18.514854 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1fa93-cf66-407c-9382-202cee90c568 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:18.515135 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1fa93-cf66-407c-9382-202cee90c568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:18.547747 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-7ba1fa93-cf66-407c-9382-202cee90c568 None None] MFA Rules not processed for user `7519f1c19cd34f619e7c0eb1777b03a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:18.549302 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-7ba1fa93-cf66-407c-9382-202cee90c568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:18.612623 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bd451-cb15-4f5a-96d2-16a148eada76 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:18.615080 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-9d3bd451-cb15-4f5a-96d2-16a148eada76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:18.659007 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1012/2021] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:18 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:18.666737 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1fa93-cf66-407c-9382-202cee90c568 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:18.668156 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-7ba1fa93-cf66-407c-9382-202cee90c568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:18.696303 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:18.716339 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bd451-cb15-4f5a-96d2-16a148eada76 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:18.721089 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5b9a8-5add-4d39-803c-0bc896e5b509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:18.721965 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5b9a8-5add-4d39-803c-0bc896e5b509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:18.722248 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5b9a8-5add-4d39-803c-0bc896e5b509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:18.722525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5b9a8-5add-4d39-803c-0bc896e5b509 admin admin] PATH_INFO: `/v3/users/c56b4e0df8ef4daeaab38c26accfe16d` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:18.723732 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5b9a8-5add-4d39-803c-0bc896e5b509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c56b4e0df8ef4daeaab38c26accfe16d)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:18.725707 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5b9a8-5add-4d39-803c-0bc896e5b509 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:18.730272 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1fa93-cf66-407c-9382-202cee90c568 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:18.734378 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae4311-eb6e-4584-bd82-4bfb26dfdbda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:18.735040 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae4311-eb6e-4584-bd82-4bfb26dfdbda service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:18.735376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae4311-eb6e-4584-bd82-4bfb26dfdbda service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:18.735602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae4311-eb6e-4584-bd82-4bfb26dfdbda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:18.745944 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae4311-eb6e-4584-bd82-4bfb26dfdbda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:18.747402 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae4311-eb6e-4584-bd82-4bfb26dfdbda service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:18.757892 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1013/2022] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:18 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:20:18.813112 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae4311-eb6e-4584-bd82-4bfb26dfdbda service cinder] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:18.814514 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-6eae4311-eb6e-4584-bd82-4bfb26dfdbda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:18.830869 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae4311-eb6e-4584-bd82-4bfb26dfdbda service cinder] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:18.836966 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9d223-27b7-4496-a9f6-9de826cf21c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:18.838148 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9d223-27b7-4496-a9f6-9de826cf21c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:18.838509 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9d223-27b7-4496-a9f6-9de826cf21c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:18.839071 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9d223-27b7-4496-a9f6-9de826cf21c2 admin admin] PATH_INFO: `/v3/projects/fd98b602f8ff45d4949ed5948e8b00ef` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:18.840489 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9d223-27b7-4496-a9f6-9de826cf21c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd98b602f8ff45d4949ed5948e8b00ef)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:18.842680 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9d223-27b7-4496-a9f6-9de826cf21c2 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:18.934878 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-20a5b9a8-5add-4d39-803c-0bc896e5b509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c56b4e0df8ef4daeaab38c26accfe16d'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:18.950118 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-20a5b9a8-5add-4d39-803c-0bc896e5b509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c56b4e0df8ef4daeaab38c26accfe16d'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:18.967777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-aec9d223-27b7-4496-a9f6-9de826cf21c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd98b602f8ff45d4949ed5948e8b00ef', 'request_id': 'req-aec9d223-27b7-4496-a9f6-9de826cf21c2'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:18.973463 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-aec9d223-27b7-4496-a9f6-9de826cf21c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd98b602f8ff45d4949ed5948e8b00ef', 'request_id': 'req-aec9d223-27b7-4496-a9f6-9de826cf21c2'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:18.977264 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:19.052782 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-20a5b9a8-5add-4d39-803c-0bc896e5b509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c56b4e0df8ef4daeaab38c26accfe16d'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:19.053441 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-20a5b9a8-5add-4d39-803c-0bc896e5b509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c56b4e0df8ef4daeaab38c26accfe16d'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:19.061183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-20a5b9a8-5add-4d39-803c-0bc896e5b509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c56b4e0df8ef4daeaab38c26accfe16d'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:19.067141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1010/2023] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:20:18 2022] DELETE /identity/v3/users/c56b4e0df8ef4daeaab38c26accfe16d => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:19.071713 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e95ee-4630-4ec4-88db-46831b967691 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:19.072003 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e95ee-4630-4ec4-88db-46831b967691 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:19.072286 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e95ee-4630-4ec4-88db-46831b967691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:19.088730 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-272e95ee-4630-4ec4-88db-46831b967691 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:19.089960 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-272e95ee-4630-4ec4-88db-46831b967691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:19.148667 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1011/2024] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:20:19.154559 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-aec9d223-27b7-4496-a9f6-9de826cf21c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd98b602f8ff45d4949ed5948e8b00ef', 'request_id': 'req-aec9d223-27b7-4496-a9f6-9de826cf21c2'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:19.164860 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e95ee-4630-4ec4-88db-46831b967691 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:19.166305 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-272e95ee-4630-4ec4-88db-46831b967691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:19.168417 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-aec9d223-27b7-4496-a9f6-9de826cf21c2 admin admin] The token cache is being invalidate because project fd98b602f8ff45d4949ed5948e8b00ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:20:19.168705 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-aec9d223-27b7-4496-a9f6-9de826cf21c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:19.169448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-aec9d223-27b7-4496-a9f6-9de826cf21c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:19.171014 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1014/2025] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:20:18 2022] DELETE /identity/v3/projects/fd98b602f8ff45d4949ed5948e8b00ef => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:20:19.171768 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9d223-27b7-4496-a9f6-9de826cf21c2 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:19.173429 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-aec9d223-27b7-4496-a9f6-9de826cf21c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:19.230253 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e95ee-4630-4ec4-88db-46831b967691 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:19.234735 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20085b92-4d5e-48ee-aa12-a9278427d6ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:19.235416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20085b92-4d5e-48ee-aa12-a9278427d6ed service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:19.235695 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20085b92-4d5e-48ee-aa12-a9278427d6ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:19.235972 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20085b92-4d5e-48ee-aa12-a9278427d6ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:19.241032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-20085b92-4d5e-48ee-aa12-a9278427d6ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:19.253735 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9d223-27b7-4496-a9f6-9de826cf21c2 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:19.255480 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20085b92-4d5e-48ee-aa12-a9278427d6ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:19.257078 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20085b92-4d5e-48ee-aa12-a9278427d6ed service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:19.268140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1012/2026] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:20:19.269473 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536c583-caa0-4615-acbd-d97b2e851ecb None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:19.269763 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536c583-caa0-4615-acbd-d97b2e851ecb None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:19.270107 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536c583-caa0-4615-acbd-d97b2e851ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:19.279015 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:19.292979 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-7536c583-caa0-4615-acbd-d97b2e851ecb None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:19.294254 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-7536c583-caa0-4615-acbd-d97b2e851ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:19.304664 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1013/2027] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:19.313271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1762a6-b1e5-4cde-a8a9-082cea39b57d None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:19.313617 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1762a6-b1e5-4cde-a8a9-082cea39b57d None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:19.314034 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1762a6-b1e5-4cde-a8a9-082cea39b57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:19.323930 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98b31d-fdd2-41d2-a2bd-c5d6443c136b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:19.325091 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98b31d-fdd2-41d2-a2bd-c5d6443c136b service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:19.325207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98b31d-fdd2-41d2-a2bd-c5d6443c136b service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:19.325540 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98b31d-fdd2-41d2-a2bd-c5d6443c136b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:19.328085 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-bb98b31d-fdd2-41d2-a2bd-c5d6443c136b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:19.333169 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-df1762a6-b1e5-4cde-a8a9-082cea39b57d None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:19.334483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-df1762a6-b1e5-4cde-a8a9-082cea39b57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:19.347580 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1014/2028] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:19.349914 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1762a6-b1e5-4cde-a8a9-082cea39b57d None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:19.360918 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1762a6-b1e5-4cde-a8a9-082cea39b57d None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:19.367717 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cba166-d9e4-4ca3-ade8-6ab9ec07d979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:19.368509 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cba166-d9e4-4ca3-ade8-6ab9ec07d979 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:19.368724 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cba166-d9e4-4ca3-ade8-6ab9ec07d979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:19.369401 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cba166-d9e4-4ca3-ade8-6ab9ec07d979 admin admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:19.370241 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cba166-d9e4-4ca3-ade8-6ab9ec07d979 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:20:19.370553 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cba166-d9e4-4ca3-ade8-6ab9ec07d979 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:19.372320 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cba166-d9e4-4ca3-ade8-6ab9ec07d979 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:19.387519 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1015/2029] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:20:19.395164 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cba166-d9e4-4ca3-ade8-6ab9ec07d979 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:19.406492 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cba166-d9e4-4ca3-ade8-6ab9ec07d979 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:19.413744 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1e0d3-ef48-4536-afcc-4acce3da7052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:19.414406 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1e0d3-ef48-4536-afcc-4acce3da7052 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:19.414688 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1e0d3-ef48-4536-afcc-4acce3da7052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:19.414975 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1e0d3-ef48-4536-afcc-4acce3da7052 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:19.415678 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1e0d3-ef48-4536-afcc-4acce3da7052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:19.415927 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98b31d-fdd2-41d2-a2bd-c5d6443c136b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:19.417630 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1e0d3-ef48-4536-afcc-4acce3da7052 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:19.417768 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98b31d-fdd2-41d2-a2bd-c5d6443c136b service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:19.427678 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1015/2030] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:19 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:19.497415 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1016/2031] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:19 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:19.498529 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98b31d-fdd2-41d2-a2bd-c5d6443c136b service cinder] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:19.506875 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:19.512433 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98b31d-fdd2-41d2-a2bd-c5d6443c136b service cinder] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:19.582009 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721085c1-eb7b-4941-9bc1-500ac6a35205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:19.583600 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721085c1-eb7b-4941-9bc1-500ac6a35205 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:19.584173 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721085c1-eb7b-4941-9bc1-500ac6a35205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:19.584629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721085c1-eb7b-4941-9bc1-500ac6a35205 admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:19.585562 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721085c1-eb7b-4941-9bc1-500ac6a35205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:19.588264 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721085c1-eb7b-4941-9bc1-500ac6a35205 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:19.693978 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7babc-5c3c-4d74-a4b6-ff15ab5126ee None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:19.694269 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7babc-5c3c-4d74-a4b6-ff15ab5126ee None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:19.694555 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7babc-5c3c-4d74-a4b6-ff15ab5126ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:19.712285 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-7cb7babc-5c3c-4d74-a4b6-ff15ab5126ee None None] MFA Rules not processed for user `c2e02737f0cc423d95db9c3324f7215e`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:19.713545 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-7cb7babc-5c3c-4d74-a4b6-ff15ab5126ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:19.719868 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1016/2032] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:19 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:19.721734 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721085c1-eb7b-4941-9bc1-500ac6a35205 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:19.735352 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721085c1-eb7b-4941-9bc1-500ac6a35205 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:19.740161 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7c5e3-618b-46d7-ac0c-adeffe52343b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:19.740765 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7c5e3-618b-46d7-ac0c-adeffe52343b admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:19.741250 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7c5e3-618b-46d7-ac0c-adeffe52343b admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:19.741532 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7c5e3-618b-46d7-ac0c-adeffe52343b admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:19.742265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7c5e3-618b-46d7-ac0c-adeffe52343b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:19.743937 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7c5e3-618b-46d7-ac0c-adeffe52343b admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:19.754260 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1017/2033] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:19.758083 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7c5e3-618b-46d7-ac0c-adeffe52343b admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:19.768336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7c5e3-618b-46d7-ac0c-adeffe52343b admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:19.773703 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e1310-2209-493c-bbf9-adee7eb07f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:19.774388 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e1310-2209-493c-bbf9-adee7eb07f84 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:19.774670 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e1310-2209-493c-bbf9-adee7eb07f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:19.774945 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e1310-2209-493c-bbf9-adee7eb07f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:19.775738 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e1310-2209-493c-bbf9-adee7eb07f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:19.776530 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1017/2034] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:20:19.777320 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7babc-5c3c-4d74-a4b6-ff15ab5126ee None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:19.778671 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e1310-2209-493c-bbf9-adee7eb07f84 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:19.782177 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-7cb7babc-5c3c-4d74-a4b6-ff15ab5126ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:19.794389 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1018/2035] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:20:19.798624 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e1310-2209-493c-bbf9-adee7eb07f84 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:19.809105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7babc-5c3c-4d74-a4b6-ff15ab5126ee None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:19.809963 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e1310-2209-493c-bbf9-adee7eb07f84 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:19.817196 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0dfca-48b1-47cd-bb48-1fd5599ee08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:19.818186 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0dfca-48b1-47cd-bb48-1fd5599ee08e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:19.818542 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0dfca-48b1-47cd-bb48-1fd5599ee08e admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:19.818891 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0dfca-48b1-47cd-bb48-1fd5599ee08e admin admin] PATH_INFO: `/v3/projects/169297ae35e347f8b6e3d9ab08455b96` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:19.820173 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979fb11-7f6f-4492-988e-dddc3471b4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:19.820615 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0dfca-48b1-47cd-bb48-1fd5599ee08e admin admin] RBAC: Authorizing `identity:delete_project(project_id=169297ae35e347f8b6e3d9ab08455b96)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:19.821182 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979fb11-7f6f-4492-988e-dddc3471b4c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:19.823313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979fb11-7f6f-4492-988e-dddc3471b4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:19.823313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979fb11-7f6f-4492-988e-dddc3471b4c1 admin admin] PATH_INFO: `/v3/projects/df01d1280c0a4ff4972392ee479e9772/users/3306e7d5f78e40fe9a2f87dc7dccb295/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:19.823538 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0dfca-48b1-47cd-bb48-1fd5599ee08e admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:19.840233 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979fb11-7f6f-4492-988e-dddc3471b4c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df01d1280c0a4ff4972392ee479e9772, user_id=3306e7d5f78e40fe9a2f87dc7dccb295, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:19.843126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979fb11-7f6f-4492-988e-dddc3471b4c1 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:19.921309 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1019/2036] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:19 2022] PUT /identity/v3/projects/df01d1280c0a4ff4972392ee479e9772/users/3306e7d5f78e40fe9a2f87dc7dccb295/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:19.931826 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379963e6-b370-4b1e-93c2-159d37d29383 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:19.932118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379963e6-b370-4b1e-93c2-159d37d29383 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:19.932702 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379963e6-b370-4b1e-93c2-159d37d29383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:19.968507 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-fad0dfca-48b1-47cd-bb48-1fd5599ee08e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '169297ae35e347f8b6e3d9ab08455b96', 'request_id': 'req-fad0dfca-48b1-47cd-bb48-1fd5599ee08e'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:19.969492 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-379963e6-b370-4b1e-93c2-159d37d29383 None None] MFA Rules not processed for user `3306e7d5f78e40fe9a2f87dc7dccb295`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:19.972884 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-379963e6-b370-4b1e-93c2-159d37d29383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:19.976793 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-fad0dfca-48b1-47cd-bb48-1fd5599ee08e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '169297ae35e347f8b6e3d9ab08455b96', 'request_id': 'req-fad0dfca-48b1-47cd-bb48-1fd5599ee08e'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:20.029845 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-fad0dfca-48b1-47cd-bb48-1fd5599ee08e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '169297ae35e347f8b6e3d9ab08455b96', 'request_id': 'req-fad0dfca-48b1-47cd-bb48-1fd5599ee08e'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:20.043052 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-fad0dfca-48b1-47cd-bb48-1fd5599ee08e admin admin] The token cache is being invalidate because project 169297ae35e347f8b6e3d9ab08455b96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:20:20.043344 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-fad0dfca-48b1-47cd-bb48-1fd5599ee08e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:20.044008 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-fad0dfca-48b1-47cd-bb48-1fd5599ee08e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:20.045834 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1018/2037] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:20:19 2022] DELETE /identity/v3/projects/169297ae35e347f8b6e3d9ab08455b96 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:20.050288 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0dfca-48b1-47cd-bb48-1fd5599ee08e admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:20.052089 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-fad0dfca-48b1-47cd-bb48-1fd5599ee08e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:20.063988 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1020/2038] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:20:20.079166 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379963e6-b370-4b1e-93c2-159d37d29383 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:20.080788 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-379963e6-b370-4b1e-93c2-159d37d29383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:20.107438 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:20.135125 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0dfca-48b1-47cd-bb48-1fd5599ee08e admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:20.137460 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:20.142491 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3048dc-c322-4e02-a55d-e618e4c911b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:20.152379 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3048dc-c322-4e02-a55d-e618e4c911b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:20.152379 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3048dc-c322-4e02-a55d-e618e4c911b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:20.152379 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3048dc-c322-4e02-a55d-e618e4c911b2 admin admin] PATH_INFO: `/v3/users/440788e144c34bb3bf125a6940c2c177` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:20.153113 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3048dc-c322-4e02-a55d-e618e4c911b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=440788e144c34bb3bf125a6940c2c177)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:20.155228 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3048dc-c322-4e02-a55d-e618e4c911b2 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:20.159359 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379963e6-b370-4b1e-93c2-159d37d29383 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:20.168152 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb11a0-019c-4fec-b550-21d837449224 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:20.168626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb11a0-019c-4fec-b550-21d837449224 service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:20.168935 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb11a0-019c-4fec-b550-21d837449224 service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:20.169586 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb11a0-019c-4fec-b550-21d837449224 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:20.180581 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb11a0-019c-4fec-b550-21d837449224 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:20.182105 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb11a0-019c-4fec-b550-21d837449224 service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:20.197318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1021/2039] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:20:20.232479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb11a0-019c-4fec-b550-21d837449224 service cinder] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:20.234122 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-6bcb11a0-019c-4fec-b550-21d837449224 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:20.259835 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb11a0-019c-4fec-b550-21d837449224 service cinder] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:20.266500 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176742e-7467-4b3e-9e94-09b30c50998b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:20.267923 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176742e-7467-4b3e-9e94-09b30c50998b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:20.268161 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176742e-7467-4b3e-9e94-09b30c50998b admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:20.268512 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176742e-7467-4b3e-9e94-09b30c50998b admin admin] PATH_INFO: `/v3/users/3306e7d5f78e40fe9a2f87dc7dccb295` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:20.270355 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176742e-7467-4b3e-9e94-09b30c50998b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3306e7d5f78e40fe9a2f87dc7dccb295)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:20.272646 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176742e-7467-4b3e-9e94-09b30c50998b admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:20.418612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-ea3048dc-c322-4e02-a55d-e618e4c911b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '440788e144c34bb3bf125a6940c2c177'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:20.436729 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-ea3048dc-c322-4e02-a55d-e618e4c911b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '440788e144c34bb3bf125a6940c2c177'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:20.466274 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-4176742e-7467-4b3e-9e94-09b30c50998b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3306e7d5f78e40fe9a2f87dc7dccb295'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:20.467015 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-4176742e-7467-4b3e-9e94-09b30c50998b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3306e7d5f78e40fe9a2f87dc7dccb295'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:20.526835 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-ea3048dc-c322-4e02-a55d-e618e4c911b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '440788e144c34bb3bf125a6940c2c177'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:20.527494 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-ea3048dc-c322-4e02-a55d-e618e4c911b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '440788e144c34bb3bf125a6940c2c177'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:20.541045 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-ea3048dc-c322-4e02-a55d-e618e4c911b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '440788e144c34bb3bf125a6940c2c177'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:20.554687 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1019/2040] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:20:20 2022] DELETE /identity/v3/users/440788e144c34bb3bf125a6940c2c177 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:20:20.632140 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-4176742e-7467-4b3e-9e94-09b30c50998b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3306e7d5f78e40fe9a2f87dc7dccb295'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:20.642799 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-4176742e-7467-4b3e-9e94-09b30c50998b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3306e7d5f78e40fe9a2f87dc7dccb295'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:20.651128 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-4176742e-7467-4b3e-9e94-09b30c50998b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3306e7d5f78e40fe9a2f87dc7dccb295'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:20.659567 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1022/2041] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:20:20 2022] DELETE /identity/v3/users/3306e7d5f78e40fe9a2f87dc7dccb295 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:20.670715 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0797df-5723-4287-8ff3-8eb1212928a9 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:20.671021 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0797df-5723-4287-8ff3-8eb1212928a9 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:20.671362 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0797df-5723-4287-8ff3-8eb1212928a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:20.693434 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-1a0797df-5723-4287-8ff3-8eb1212928a9 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:20.694708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-1a0797df-5723-4287-8ff3-8eb1212928a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:20.762307 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1020/2042] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:20.772177 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176742e-7467-4b3e-9e94-09b30c50998b admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:20.773628 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-4176742e-7467-4b3e-9e94-09b30c50998b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:20.839078 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176742e-7467-4b3e-9e94-09b30c50998b admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:20.844127 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7b01a-1925-45a0-b814-69c589293a85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:20.844844 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7b01a-1925-45a0-b814-69c589293a85 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:20.845533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7b01a-1925-45a0-b814-69c589293a85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:20.845533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7b01a-1925-45a0-b814-69c589293a85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:20.858516 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7b01a-1925-45a0-b814-69c589293a85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:20.860260 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7b01a-1925-45a0-b814-69c589293a85 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:20.872957 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1023/2043] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:21.202043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0797df-5723-4287-8ff3-8eb1212928a9 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:21.204146 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-1a0797df-5723-4287-8ff3-8eb1212928a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:21.239883 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0797df-5723-4287-8ff3-8eb1212928a9 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:21.250266 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016b823-7f40-436e-824a-b3d92924772f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:21.251809 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016b823-7f40-436e-824a-b3d92924772f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:21.255648 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016b823-7f40-436e-824a-b3d92924772f admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:21.255648 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016b823-7f40-436e-824a-b3d92924772f admin admin] PATH_INFO: `/v3/projects/85b4a0b79d204e9d8ccff86e96462873` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:21.256130 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016b823-7f40-436e-824a-b3d92924772f admin admin] RBAC: Authorizing `identity:delete_project(project_id=85b4a0b79d204e9d8ccff86e96462873)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:21.258593 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016b823-7f40-436e-824a-b3d92924772f admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:21.434068 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-7016b823-7f40-436e-824a-b3d92924772f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85b4a0b79d204e9d8ccff86e96462873', 'request_id': 'req-7016b823-7f40-436e-824a-b3d92924772f'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:21.440672 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-7016b823-7f40-436e-824a-b3d92924772f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85b4a0b79d204e9d8ccff86e96462873', 'request_id': 'req-7016b823-7f40-436e-824a-b3d92924772f'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:21.444308 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:21.561020 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-7016b823-7f40-436e-824a-b3d92924772f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85b4a0b79d204e9d8ccff86e96462873', 'request_id': 'req-7016b823-7f40-436e-824a-b3d92924772f'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:21.571867 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-7016b823-7f40-436e-824a-b3d92924772f admin admin] The token cache is being invalidate because project 85b4a0b79d204e9d8ccff86e96462873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:20:21.577142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-7016b823-7f40-436e-824a-b3d92924772f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:21.577142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-7016b823-7f40-436e-824a-b3d92924772f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:21.577142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1021/2044] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:20:21 2022] DELETE /identity/v3/projects/85b4a0b79d204e9d8ccff86e96462873 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:21.579340 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25465bb8-034a-4235-abd6-fda46d631c13 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:21.579624 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25465bb8-034a-4235-abd6-fda46d631c13 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:21.579896 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25465bb8-034a-4235-abd6-fda46d631c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:21.603951 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-25465bb8-034a-4235-abd6-fda46d631c13 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:21.605785 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-25465bb8-034a-4235-abd6-fda46d631c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:21.616444 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016b823-7f40-436e-824a-b3d92924772f admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:21.619216 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-7016b823-7f40-436e-824a-b3d92924772f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:21.705684 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:21.729023 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1024/2045] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:21.730785 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc31311-8a23-4b3e-9321-9ca7e57a762b None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:21.731245 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc31311-8a23-4b3e-9321-9ca7e57a762b None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:21.731680 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc31311-8a23-4b3e-9321-9ca7e57a762b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:21.758245 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-dbc31311-8a23-4b3e-9321-9ca7e57a762b None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:21.759949 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-dbc31311-8a23-4b3e-9321-9ca7e57a762b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:21.760581 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016b823-7f40-436e-824a-b3d92924772f admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:21.774067 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1025/2046] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:21.778558 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc31311-8a23-4b3e-9321-9ca7e57a762b None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:21.782572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd63d2-9e15-44be-be82-3f9f099cbeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:21.783916 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd63d2-9e15-44be-be82-3f9f099cbeb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:21.784560 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd63d2-9e15-44be-be82-3f9f099cbeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:21.785051 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd63d2-9e15-44be-be82-3f9f099cbeb6 admin admin] PATH_INFO: `/v3/projects/df01d1280c0a4ff4972392ee479e9772` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:21.786641 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd63d2-9e15-44be-be82-3f9f099cbeb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df01d1280c0a4ff4972392ee479e9772)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:21.788888 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd63d2-9e15-44be-be82-3f9f099cbeb6 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:21.794190 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc31311-8a23-4b3e-9321-9ca7e57a762b None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:21.800911 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d1e7e-87d9-4f77-8492-6494c9f2d223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:21.803918 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d1e7e-87d9-4f77-8492-6494c9f2d223 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:21.803918 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d1e7e-87d9-4f77-8492-6494c9f2d223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:21.803918 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d1e7e-87d9-4f77-8492-6494c9f2d223 admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:21.805042 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d1e7e-87d9-4f77-8492-6494c9f2d223 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:20:21.805654 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d1e7e-87d9-4f77-8492-6494c9f2d223 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:21.808145 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d1e7e-87d9-4f77-8492-6494c9f2d223 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:21.825409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1026/2047] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:20:21.830026 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d1e7e-87d9-4f77-8492-6494c9f2d223 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:21.842565 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d1e7e-87d9-4f77-8492-6494c9f2d223 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:21.847534 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ff8c1-f7b7-4d74-a52b-425d5cd0495b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:21.848222 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ff8c1-f7b7-4d74-a52b-425d5cd0495b admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:21.848511 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ff8c1-f7b7-4d74-a52b-425d5cd0495b admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:21.848796 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ff8c1-f7b7-4d74-a52b-425d5cd0495b admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:21.849545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ff8c1-f7b7-4d74-a52b-425d5cd0495b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:21.853078 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ff8c1-f7b7-4d74-a52b-425d5cd0495b admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:21.967529 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-ecbd63d2-9e15-44be-be82-3f9f099cbeb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df01d1280c0a4ff4972392ee479e9772', 'request_id': 'req-ecbd63d2-9e15-44be-be82-3f9f099cbeb6'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:21.973925 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-ecbd63d2-9e15-44be-be82-3f9f099cbeb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df01d1280c0a4ff4972392ee479e9772', 'request_id': 'req-ecbd63d2-9e15-44be-be82-3f9f099cbeb6'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:21.985087 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1027/2048] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:21 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:20:21.986820 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ff8c1-f7b7-4d74-a52b-425d5cd0495b admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:22.050597 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ff8c1-f7b7-4d74-a52b-425d5cd0495b admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:22.052343 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-ecbd63d2-9e15-44be-be82-3f9f099cbeb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df01d1280c0a4ff4972392ee479e9772', 'request_id': 'req-ecbd63d2-9e15-44be-be82-3f9f099cbeb6'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:22.059146 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b6e64-3ccf-44f6-b5b3-52281759f99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:22.059851 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b6e64-3ccf-44f6-b5b3-52281759f99c admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:22.060120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b6e64-3ccf-44f6-b5b3-52281759f99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:22.060406 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b6e64-3ccf-44f6-b5b3-52281759f99c admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:22.061157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b6e64-3ccf-44f6-b5b3-52281759f99c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:22.063099 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b6e64-3ccf-44f6-b5b3-52281759f99c admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:22.064708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-ecbd63d2-9e15-44be-be82-3f9f099cbeb6 admin admin] The token cache is being invalidate because project df01d1280c0a4ff4972392ee479e9772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:20:22.069714 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-ecbd63d2-9e15-44be-be82-3f9f099cbeb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:22.069714 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-ecbd63d2-9e15-44be-be82-3f9f099cbeb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:22.069714 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1022/2049] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:20:21 2022] DELETE /identity/v3/projects/df01d1280c0a4ff4972392ee479e9772 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:22.072505 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e2a0c-0f76-4cf8-83c3-848ea3565bba None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:22.072799 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e2a0c-0f76-4cf8-83c3-848ea3565bba None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:22.073113 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e2a0c-0f76-4cf8-83c3-848ea3565bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:22.091986 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-196e2a0c-0f76-4cf8-83c3-848ea3565bba None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:22.093256 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-196e2a0c-0f76-4cf8-83c3-848ea3565bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:22.101358 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1023/2050] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:20:22.108959 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ad8fb-36c8-421e-9de1-308f6e5c0534 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:22.115565 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ad8fb-36c8-421e-9de1-308f6e5c0534 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:22.115565 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ad8fb-36c8-421e-9de1-308f6e5c0534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:22.127406 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-880ad8fb-36c8-421e-9de1-308f6e5c0534 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:22.128609 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-880ad8fb-36c8-421e-9de1-308f6e5c0534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:22.137401 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1024/2051] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:20:22.141933 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ad8fb-36c8-421e-9de1-308f6e5c0534 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:22.151619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ad8fb-36c8-421e-9de1-308f6e5c0534 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:22.156421 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966de82b-3b74-4648-b514-f033a4cd4e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:22.157120 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966de82b-3b74-4648-b514-f033a4cd4e91 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:22.157407 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966de82b-3b74-4648-b514-f033a4cd4e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:22.161039 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966de82b-3b74-4648-b514-f033a4cd4e91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:22.161039 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966de82b-3b74-4648-b514-f033a4cd4e91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:20:22.161039 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966de82b-3b74-4648-b514-f033a4cd4e91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:22.161039 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966de82b-3b74-4648-b514-f033a4cd4e91 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:22.169938 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1028/2052] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:21 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:22.172310 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1025/2053] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:20:22.176638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966de82b-3b74-4648-b514-f033a4cd4e91 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:22.176941 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b6e64-3ccf-44f6-b5b3-52281759f99c admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:22.179274 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-9f1b6e64-3ccf-44f6-b5b3-52281759f99c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:22.188164 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966de82b-3b74-4648-b514-f033a4cd4e91 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:22.193534 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b6e64-3ccf-44f6-b5b3-52281759f99c admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:22.195956 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e533418-1f54-4777-a8ec-d059cb509835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:22.196629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e533418-1f54-4777-a8ec-d059cb509835 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:22.196979 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e533418-1f54-4777-a8ec-d059cb509835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:22.197262 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e533418-1f54-4777-a8ec-d059cb509835 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:22.197960 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e533418-1f54-4777-a8ec-d059cb509835 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:22.198919 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b233cc-18be-428d-a93f-da5aca101a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:22.199661 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b233cc-18be-428d-a93f-da5aca101a22 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:22.199935 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b233cc-18be-428d-a93f-da5aca101a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:22.200030 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e533418-1f54-4777-a8ec-d059cb509835 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:22.200218 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b233cc-18be-428d-a93f-da5aca101a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:22.201152 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b233cc-18be-428d-a93f-da5aca101a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:22.202686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b233cc-18be-428d-a93f-da5aca101a22 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:22.213831 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1029/2054] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:22.217832 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b233cc-18be-428d-a93f-da5aca101a22 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:22.227713 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b233cc-18be-428d-a93f-da5aca101a22 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:22.232611 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d03b70-645b-4674-82ca-3cca6740cdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:22.233303 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d03b70-645b-4674-82ca-3cca6740cdd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:22.233589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d03b70-645b-4674-82ca-3cca6740cdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:22.233869 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d03b70-645b-4674-82ca-3cca6740cdd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:22.234588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d03b70-645b-4674-82ca-3cca6740cdd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:22.236170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d03b70-645b-4674-82ca-3cca6740cdd8 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:22.246625 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1030/2055] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:20:22.250603 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d03b70-645b-4674-82ca-3cca6740cdd8 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:22.260537 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d03b70-645b-4674-82ca-3cca6740cdd8 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:22.265244 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932bbb6-c480-4131-ac46-5ffc33f93223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:22.266097 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932bbb6-c480-4131-ac46-5ffc33f93223 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:22.266651 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932bbb6-c480-4131-ac46-5ffc33f93223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:22.266913 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932bbb6-c480-4131-ac46-5ffc33f93223 admin admin] PATH_INFO: `/v3/projects/bfcee8e74281416db19b906e412cf67b/users/8bcfa9ff0b6f411d80cab1501e1fa3ec/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:22.282803 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932bbb6-c480-4131-ac46-5ffc33f93223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfcee8e74281416db19b906e412cf67b, user_id=8bcfa9ff0b6f411d80cab1501e1fa3ec, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:22.285462 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932bbb6-c480-4131-ac46-5ffc33f93223 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:22.304080 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1026/2056] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:22 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:22.308187 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e533418-1f54-4777-a8ec-d059cb509835 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:22.380479 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e533418-1f54-4777-a8ec-d059cb509835 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:22.385143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1031/2057] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:22 2022] PUT /identity/v3/projects/bfcee8e74281416db19b906e412cf67b/users/8bcfa9ff0b6f411d80cab1501e1fa3ec/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:20:22.396304 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d96825-e758-4b6d-a0a5-d2500aec3141 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:22.396713 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d96825-e758-4b6d-a0a5-d2500aec3141 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:22.397106 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d96825-e758-4b6d-a0a5-d2500aec3141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:22.427488 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-85d96825-e758-4b6d-a0a5-d2500aec3141 None None] MFA Rules not processed for user `8bcfa9ff0b6f411d80cab1501e1fa3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:22.428747 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-85d96825-e758-4b6d-a0a5-d2500aec3141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:22.452539 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed7608-d87b-4af3-99f1-e71876c3f864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:22.453383 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed7608-d87b-4af3-99f1-e71876c3f864 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:22.453669 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed7608-d87b-4af3-99f1-e71876c3f864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:22.453955 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed7608-d87b-4af3-99f1-e71876c3f864 admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:22.454819 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed7608-d87b-4af3-99f1-e71876c3f864 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:22.456893 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed7608-d87b-4af3-99f1-e71876c3f864 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:22.508843 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1032/2058] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:20:22.520894 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d96825-e758-4b6d-a0a5-d2500aec3141 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:22.522888 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-85d96825-e758-4b6d-a0a5-d2500aec3141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:22.578268 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1027/2059] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:22 2022] POST /identity/v3/users => generated 286 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:20:22.582358 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed7608-d87b-4af3-99f1-e71876c3f864 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:22.585671 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d96825-e758-4b6d-a0a5-d2500aec3141 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:22.589661 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1c701-ee99-4d55-9300-e413ae0c8a4b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4fbf9b051940bd82547a700796d118', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:22.590329 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1c701-ee99-4d55-9300-e413ae0c8a4b service glance] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:22.590608 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1c701-ee99-4d55-9300-e413ae0c8a4b service glance] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:22.590880 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1c701-ee99-4d55-9300-e413ae0c8a4b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:22.594034 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed7608-d87b-4af3-99f1-e71876c3f864 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:22.598940 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4e5d9-dadc-4bfa-be01-e99f5a2812fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:22.599547 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4e5d9-dadc-4bfa-be01-e99f5a2812fa admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:22.600022 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4e5d9-dadc-4bfa-be01-e99f5a2812fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:22.600543 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4e5d9-dadc-4bfa-be01-e99f5a2812fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:22.600657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1c701-ee99-4d55-9300-e413ae0c8a4b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:22.601464 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4e5d9-dadc-4bfa-be01-e99f5a2812fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:22.601746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1c701-ee99-4d55-9300-e413ae0c8a4b service glance] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:22.604237 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4e5d9-dadc-4bfa-be01-e99f5a2812fa admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:22.612139 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1033/2060] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:20:22.620026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1028/2061] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:22.623931 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1c701-ee99-4d55-9300-e413ae0c8a4b service glance] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:22.636017 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1c701-ee99-4d55-9300-e413ae0c8a4b service glance] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:22.641059 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fc007-0799-401c-9bdf-5bb5b50a0601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:22.642419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fc007-0799-401c-9bdf-5bb5b50a0601 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:22.642419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fc007-0799-401c-9bdf-5bb5b50a0601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:22.642578 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fc007-0799-401c-9bdf-5bb5b50a0601 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:22.643288 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8fc007-0799-401c-9bdf-5bb5b50a0601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:22.644908 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8fc007-0799-401c-9bdf-5bb5b50a0601 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:22.658727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1034/2062] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:20:22.660266 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4e5d9-dadc-4bfa-be01-e99f5a2812fa admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:22.671180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4e5d9-dadc-4bfa-be01-e99f5a2812fa admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:22.677245 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c9812-6f24-4c9c-871d-bc871a99f25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:22.678056 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c9812-6f24-4c9c-871d-bc871a99f25e admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:22.678336 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c9812-6f24-4c9c-871d-bc871a99f25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:22.678676 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c9812-6f24-4c9c-871d-bc871a99f25e admin admin] PATH_INFO: `/v3/projects/130e7b24e0c44000b2c29d729e91325d/users/2d03f96e61c94c90b4d14980ae712191/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:22.701166 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c9812-6f24-4c9c-871d-bc871a99f25e admin admin] RBAC: Authorizing `identity:create_grant(project_id=130e7b24e0c44000b2c29d729e91325d, user_id=2d03f96e61c94c90b4d14980ae712191, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:22.704246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c9812-6f24-4c9c-871d-bc871a99f25e admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:22.756671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:22.788367 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1029/2063] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:22 2022] PUT /identity/v3/projects/130e7b24e0c44000b2c29d729e91325d/users/2d03f96e61c94c90b4d14980ae712191/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:22.807870 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a3150-2c21-4c68-8a89-d376dc55dfdc None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:22.809028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a3150-2c21-4c68-8a89-d376dc55dfdc None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:22.809716 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a3150-2c21-4c68-8a89-d376dc55dfdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:22.854375 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-be7a3150-2c21-4c68-8a89-d376dc55dfdc None None] MFA Rules not processed for user `2d03f96e61c94c90b4d14980ae712191`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:22.854375 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-be7a3150-2c21-4c68-8a89-d376dc55dfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:22.876121 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:22.931743 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1035/2064] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:22.970044 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c9812-6f24-4c9c-871d-bc871a99f25e admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:22.971880 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-b47c9812-6f24-4c9c-871d-bc871a99f25e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:23.033561 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c9812-6f24-4c9c-871d-bc871a99f25e admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:23.038141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5739a7-a2d5-4871-a9e0-2e7d15fc7049 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:23.038804 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5739a7-a2d5-4871-a9e0-2e7d15fc7049 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:23.039093 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5739a7-a2d5-4871-a9e0-2e7d15fc7049 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:23.039374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5739a7-a2d5-4871-a9e0-2e7d15fc7049 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:23.048935 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5739a7-a2d5-4871-a9e0-2e7d15fc7049 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:23.050578 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5739a7-a2d5-4871-a9e0-2e7d15fc7049 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:23.061305 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1030/2065] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:23.081915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a3150-2c21-4c68-8a89-d376dc55dfdc None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:23.151939 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a3150-2c21-4c68-8a89-d376dc55dfdc None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:23.156628 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d219a0-ef41-4c55-9889-417aab656c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:23.157657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d219a0-ef41-4c55-9889-417aab656c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:23.157937 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d219a0-ef41-4c55-9889-417aab656c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:23.158215 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d219a0-ef41-4c55-9889-417aab656c69 admin admin] PATH_INFO: `/v3/users/2d03f96e61c94c90b4d14980ae712191` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:23.159445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d219a0-ef41-4c55-9889-417aab656c69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d03f96e61c94c90b4d14980ae712191)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:23.163979 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d219a0-ef41-4c55-9889-417aab656c69 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:23.167314 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:23.415822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-62d219a0-ef41-4c55-9889-417aab656c69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d03f96e61c94c90b4d14980ae712191'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:23.416509 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-62d219a0-ef41-4c55-9889-417aab656c69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d03f96e61c94c90b4d14980ae712191'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:23.498445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-62d219a0-ef41-4c55-9889-417aab656c69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d03f96e61c94c90b4d14980ae712191'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:23.514454 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-62d219a0-ef41-4c55-9889-417aab656c69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d03f96e61c94c90b4d14980ae712191'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:23.532611 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-62d219a0-ef41-4c55-9889-417aab656c69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d03f96e61c94c90b4d14980ae712191'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:23.539942 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1036/2066] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:20:23 2022] DELETE /identity/v3/users/2d03f96e61c94c90b4d14980ae712191 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:20:23.544633 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb4c7d-3efe-4570-8fe5-dcc5c558c8e7 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:23.545160 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb4c7d-3efe-4570-8fe5-dcc5c558c8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:23.545288 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb4c7d-3efe-4570-8fe5-dcc5c558c8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:23.564219 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-c7fb4c7d-3efe-4570-8fe5-dcc5c558c8e7 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:23.565606 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-c7fb4c7d-3efe-4570-8fe5-dcc5c558c8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:23.597826 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:23.634602 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1031/2067] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:23.644694 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d219a0-ef41-4c55-9889-417aab656c69 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:23.648903 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-62d219a0-ef41-4c55-9889-417aab656c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:23.712134 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d219a0-ef41-4c55-9889-417aab656c69 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:23.715871 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d83e61-3825-4d07-965a-f98c0fddb12f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:23.716518 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d83e61-3825-4d07-965a-f98c0fddb12f service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:23.716801 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d83e61-3825-4d07-965a-f98c0fddb12f service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:23.717107 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d83e61-3825-4d07-965a-f98c0fddb12f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:23.726754 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d83e61-3825-4d07-965a-f98c0fddb12f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:23.728191 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d83e61-3825-4d07-965a-f98c0fddb12f service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:23.737796 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1037/2068] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:24.198374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb4c7d-3efe-4570-8fe5-dcc5c558c8e7 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:24.200044 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-c7fb4c7d-3efe-4570-8fe5-dcc5c558c8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:24.219103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb4c7d-3efe-4570-8fe5-dcc5c558c8e7 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:24.229693 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036300b-ee41-4632-92ac-50b07e996923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:24.229693 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036300b-ee41-4632-92ac-50b07e996923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:24.229693 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036300b-ee41-4632-92ac-50b07e996923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:24.229693 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036300b-ee41-4632-92ac-50b07e996923 admin admin] PATH_INFO: `/v3/projects/130e7b24e0c44000b2c29d729e91325d` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:24.230297 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6036300b-ee41-4632-92ac-50b07e996923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=130e7b24e0c44000b2c29d729e91325d)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:24.230697 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6036300b-ee41-4632-92ac-50b07e996923 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:24.323807 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-6036300b-ee41-4632-92ac-50b07e996923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '130e7b24e0c44000b2c29d729e91325d', 'request_id': 'req-6036300b-ee41-4632-92ac-50b07e996923'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:24.330461 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-6036300b-ee41-4632-92ac-50b07e996923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '130e7b24e0c44000b2c29d729e91325d', 'request_id': 'req-6036300b-ee41-4632-92ac-50b07e996923'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:24.389671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-6036300b-ee41-4632-92ac-50b07e996923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '130e7b24e0c44000b2c29d729e91325d', 'request_id': 'req-6036300b-ee41-4632-92ac-50b07e996923'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:24.401881 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-6036300b-ee41-4632-92ac-50b07e996923 admin admin] The token cache is being invalidate because project 130e7b24e0c44000b2c29d729e91325d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:20:24.402170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-6036300b-ee41-4632-92ac-50b07e996923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:24.402838 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-6036300b-ee41-4632-92ac-50b07e996923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:24.405532 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1032/2069] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:20:24 2022] DELETE /identity/v3/projects/130e7b24e0c44000b2c29d729e91325d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:24.412971 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab356e-3f04-491c-9743-b71b51209cb0 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:24.413519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab356e-3f04-491c-9743-b71b51209cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:24.413719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab356e-3f04-491c-9743-b71b51209cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:24.432213 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-efab356e-3f04-491c-9743-b71b51209cb0 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:24.433384 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-efab356e-3f04-491c-9743-b71b51209cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:24.494640 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1038/2070] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:24.502520 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e25599-1d89-4706-82a5-1b61bdfffe36 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:24.502808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e25599-1d89-4706-82a5-1b61bdfffe36 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:24.503093 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e25599-1d89-4706-82a5-1b61bdfffe36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:24.521704 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-88e25599-1d89-4706-82a5-1b61bdfffe36 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:24.522923 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-88e25599-1d89-4706-82a5-1b61bdfffe36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:24.531061 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1033/2071] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:24.535764 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab356e-3f04-491c-9743-b71b51209cb0 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:24.546091 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab356e-3f04-491c-9743-b71b51209cb0 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:24.551033 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdecc6-8058-4f36-8cd9-005f80f4a7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:24.552286 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdecc6-8058-4f36-8cd9-005f80f4a7da admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:24.552550 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdecc6-8058-4f36-8cd9-005f80f4a7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:24.552854 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdecc6-8058-4f36-8cd9-005f80f4a7da admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:24.553600 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdecc6-8058-4f36-8cd9-005f80f4a7da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:20:24.553912 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdecc6-8058-4f36-8cd9-005f80f4a7da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:24.555517 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdecc6-8058-4f36-8cd9-005f80f4a7da admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:24.566962 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1039/2072] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:20:24.571422 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e25599-1d89-4706-82a5-1b61bdfffe36 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:24.580736 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e25599-1d89-4706-82a5-1b61bdfffe36 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:24.585522 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12218df-577d-4f65-8f70-3888eba1b2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:24.586180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12218df-577d-4f65-8f70-3888eba1b2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:24.586466 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12218df-577d-4f65-8f70-3888eba1b2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:24.586747 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12218df-577d-4f65-8f70-3888eba1b2f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:24.587445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12218df-577d-4f65-8f70-3888eba1b2f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:24.589452 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12218df-577d-4f65-8f70-3888eba1b2f2 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:24.696352 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1034/2073] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:24 2022] POST /identity/v3/projects => generated 397 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:24.697341 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdecc6-8058-4f36-8cd9-005f80f4a7da admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:24.707512 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdecc6-8058-4f36-8cd9-005f80f4a7da admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:24.719926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:24.768606 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ba26d-bef3-46a7-ae70-500bc814093a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:24.769422 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ba26d-bef3-46a7-ae70-500bc814093a admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:24.769711 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ba26d-bef3-46a7-ae70-500bc814093a admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:24.769995 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ba26d-bef3-46a7-ae70-500bc814093a admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:24.771242 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ba26d-bef3-46a7-ae70-500bc814093a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:24.773318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ba26d-bef3-46a7-ae70-500bc814093a admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:24.864534 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1040/2074] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:24 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:24.869483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12218df-577d-4f65-8f70-3888eba1b2f2 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:24.879756 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12218df-577d-4f65-8f70-3888eba1b2f2 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:24.884638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2170c-4929-477e-9550-b41ca9fcab8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:24.885676 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2170c-4929-477e-9550-b41ca9fcab8e admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:24.885676 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2170c-4929-477e-9550-b41ca9fcab8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:24.885908 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2170c-4929-477e-9550-b41ca9fcab8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:24.886677 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2170c-4929-477e-9550-b41ca9fcab8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:24.888313 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2170c-4929-477e-9550-b41ca9fcab8e admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:24.900474 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1035/2075] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:24.904764 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ba26d-bef3-46a7-ae70-500bc814093a admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:24.923101 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ba26d-bef3-46a7-ae70-500bc814093a admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:24.928055 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efb7c3-da5e-4cbb-bff2-387ad29666c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:24.928732 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efb7c3-da5e-4cbb-bff2-387ad29666c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:24.929058 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efb7c3-da5e-4cbb-bff2-387ad29666c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:24.929345 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efb7c3-da5e-4cbb-bff2-387ad29666c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:24.930124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efb7c3-da5e-4cbb-bff2-387ad29666c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:24.931739 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efb7c3-da5e-4cbb-bff2-387ad29666c6 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:24.944979 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1041/2076] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:24.958703 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2170c-4929-477e-9550-b41ca9fcab8e admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:24.970545 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2170c-4929-477e-9550-b41ca9fcab8e admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:24.978213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e26d9f-c265-4539-b32c-e4f41f031720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:24.982399 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e26d9f-c265-4539-b32c-e4f41f031720 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:24.982399 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e26d9f-c265-4539-b32c-e4f41f031720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:24.982399 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e26d9f-c265-4539-b32c-e4f41f031720 admin admin] PATH_INFO: `/v3/projects/1126d5b782224717b7374cb8ecbddc5a/users/05b5c269a8ba4cba9bbe7dc66dcad8f0/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:24.998085 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e26d9f-c265-4539-b32c-e4f41f031720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1126d5b782224717b7374cb8ecbddc5a, user_id=05b5c269a8ba4cba9bbe7dc66dcad8f0, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:25.005550 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e26d9f-c265-4539-b32c-e4f41f031720 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:25.087850 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1036/2077] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:24 2022] PUT /identity/v3/projects/1126d5b782224717b7374cb8ecbddc5a/users/05b5c269a8ba4cba9bbe7dc66dcad8f0/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:25.098095 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d7e51-d7ac-479b-aa4e-9c05fcd51415 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:25.098416 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d7e51-d7ac-479b-aa4e-9c05fcd51415 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:25.098700 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d7e51-d7ac-479b-aa4e-9c05fcd51415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:25.125473 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-5d0d7e51-d7ac-479b-aa4e-9c05fcd51415 None None] MFA Rules not processed for user `05b5c269a8ba4cba9bbe7dc66dcad8f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:25.126681 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-5d0d7e51-d7ac-479b-aa4e-9c05fcd51415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:25.195057 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1042/2078] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:25.207100 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e26d9f-c265-4539-b32c-e4f41f031720 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:25.209686 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-95e26d9f-c265-4539-b32c-e4f41f031720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:25.267531 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e26d9f-c265-4539-b32c-e4f41f031720 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:25.272959 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b15f65-cafe-490b-a429-d4cf89ce7253 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:25.273525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b15f65-cafe-490b-a429-d4cf89ce7253 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:25.273808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b15f65-cafe-490b-a429-d4cf89ce7253 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:25.274087 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b15f65-cafe-490b-a429-d4cf89ce7253 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:25.280510 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:25.282895 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b15f65-cafe-490b-a429-d4cf89ce7253 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:25.284325 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b15f65-cafe-490b-a429-d4cf89ce7253 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:25.292966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1037/2079] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:25 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:33.047035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908f5cd-0621-4df1-8836-59603999dfc8 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:33.047800 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908f5cd-0621-4df1-8836-59603999dfc8 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:33.047800 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908f5cd-0621-4df1-8836-59603999dfc8 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:33.049093 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1043/2080] 10.222.0.46 () {54 vars in 921 bytes} [Wed Jun 22 10:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:20:33.061580 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5dfe8-aa94-4959-a5cc-effb5aa7ffc5 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:33.062101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5dfe8-aa94-4959-a5cc-effb5aa7ffc5 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:33.062180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5dfe8-aa94-4959-a5cc-effb5aa7ffc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:33.094738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-e4a5dfe8-aa94-4959-a5cc-effb5aa7ffc5 None None] MFA Rules not processed for user `675892a676054b4f86f9ac12d95f4f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:33.095973 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-e4a5dfe8-aa94-4959-a5cc-effb5aa7ffc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:33.195619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908f5cd-0621-4df1-8836-59603999dfc8 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:33.198003 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-5908f5cd-0621-4df1-8836-59603999dfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:33.226325 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1038/2081] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Jun 22 10:20:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:33.245204 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5dfe8-aa94-4959-a5cc-effb5aa7ffc5 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:33.245204 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-e4a5dfe8-aa94-4959-a5cc-effb5aa7ffc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:33.254803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5dfe8-aa94-4959-a5cc-effb5aa7ffc5 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:33.261501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f2f33-0464-4cac-8a64-a128adb3344a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '675892a676054b4f86f9ac12d95f4f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:33.262186 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f2f33-0464-4cac-8a64-a128adb3344a service placement] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:33.262491 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f2f33-0464-4cac-8a64-a128adb3344a service placement] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:33.262771 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f2f33-0464-4cac-8a64-a128adb3344a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:33.272233 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f2f33-0464-4cac-8a64-a128adb3344a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:33.274382 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f2f33-0464-4cac-8a64-a128adb3344a service placement] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:33.289134 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1039/2082] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:33.311127 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:33.312687 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908f5cd-0621-4df1-8836-59603999dfc8 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:33.317464 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d656b-759a-4a77-b031-eeaccf913ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:33.318375 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d656b-759a-4a77-b031-eeaccf913ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:33.318683 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d656b-759a-4a77-b031-eeaccf913ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:33.318961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d656b-759a-4a77-b031-eeaccf913ad4 admin admin] PATH_INFO: `/v3/users/6e05fbada6264cfb826ae4c93254de5a` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:33.320186 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d656b-759a-4a77-b031-eeaccf913ad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e05fbada6264cfb826ae4c93254de5a)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:33.322168 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d656b-759a-4a77-b031-eeaccf913ad4 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:33.553617 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-743d656b-759a-4a77-b031-eeaccf913ad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e05fbada6264cfb826ae4c93254de5a'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:33.554342 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-743d656b-759a-4a77-b031-eeaccf913ad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e05fbada6264cfb826ae4c93254de5a'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:33.619420 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-743d656b-759a-4a77-b031-eeaccf913ad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e05fbada6264cfb826ae4c93254de5a'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:33.632691 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-743d656b-759a-4a77-b031-eeaccf913ad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e05fbada6264cfb826ae4c93254de5a'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:33.641402 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-743d656b-759a-4a77-b031-eeaccf913ad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e05fbada6264cfb826ae4c93254de5a'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:33.648632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1044/2083] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:20:33 2022] DELETE /identity/v3/users/6e05fbada6264cfb826ae4c93254de5a => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:20:33.953115 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f2f33-0464-4cac-8a64-a128adb3344a service placement] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:33.966015 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f2f33-0464-4cac-8a64-a128adb3344a service placement] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:34.029464 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15367d-124c-402a-8c60-761a9719fd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:34.030825 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15367d-124c-402a-8c60-761a9719fd92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:34.030825 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15367d-124c-402a-8c60-761a9719fd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:34.031015 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15367d-124c-402a-8c60-761a9719fd92 admin admin] PATH_INFO: `/v3/projects/d5e8f35bd8844091accf4166f837f057` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:34.032335 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf15367d-124c-402a-8c60-761a9719fd92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5e8f35bd8844091accf4166f837f057)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:34.034410 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf15367d-124c-402a-8c60-761a9719fd92 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:34.123699 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:34.135605 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-cf15367d-124c-402a-8c60-761a9719fd92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5e8f35bd8844091accf4166f837f057', 'request_id': 'req-cf15367d-124c-402a-8c60-761a9719fd92'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:34.142089 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-cf15367d-124c-402a-8c60-761a9719fd92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5e8f35bd8844091accf4166f837f057', 'request_id': 'req-cf15367d-124c-402a-8c60-761a9719fd92'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:34.208488 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-cf15367d-124c-402a-8c60-761a9719fd92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5e8f35bd8844091accf4166f837f057', 'request_id': 'req-cf15367d-124c-402a-8c60-761a9719fd92'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:34.221778 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-cf15367d-124c-402a-8c60-761a9719fd92 admin admin] The token cache is being invalidate because project d5e8f35bd8844091accf4166f837f057 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:20:34.222126 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-cf15367d-124c-402a-8c60-761a9719fd92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:34.222912 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-cf15367d-124c-402a-8c60-761a9719fd92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:34.224592 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1040/2084] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:20:33 2022] DELETE /identity/v3/projects/d5e8f35bd8844091accf4166f837f057 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:34.237435 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d516b-100e-4d93-8c7f-f836c2dcae27 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:34.237890 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d516b-100e-4d93-8c7f-f836c2dcae27 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:34.238021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d516b-100e-4d93-8c7f-f836c2dcae27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:34.287948 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-206d516b-100e-4d93-8c7f-f836c2dcae27 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:34.288764 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-206d516b-100e-4d93-8c7f-f836c2dcae27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:34.350410 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1045/2085] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:34.358804 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c844f3-cfd1-42cd-99a7-018269310773 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:34.359217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c844f3-cfd1-42cd-99a7-018269310773 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:34.359599 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c844f3-cfd1-42cd-99a7-018269310773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:34.379506 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-f4c844f3-cfd1-42cd-99a7-018269310773 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:34.380879 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-f4c844f3-cfd1-42cd-99a7-018269310773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:34.389327 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1041/2086] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:34.393941 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d516b-100e-4d93-8c7f-f836c2dcae27 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:34.404437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d516b-100e-4d93-8c7f-f836c2dcae27 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:34.410336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79460a2-c801-442f-9217-88bc9be28d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:34.411007 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79460a2-c801-442f-9217-88bc9be28d74 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:34.411294 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79460a2-c801-442f-9217-88bc9be28d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:34.411572 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79460a2-c801-442f-9217-88bc9be28d74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:34.412954 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79460a2-c801-442f-9217-88bc9be28d74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:20:34.413161 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79460a2-c801-442f-9217-88bc9be28d74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:34.414772 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79460a2-c801-442f-9217-88bc9be28d74 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:34.430457 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1046/2087] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:20:34.434654 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c844f3-cfd1-42cd-99a7-018269310773 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:34.443796 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c844f3-cfd1-42cd-99a7-018269310773 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:34.448547 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d376a-9971-40a5-a4e9-90a51d47c3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:34.449225 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d376a-9971-40a5-a4e9-90a51d47c3a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:34.449502 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d376a-9971-40a5-a4e9-90a51d47c3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:34.449776 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d376a-9971-40a5-a4e9-90a51d47c3a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:34.450463 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d376a-9971-40a5-a4e9-90a51d47c3a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:34.452386 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d376a-9971-40a5-a4e9-90a51d47c3a3 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:34.566322 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1042/2088] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:34 2022] POST /identity/v3/projects => generated 365 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:34.567535 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79460a2-c801-442f-9217-88bc9be28d74 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:34.577901 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79460a2-c801-442f-9217-88bc9be28d74 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:34.625905 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:34.643919 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6824a-d3b1-4107-b05f-04463b2a9bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:34.644655 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6824a-d3b1-4107-b05f-04463b2a9bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:34.644973 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6824a-d3b1-4107-b05f-04463b2a9bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:34.645256 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6824a-d3b1-4107-b05f-04463b2a9bd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:34.645961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6824a-d3b1-4107-b05f-04463b2a9bd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:34.648391 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6824a-d3b1-4107-b05f-04463b2a9bd4 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:34.785697 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1047/2089] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:34 2022] POST /identity/v3/users => generated 283 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:34.790481 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d376a-9971-40a5-a4e9-90a51d47c3a3 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:34.800752 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d376a-9971-40a5-a4e9-90a51d47c3a3 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:34.805863 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d289ba-c8b9-4418-8e33-834fbc825541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:34.806435 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d289ba-c8b9-4418-8e33-834fbc825541 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:34.806725 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d289ba-c8b9-4418-8e33-834fbc825541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:34.807006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d289ba-c8b9-4418-8e33-834fbc825541 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:34.807782 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d289ba-c8b9-4418-8e33-834fbc825541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:34.809474 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d289ba-c8b9-4418-8e33-834fbc825541 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:34.820991 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1043/2090] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:34.827062 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6824a-d3b1-4107-b05f-04463b2a9bd4 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:34.839362 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6824a-d3b1-4107-b05f-04463b2a9bd4 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:34.844387 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c1a68a-fb98-4f28-87f9-3c7eb56cf1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:34.845086 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1a68a-fb98-4f28-87f9-3c7eb56cf1ca admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:34.845369 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1a68a-fb98-4f28-87f9-3c7eb56cf1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:34.845647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1a68a-fb98-4f28-87f9-3c7eb56cf1ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:34.846381 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c1a68a-fb98-4f28-87f9-3c7eb56cf1ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:34.848013 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c1a68a-fb98-4f28-87f9-3c7eb56cf1ca admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:34.860161 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1048/2091] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:34.864477 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d289ba-c8b9-4418-8e33-834fbc825541 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:34.874582 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d289ba-c8b9-4418-8e33-834fbc825541 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:34.879244 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03538f18-436e-43de-a7a0-9043b472fc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:34.880125 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03538f18-436e-43de-a7a0-9043b472fc72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:34.880414 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03538f18-436e-43de-a7a0-9043b472fc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:34.880694 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03538f18-436e-43de-a7a0-9043b472fc72 admin admin] PATH_INFO: `/v3/projects/18b1865bfbd84f069458d928951eb0e9/users/9dbf7a0099b4428a9541921a269ad350/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:34.897903 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03538f18-436e-43de-a7a0-9043b472fc72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18b1865bfbd84f069458d928951eb0e9, user_id=9dbf7a0099b4428a9541921a269ad350, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:34.900568 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03538f18-436e-43de-a7a0-9043b472fc72 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:34.986467 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1044/2092] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:34 2022] PUT /identity/v3/projects/18b1865bfbd84f069458d928951eb0e9/users/9dbf7a0099b4428a9541921a269ad350/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:34.997527 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2070963-a56c-475b-8946-6673ac724256 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:34.997842 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2070963-a56c-475b-8946-6673ac724256 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:34.998122 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2070963-a56c-475b-8946-6673ac724256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:35.025300 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-b2070963-a56c-475b-8946-6673ac724256 None None] MFA Rules not processed for user `9dbf7a0099b4428a9541921a269ad350`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:35.026509 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-b2070963-a56c-475b-8946-6673ac724256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:35.098394 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1049/2093] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:35.109837 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03538f18-436e-43de-a7a0-9043b472fc72 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:35.111525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-03538f18-436e-43de-a7a0-9043b472fc72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:35.171308 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03538f18-436e-43de-a7a0-9043b472fc72 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:35.175071 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f470c-2a25-445f-beec-bac01c3cd953 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:35.175723 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f470c-2a25-445f-beec-bac01c3cd953 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:35.176006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f470c-2a25-445f-beec-bac01c3cd953 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:35.176279 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f470c-2a25-445f-beec-bac01c3cd953 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:35.185073 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f470c-2a25-445f-beec-bac01c3cd953 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:35.186505 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f470c-2a25-445f-beec-bac01c3cd953 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:35.195235 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1045/2094] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:35 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:36.353957 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2070963-a56c-475b-8946-6673ac724256 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:36.355498 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-b2070963-a56c-475b-8946-6673ac724256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:36.426530 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2070963-a56c-475b-8946-6673ac724256 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:36.437066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164c1bd-101e-42c8-87bf-535a2b958ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:36.437066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164c1bd-101e-42c8-87bf-535a2b958ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:36.437066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164c1bd-101e-42c8-87bf-535a2b958ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:36.437066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164c1bd-101e-42c8-87bf-535a2b958ed5 admin admin] PATH_INFO: `/v3/users/dd0acf5ba82f4ef190a5ca49ff91afbc` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:36.437458 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c164c1bd-101e-42c8-87bf-535a2b958ed5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd0acf5ba82f4ef190a5ca49ff91afbc)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:36.439452 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c164c1bd-101e-42c8-87bf-535a2b958ed5 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:36.592924 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-c164c1bd-101e-42c8-87bf-535a2b958ed5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd0acf5ba82f4ef190a5ca49ff91afbc'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:36.593621 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-c164c1bd-101e-42c8-87bf-535a2b958ed5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd0acf5ba82f4ef190a5ca49ff91afbc'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:36.603053 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:36.643299 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-c164c1bd-101e-42c8-87bf-535a2b958ed5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd0acf5ba82f4ef190a5ca49ff91afbc'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:36.657589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-c164c1bd-101e-42c8-87bf-535a2b958ed5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd0acf5ba82f4ef190a5ca49ff91afbc'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:36.665581 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-c164c1bd-101e-42c8-87bf-535a2b958ed5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd0acf5ba82f4ef190a5ca49ff91afbc'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:36.672314 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1050/2095] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:20:36 2022] DELETE /identity/v3/users/dd0acf5ba82f4ef190a5ca49ff91afbc => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:36.676891 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad0cfc-234d-44f3-bee5-9dd1b2ebc6e1 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:36.677357 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad0cfc-234d-44f3-bee5-9dd1b2ebc6e1 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:36.677481 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad0cfc-234d-44f3-bee5-9dd1b2ebc6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:36.699997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-b6ad0cfc-234d-44f3-bee5-9dd1b2ebc6e1 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:36.701465 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-b6ad0cfc-234d-44f3-bee5-9dd1b2ebc6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:36.753993 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:36.763190 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1046/2096] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:36.774790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164c1bd-101e-42c8-87bf-535a2b958ed5 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:36.776240 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-c164c1bd-101e-42c8-87bf-535a2b958ed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:36.859109 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164c1bd-101e-42c8-87bf-535a2b958ed5 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:36.862931 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0765e-3726-48d9-922f-64e620d93fd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:36.863581 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0765e-3726-48d9-922f-64e620d93fd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:36.863869 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0765e-3726-48d9-922f-64e620d93fd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:36.864203 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0765e-3726-48d9-922f-64e620d93fd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:36.874372 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0765e-3726-48d9-922f-64e620d93fd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:36.876125 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0765e-3726-48d9-922f-64e620d93fd0 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:36.887451 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1051/2097] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:37.330528 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad0cfc-234d-44f3-bee5-9dd1b2ebc6e1 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:37.332226 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-b6ad0cfc-234d-44f3-bee5-9dd1b2ebc6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:37.352775 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad0cfc-234d-44f3-bee5-9dd1b2ebc6e1 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:37.357929 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d9408-1e7d-4479-86ba-04b79b448215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:37.358721 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d9408-1e7d-4479-86ba-04b79b448215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:37.359020 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d9408-1e7d-4479-86ba-04b79b448215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:37.359322 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d9408-1e7d-4479-86ba-04b79b448215 admin admin] PATH_INFO: `/v3/projects/644e43f453a54b108b796a64b536065f` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:37.360471 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d9408-1e7d-4479-86ba-04b79b448215 admin admin] RBAC: Authorizing `identity:delete_project(project_id=644e43f453a54b108b796a64b536065f)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:37.362466 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d9408-1e7d-4479-86ba-04b79b448215 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:37.466638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f67d9408-1e7d-4479-86ba-04b79b448215 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '644e43f453a54b108b796a64b536065f', 'request_id': 'req-f67d9408-1e7d-4479-86ba-04b79b448215'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:37.473546 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f67d9408-1e7d-4479-86ba-04b79b448215 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '644e43f453a54b108b796a64b536065f', 'request_id': 'req-f67d9408-1e7d-4479-86ba-04b79b448215'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:37.586490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f67d9408-1e7d-4479-86ba-04b79b448215 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '644e43f453a54b108b796a64b536065f', 'request_id': 'req-f67d9408-1e7d-4479-86ba-04b79b448215'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:37.597499 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f67d9408-1e7d-4479-86ba-04b79b448215 admin admin] The token cache is being invalidate because project 644e43f453a54b108b796a64b536065f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:20:37.597788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f67d9408-1e7d-4479-86ba-04b79b448215 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:37.598422 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f67d9408-1e7d-4479-86ba-04b79b448215 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:37.600123 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1047/2098] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:20:37 2022] DELETE /identity/v3/projects/644e43f453a54b108b796a64b536065f => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:37.605259 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0765e-3726-48d9-922f-64e620d93fd0 service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:37.615160 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0765e-3726-48d9-922f-64e620d93fd0 service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:37.684312 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bff7c0-6780-4627-9cd5-9c7ac2efc19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:37.686038 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bff7c0-6780-4627-9cd5-9c7ac2efc19f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:37.686483 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bff7c0-6780-4627-9cd5-9c7ac2efc19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:37.686774 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bff7c0-6780-4627-9cd5-9c7ac2efc19f admin admin] PATH_INFO: `/v3/users/7519f1c19cd34f619e7c0eb1777b03a8` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:37.688133 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bff7c0-6780-4627-9cd5-9c7ac2efc19f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7519f1c19cd34f619e7c0eb1777b03a8)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:37.690131 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bff7c0-6780-4627-9cd5-9c7ac2efc19f admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:37.874401 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-08bff7c0-6780-4627-9cd5-9c7ac2efc19f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7519f1c19cd34f619e7c0eb1777b03a8'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:37.875064 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-08bff7c0-6780-4627-9cd5-9c7ac2efc19f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7519f1c19cd34f619e7c0eb1777b03a8'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:37.878765 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:37.986032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d9408-1e7d-4479-86ba-04b79b448215 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:37.987465 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-f67d9408-1e7d-4479-86ba-04b79b448215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:37.991594 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-08bff7c0-6780-4627-9cd5-9c7ac2efc19f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7519f1c19cd34f619e7c0eb1777b03a8'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:38.010067 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-08bff7c0-6780-4627-9cd5-9c7ac2efc19f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7519f1c19cd34f619e7c0eb1777b03a8'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:38.013399 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d9408-1e7d-4479-86ba-04b79b448215 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:38.019591 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403814bc-f683-4f2f-b9c6-938bfbf72109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:38.019768 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-08bff7c0-6780-4627-9cd5-9c7ac2efc19f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7519f1c19cd34f619e7c0eb1777b03a8'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:38.021023 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403814bc-f683-4f2f-b9c6-938bfbf72109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:38.021508 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403814bc-f683-4f2f-b9c6-938bfbf72109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:38.022002 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403814bc-f683-4f2f-b9c6-938bfbf72109 admin admin] PATH_INFO: `/v3/users/05b5c269a8ba4cba9bbe7dc66dcad8f0` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:38.024487 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403814bc-f683-4f2f-b9c6-938bfbf72109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05b5c269a8ba4cba9bbe7dc66dcad8f0)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:38.027990 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1052/2099] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:20:37 2022] DELETE /identity/v3/users/7519f1c19cd34f619e7c0eb1777b03a8 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:38.028141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403814bc-f683-4f2f-b9c6-938bfbf72109 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:38.319802 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-403814bc-f683-4f2f-b9c6-938bfbf72109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05b5c269a8ba4cba9bbe7dc66dcad8f0'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:38.334126 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-403814bc-f683-4f2f-b9c6-938bfbf72109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05b5c269a8ba4cba9bbe7dc66dcad8f0'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:38.399269 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-403814bc-f683-4f2f-b9c6-938bfbf72109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05b5c269a8ba4cba9bbe7dc66dcad8f0'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:38.399870 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-403814bc-f683-4f2f-b9c6-938bfbf72109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05b5c269a8ba4cba9bbe7dc66dcad8f0'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:38.409469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-403814bc-f683-4f2f-b9c6-938bfbf72109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05b5c269a8ba4cba9bbe7dc66dcad8f0'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:38.417057 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1048/2100] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:20:37 2022] DELETE /identity/v3/users/05b5c269a8ba4cba9bbe7dc66dcad8f0 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:20:38.422108 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ed0fb-f7ff-433a-a470-6156f62f2485 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:38.422477 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ed0fb-f7ff-433a-a470-6156f62f2485 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:38.422785 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ed0fb-f7ff-433a-a470-6156f62f2485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:38.440992 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-2a4ed0fb-f7ff-433a-a470-6156f62f2485 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:38.442254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-2a4ed0fb-f7ff-433a-a470-6156f62f2485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:38.524230 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1053/2101] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:38.533966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403814bc-f683-4f2f-b9c6-938bfbf72109 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:38.535400 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-403814bc-f683-4f2f-b9c6-938bfbf72109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:38.598287 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403814bc-f683-4f2f-b9c6-938bfbf72109 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:38.607205 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3b66f-d5d9-4ccc-abc0-c2320a2a2de6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:38.607399 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ed0fb-f7ff-433a-a470-6156f62f2485 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:38.607928 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3b66f-d5d9-4ccc-abc0-c2320a2a2de6 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:38.607928 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3b66f-d5d9-4ccc-abc0-c2320a2a2de6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:38.607928 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3b66f-d5d9-4ccc-abc0-c2320a2a2de6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:38.608298 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-2a4ed0fb-f7ff-433a-a470-6156f62f2485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:38.622003 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ed0fb-f7ff-433a-a470-6156f62f2485 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:38.623792 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3b66f-d5d9-4ccc-abc0-c2320a2a2de6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:38.627114 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1244f8-381c-40da-8f55-9119a1612196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:38.630686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1244f8-381c-40da-8f55-9119a1612196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:38.630686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1244f8-381c-40da-8f55-9119a1612196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:38.630686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1244f8-381c-40da-8f55-9119a1612196 admin admin] PATH_INFO: `/v3/projects/8b889b4d757844948c95bed8c1b59862` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:38.631111 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3b66f-d5d9-4ccc-abc0-c2320a2a2de6 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:38.631198 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1244f8-381c-40da-8f55-9119a1612196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b889b4d757844948c95bed8c1b59862)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:38.631874 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1244f8-381c-40da-8f55-9119a1612196 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:38.639136 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:38.649367 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1049/2102] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:38.806752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-6d1244f8-381c-40da-8f55-9119a1612196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b889b4d757844948c95bed8c1b59862', 'request_id': 'req-6d1244f8-381c-40da-8f55-9119a1612196'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:38.818483 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-6d1244f8-381c-40da-8f55-9119a1612196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b889b4d757844948c95bed8c1b59862', 'request_id': 'req-6d1244f8-381c-40da-8f55-9119a1612196'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:38.969810 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-6d1244f8-381c-40da-8f55-9119a1612196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b889b4d757844948c95bed8c1b59862', 'request_id': 'req-6d1244f8-381c-40da-8f55-9119a1612196'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:38.997392 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-6d1244f8-381c-40da-8f55-9119a1612196 admin admin] The token cache is being invalidate because project 8b889b4d757844948c95bed8c1b59862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:20:39.005097 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-6d1244f8-381c-40da-8f55-9119a1612196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:39.005097 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-6d1244f8-381c-40da-8f55-9119a1612196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:39.005097 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1054/2103] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:20:38 2022] DELETE /identity/v3/projects/8b889b4d757844948c95bed8c1b59862 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:20:39.015841 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc133921-8260-45b8-829e-04dff8a81c58 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:39.016375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc133921-8260-45b8-829e-04dff8a81c58 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:39.016751 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc133921-8260-45b8-829e-04dff8a81c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:39.037012 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-dc133921-8260-45b8-829e-04dff8a81c58 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:39.038412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-dc133921-8260-45b8-829e-04dff8a81c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:39.103372 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1050/2104] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:39.112051 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa54a5b-b194-4cb6-b693-a7b5d426b8ed None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:39.112340 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa54a5b-b194-4cb6-b693-a7b5d426b8ed None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:39.112617 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa54a5b-b194-4cb6-b693-a7b5d426b8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:39.131433 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-6fa54a5b-b194-4cb6-b693-a7b5d426b8ed None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:39.135380 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-6fa54a5b-b194-4cb6-b693-a7b5d426b8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:39.143582 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc133921-8260-45b8-829e-04dff8a81c58 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:39.143582 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-dc133921-8260-45b8-829e-04dff8a81c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:39.144013 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1055/2105] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:39.146383 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa54a5b-b194-4cb6-b693-a7b5d426b8ed None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:39.156037 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa54a5b-b194-4cb6-b693-a7b5d426b8ed None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:39.163721 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc133921-8260-45b8-829e-04dff8a81c58 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:39.164300 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d615ee-a933-43ef-a6a3-5401386d82f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:39.165247 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d615ee-a933-43ef-a6a3-5401386d82f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:39.165624 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d615ee-a933-43ef-a6a3-5401386d82f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:39.165999 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d615ee-a933-43ef-a6a3-5401386d82f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:39.166940 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d615ee-a933-43ef-a6a3-5401386d82f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:20:39.167402 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d615ee-a933-43ef-a6a3-5401386d82f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:39.169051 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87e17f-d8f8-42a0-b748-a30b88cdcafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:39.169344 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d615ee-a933-43ef-a6a3-5401386d82f1 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:39.170442 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87e17f-d8f8-42a0-b748-a30b88cdcafa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:39.170731 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87e17f-d8f8-42a0-b748-a30b88cdcafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:39.171008 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87e17f-d8f8-42a0-b748-a30b88cdcafa admin admin] PATH_INFO: `/v3/projects/1126d5b782224717b7374cb8ecbddc5a` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:39.172240 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87e17f-d8f8-42a0-b748-a30b88cdcafa admin admin] RBAC: Authorizing `identity:delete_project(project_id=1126d5b782224717b7374cb8ecbddc5a)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:39.174309 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87e17f-d8f8-42a0-b748-a30b88cdcafa admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:39.182708 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1056/2106] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:20:39.187240 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d615ee-a933-43ef-a6a3-5401386d82f1 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:39.201844 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d615ee-a933-43ef-a6a3-5401386d82f1 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:39.206862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef43f4-3fad-48ba-afaf-92a5090f67d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:39.207568 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef43f4-3fad-48ba-afaf-92a5090f67d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:39.207836 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef43f4-3fad-48ba-afaf-92a5090f67d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:39.208114 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef43f4-3fad-48ba-afaf-92a5090f67d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:39.208862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef43f4-3fad-48ba-afaf-92a5090f67d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:39.210947 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef43f4-3fad-48ba-afaf-92a5090f67d6 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:39.308742 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-9e87e17f-d8f8-42a0-b748-a30b88cdcafa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1126d5b782224717b7374cb8ecbddc5a', 'request_id': 'req-9e87e17f-d8f8-42a0-b748-a30b88cdcafa'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:39.315524 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-9e87e17f-d8f8-42a0-b748-a30b88cdcafa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1126d5b782224717b7374cb8ecbddc5a', 'request_id': 'req-9e87e17f-d8f8-42a0-b748-a30b88cdcafa'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:39.334569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1057/2107] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:39 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:20:39.336695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef43f4-3fad-48ba-afaf-92a5090f67d6 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:39.349730 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:39.403636 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-9e87e17f-d8f8-42a0-b748-a30b88cdcafa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1126d5b782224717b7374cb8ecbddc5a', 'request_id': 'req-9e87e17f-d8f8-42a0-b748-a30b88cdcafa'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:39.408414 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef43f4-3fad-48ba-afaf-92a5090f67d6 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:39.416844 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efc48a-55f1-4cd9-8cf5-5abaa08dfb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:39.417531 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efc48a-55f1-4cd9-8cf5-5abaa08dfb7c admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:39.425256 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efc48a-55f1-4cd9-8cf5-5abaa08dfb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:39.425256 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efc48a-55f1-4cd9-8cf5-5abaa08dfb7c admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:39.425256 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3efc48a-55f1-4cd9-8cf5-5abaa08dfb7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:39.425256 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3efc48a-55f1-4cd9-8cf5-5abaa08dfb7c admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:39.425580 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-9e87e17f-d8f8-42a0-b748-a30b88cdcafa admin admin] The token cache is being invalidate because project 1126d5b782224717b7374cb8ecbddc5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:20:39.425580 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-9e87e17f-d8f8-42a0-b748-a30b88cdcafa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:39.425580 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-9e87e17f-d8f8-42a0-b748-a30b88cdcafa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:39.425580 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1051/2108] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:20:39 2022] DELETE /identity/v3/projects/1126d5b782224717b7374cb8ecbddc5a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:39.553111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1058/2109] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:39 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:39.559141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87e17f-d8f8-42a0-b748-a30b88cdcafa admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:39.563675 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-9e87e17f-d8f8-42a0-b748-a30b88cdcafa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:39.642476 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87e17f-d8f8-42a0-b748-a30b88cdcafa admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:39.648408 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dea357-bfef-4935-819a-3d3b8e82e6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:39.649122 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dea357-bfef-4935-819a-3d3b8e82e6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:39.649438 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dea357-bfef-4935-819a-3d3b8e82e6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:39.649716 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dea357-bfef-4935-819a-3d3b8e82e6e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:39.650505 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dea357-bfef-4935-819a-3d3b8e82e6e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:39.652203 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dea357-bfef-4935-819a-3d3b8e82e6e9 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:39.666028 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1052/2110] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:39.670833 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efc48a-55f1-4cd9-8cf5-5abaa08dfb7c admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:39.683250 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efc48a-55f1-4cd9-8cf5-5abaa08dfb7c admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:39.689018 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de356b-ccb4-4ca7-8b1d-e376d92a5057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:39.690067 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de356b-ccb4-4ca7-8b1d-e376d92a5057 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:39.690348 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de356b-ccb4-4ca7-8b1d-e376d92a5057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:39.691870 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de356b-ccb4-4ca7-8b1d-e376d92a5057 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:39.692618 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de356b-ccb4-4ca7-8b1d-e376d92a5057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:39.694295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de356b-ccb4-4ca7-8b1d-e376d92a5057 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:39.706028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1059/2111] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:39.710422 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dea357-bfef-4935-819a-3d3b8e82e6e9 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:39.722694 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dea357-bfef-4935-819a-3d3b8e82e6e9 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:39.727734 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d9a68-67b8-4cee-a300-b850f585f414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:39.728522 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d9a68-67b8-4cee-a300-b850f585f414 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:39.728797 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d9a68-67b8-4cee-a300-b850f585f414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:39.729106 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d9a68-67b8-4cee-a300-b850f585f414 admin admin] PATH_INFO: `/v3/projects/68b7839e4b984665bfbcf49c8f5cfc11/users/bc89daab9a6d4c839d64f7c8eb894503/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:39.745766 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d9a68-67b8-4cee-a300-b850f585f414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68b7839e4b984665bfbcf49c8f5cfc11, user_id=bc89daab9a6d4c839d64f7c8eb894503, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:39.748755 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d9a68-67b8-4cee-a300-b850f585f414 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:39.751290 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:39.855751 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1053/2112] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:39 2022] PUT /identity/v3/projects/68b7839e4b984665bfbcf49c8f5cfc11/users/bc89daab9a6d4c839d64f7c8eb894503/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:39.869533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee08f60-7188-480d-a3d6-b561dd00fe9e None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:39.872461 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee08f60-7188-480d-a3d6-b561dd00fe9e None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:39.872461 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee08f60-7188-480d-a3d6-b561dd00fe9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:39.909526 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-cee08f60-7188-480d-a3d6-b561dd00fe9e None None] MFA Rules not processed for user `bc89daab9a6d4c839d64f7c8eb894503`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:39.910753 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-cee08f60-7188-480d-a3d6-b561dd00fe9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:39.977039 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1060/2113] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:39.987842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d9a68-67b8-4cee-a300-b850f585f414 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:39.989613 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-b92d9a68-67b8-4cee-a300-b850f585f414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:40.051094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d9a68-67b8-4cee-a300-b850f585f414 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:40.055390 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4687fc-6acb-4727-bf47-9253da83b957 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:40.056047 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4687fc-6acb-4727-bf47-9253da83b957 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:40.056336 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4687fc-6acb-4727-bf47-9253da83b957 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:40.056617 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4687fc-6acb-4727-bf47-9253da83b957 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:40.065378 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4687fc-6acb-4727-bf47-9253da83b957 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:40.066818 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4687fc-6acb-4727-bf47-9253da83b957 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:40.075894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1054/2114] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:49.974091 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=61,keystone:INSERT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:50.071831 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:INSERT=1,keystone:SELECT=28 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:53.876627 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee08f60-7188-480d-a3d6-b561dd00fe9e None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:53.877200 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-cee08f60-7188-480d-a3d6-b561dd00fe9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:53.958763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee08f60-7188-480d-a3d6-b561dd00fe9e None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:53.966888 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e164d04e-18b1-4d95-8718-007a03bca1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:53.969088 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164d04e-18b1-4d95-8718-007a03bca1fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:53.969555 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164d04e-18b1-4d95-8718-007a03bca1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:53.970015 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164d04e-18b1-4d95-8718-007a03bca1fb admin admin] PATH_INFO: `/v3/users/9dbf7a0099b4428a9541921a269ad350` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:53.971688 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e164d04e-18b1-4d95-8718-007a03bca1fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dbf7a0099b4428a9541921a269ad350)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:53.974272 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e164d04e-18b1-4d95-8718-007a03bca1fb admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:54.192140 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-e164d04e-18b1-4d95-8718-007a03bca1fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dbf7a0099b4428a9541921a269ad350'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:54.192896 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-e164d04e-18b1-4d95-8718-007a03bca1fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dbf7a0099b4428a9541921a269ad350'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:54.274163 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-e164d04e-18b1-4d95-8718-007a03bca1fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dbf7a0099b4428a9541921a269ad350'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:54.289633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-e164d04e-18b1-4d95-8718-007a03bca1fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dbf7a0099b4428a9541921a269ad350'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:54.297770 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-e164d04e-18b1-4d95-8718-007a03bca1fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dbf7a0099b4428a9541921a269ad350'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:54.304521 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1061/2115] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:20:53 2022] DELETE /identity/v3/users/9dbf7a0099b4428a9541921a269ad350 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:54.309761 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a393ff-b6d0-4fde-a960-983d7adffa0e None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:54.310245 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a393ff-b6d0-4fde-a960-983d7adffa0e None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:54.310373 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a393ff-b6d0-4fde-a960-983d7adffa0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:54.329444 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-10a393ff-b6d0-4fde-a960-983d7adffa0e None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:54.331511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-10a393ff-b6d0-4fde-a960-983d7adffa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:54.404641 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1055/2116] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:20:54.426660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e164d04e-18b1-4d95-8718-007a03bca1fb admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:54.426660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-e164d04e-18b1-4d95-8718-007a03bca1fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:54.476922 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e164d04e-18b1-4d95-8718-007a03bca1fb admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:54.481075 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beef528-31d1-4db8-9fde-9b963ef77cb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:54.481721 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beef528-31d1-4db8-9fde-9b963ef77cb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:54.482041 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beef528-31d1-4db8-9fde-9b963ef77cb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:54.482311 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beef528-31d1-4db8-9fde-9b963ef77cb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:54.492198 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beef528-31d1-4db8-9fde-9b963ef77cb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:54.494379 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beef528-31d1-4db8-9fde-9b963ef77cb2 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:54.504668 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1062/2117] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:54.594115 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a393ff-b6d0-4fde-a960-983d7adffa0e None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:54.595586 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-10a393ff-b6d0-4fde-a960-983d7adffa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:54.607983 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a393ff-b6d0-4fde-a960-983d7adffa0e None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:54.612765 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ed3a2-a7fe-493c-b5ee-b20e76fd67f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:54.613707 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ed3a2-a7fe-493c-b5ee-b20e76fd67f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:54.613999 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ed3a2-a7fe-493c-b5ee-b20e76fd67f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:54.614278 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ed3a2-a7fe-493c-b5ee-b20e76fd67f4 admin admin] PATH_INFO: `/v3/users/bc89daab9a6d4c839d64f7c8eb894503` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:54.615523 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ed3a2-a7fe-493c-b5ee-b20e76fd67f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc89daab9a6d4c839d64f7c8eb894503)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:54.617523 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ed3a2-a7fe-493c-b5ee-b20e76fd67f4 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:54.870813 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-677ed3a2-a7fe-493c-b5ee-b20e76fd67f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc89daab9a6d4c839d64f7c8eb894503'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:54.883142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-677ed3a2-a7fe-493c-b5ee-b20e76fd67f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc89daab9a6d4c839d64f7c8eb894503'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:54.933830 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beef528-31d1-4db8-9fde-9b963ef77cb2 service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:54.935312 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-5beef528-31d1-4db8-9fde-9b963ef77cb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:54.948294 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beef528-31d1-4db8-9fde-9b963ef77cb2 service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:54.953559 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fffb1-3c3f-41a1-b607-39d6da267051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:54.954604 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fffb1-3c3f-41a1-b607-39d6da267051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:54.954886 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fffb1-3c3f-41a1-b607-39d6da267051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:54.955160 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fffb1-3c3f-41a1-b607-39d6da267051 admin admin] PATH_INFO: `/v3/projects/18b1865bfbd84f069458d928951eb0e9` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:54.955270 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-677ed3a2-a7fe-493c-b5ee-b20e76fd67f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc89daab9a6d4c839d64f7c8eb894503'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:54.955991 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-677ed3a2-a7fe-493c-b5ee-b20e76fd67f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc89daab9a6d4c839d64f7c8eb894503'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:54.956376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14fffb1-3c3f-41a1-b607-39d6da267051 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18b1865bfbd84f069458d928951eb0e9)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:54.960573 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14fffb1-3c3f-41a1-b607-39d6da267051 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:54.974451 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-677ed3a2-a7fe-493c-b5ee-b20e76fd67f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc89daab9a6d4c839d64f7c8eb894503'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:54.981872 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1056/2118] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:20:54 2022] DELETE /identity/v3/users/bc89daab9a6d4c839d64f7c8eb894503 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:54.985967 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:54.986106 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb9901-6342-4b24-b690-020e7f14736f None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:54.986388 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb9901-6342-4b24-b690-020e7f14736f None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:54.986664 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb9901-6342-4b24-b690-020e7f14736f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:55.004137 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-98bb9901-6342-4b24-b690-020e7f14736f None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:55.005546 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-98bb9901-6342-4b24-b690-020e7f14736f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:55.075246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1057/2119] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:20:55.085457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb9901-6342-4b24-b690-020e7f14736f None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:55.086891 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-98bb9901-6342-4b24-b690-020e7f14736f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:55.100415 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-a14fffb1-3c3f-41a1-b607-39d6da267051 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18b1865bfbd84f069458d928951eb0e9', 'request_id': 'req-a14fffb1-3c3f-41a1-b607-39d6da267051'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:55.104120 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:55.108325 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-a14fffb1-3c3f-41a1-b607-39d6da267051 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18b1865bfbd84f069458d928951eb0e9', 'request_id': 'req-a14fffb1-3c3f-41a1-b607-39d6da267051'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:55.166870 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb9901-6342-4b24-b690-020e7f14736f None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:55.200530 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-a14fffb1-3c3f-41a1-b607-39d6da267051 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18b1865bfbd84f069458d928951eb0e9', 'request_id': 'req-a14fffb1-3c3f-41a1-b607-39d6da267051'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:55.214331 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-a14fffb1-3c3f-41a1-b607-39d6da267051 admin admin] The token cache is being invalidate because project 18b1865bfbd84f069458d928951eb0e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:20:55.215349 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-a14fffb1-3c3f-41a1-b607-39d6da267051 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:55.216451 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-a14fffb1-3c3f-41a1-b607-39d6da267051 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:55.222386 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1063/2120] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:20:54 2022] DELETE /identity/v3/projects/18b1865bfbd84f069458d928951eb0e9 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:55.230390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ace94f-8337-4d08-90e2-3c69f7046d01 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:55.230768 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ace94f-8337-4d08-90e2-3c69f7046d01 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:55.231117 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ace94f-8337-4d08-90e2-3c69f7046d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:55.237762 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a5ba44-407e-4f15-9046-9a972d1b1c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:55.238435 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5ba44-407e-4f15-9046-9a972d1b1c2f service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:55.238719 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5ba44-407e-4f15-9046-9a972d1b1c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:55.239000 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5ba44-407e-4f15-9046-9a972d1b1c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:55.241101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-b5a5ba44-407e-4f15-9046-9a972d1b1c2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:55.269059 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-14ace94f-8337-4d08-90e2-3c69f7046d01 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:55.270701 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-14ace94f-8337-4d08-90e2-3c69f7046d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:55.331470 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a5ba44-407e-4f15-9046-9a972d1b1c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:55.333146 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a5ba44-407e-4f15-9046-9a972d1b1c2f service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:55.344748 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1058/2121] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:20:55.363612 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1064/2122] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:55.374771 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045d234-ca50-414d-9f4a-12e59a8d7f16 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:55.374771 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045d234-ca50-414d-9f4a-12e59a8d7f16 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:55.374771 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045d234-ca50-414d-9f4a-12e59a8d7f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:55.401859 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-9045d234-ca50-414d-9f4a-12e59a8d7f16 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:55.405326 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-9045d234-ca50-414d-9f4a-12e59a8d7f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:55.426666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1059/2123] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:55.432261 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ace94f-8337-4d08-90e2-3c69f7046d01 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:55.445986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ace94f-8337-4d08-90e2-3c69f7046d01 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:55.452572 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ef60e-f936-4e5c-8da2-3ce5d5236a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:55.453213 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ef60e-f936-4e5c-8da2-3ce5d5236a84 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:55.453503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ef60e-f936-4e5c-8da2-3ce5d5236a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:55.453784 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ef60e-f936-4e5c-8da2-3ce5d5236a84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:55.454533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ef60e-f936-4e5c-8da2-3ce5d5236a84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:20:55.454849 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ef60e-f936-4e5c-8da2-3ce5d5236a84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:55.457201 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ef60e-f936-4e5c-8da2-3ce5d5236a84 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:55.470749 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1065/2124] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:20:55.478051 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045d234-ca50-414d-9f4a-12e59a8d7f16 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:55.484718 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045d234-ca50-414d-9f4a-12e59a8d7f16 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:55.489564 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9860c532-a41d-4027-9a19-f50790e1d2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:55.490225 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860c532-a41d-4027-9a19-f50790e1d2bc admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:55.490507 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860c532-a41d-4027-9a19-f50790e1d2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:55.490781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860c532-a41d-4027-9a19-f50790e1d2bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:55.491484 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9860c532-a41d-4027-9a19-f50790e1d2bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:55.493957 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9860c532-a41d-4027-9a19-f50790e1d2bc admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:55.648168 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1060/2125] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:55 2022] POST /identity/v3/projects => generated 403 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:55.652230 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ef60e-f936-4e5c-8da2-3ce5d5236a84 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:55.670534 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ef60e-f936-4e5c-8da2-3ce5d5236a84 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:55.741390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcd1b6-be19-4bef-bfb7-88c647651a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:55.742141 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcd1b6-be19-4bef-bfb7-88c647651a83 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:55.742433 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcd1b6-be19-4bef-bfb7-88c647651a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:55.742863 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcd1b6-be19-4bef-bfb7-88c647651a83 admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:55.744169 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcd1b6-be19-4bef-bfb7-88c647651a83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:55.746194 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcd1b6-be19-4bef-bfb7-88c647651a83 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:55.863734 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1066/2126] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:55 2022] POST /identity/v3/users => generated 302 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:55.867664 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9860c532-a41d-4027-9a19-f50790e1d2bc admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:55.878549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9860c532-a41d-4027-9a19-f50790e1d2bc admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:55.883340 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75ecaa-c186-4546-b501-d0b7300b9ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:55.884030 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75ecaa-c186-4546-b501-d0b7300b9ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:55.884314 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75ecaa-c186-4546-b501-d0b7300b9ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:55.884593 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75ecaa-c186-4546-b501-d0b7300b9ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:55.885363 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee75ecaa-c186-4546-b501-d0b7300b9ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:55.886978 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee75ecaa-c186-4546-b501-d0b7300b9ff0 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:55.897203 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1061/2127] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:55.901316 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcd1b6-be19-4bef-bfb7-88c647651a83 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:55.911344 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcd1b6-be19-4bef-bfb7-88c647651a83 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:55.917493 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75ecaa-c186-4546-b501-d0b7300b9ff0 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:55.921631 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-ee75ecaa-c186-4546-b501-d0b7300b9ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:55.923174 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5ee34-5062-4ec4-af21-d691ce426d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:55.923330 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5ee34-5062-4ec4-af21-d691ce426d35 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:55.923680 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5ee34-5062-4ec4-af21-d691ce426d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:55.923963 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5ee34-5062-4ec4-af21-d691ce426d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:55.924880 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5ee34-5062-4ec4-af21-d691ce426d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:55.926558 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5ee34-5062-4ec4-af21-d691ce426d35 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:55.937010 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75ecaa-c186-4546-b501-d0b7300b9ff0 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:55.938765 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1067/2128] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:55.942574 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5ee34-5062-4ec4-af21-d691ce426d35 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:55.948441 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:55.950843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9edfc2-36d1-4eb0-8574-0cd7832d55c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:55.951896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9edfc2-36d1-4eb0-8574-0cd7832d55c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:55.952248 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9edfc2-36d1-4eb0-8574-0cd7832d55c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:55.952524 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9edfc2-36d1-4eb0-8574-0cd7832d55c2 admin admin] PATH_INFO: `/v3/projects/68b7839e4b984665bfbcf49c8f5cfc11` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:55.953795 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9edfc2-36d1-4eb0-8574-0cd7832d55c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68b7839e4b984665bfbcf49c8f5cfc11)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:55.955210 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5ee34-5062-4ec4-af21-d691ce426d35 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:55.955734 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9edfc2-36d1-4eb0-8574-0cd7832d55c2 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:55.960678 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8effc-d5fb-4c9e-8fbc-4ff30e36dba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:55.961643 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8effc-d5fb-4c9e-8fbc-4ff30e36dba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:55.961921 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8effc-d5fb-4c9e-8fbc-4ff30e36dba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:55.962196 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8effc-d5fb-4c9e-8fbc-4ff30e36dba8 admin admin] PATH_INFO: `/v3/projects/a9135071ad4c4d8e821a2d000ca5068d/users/97085ade451a4940ad5a67f50bb84725/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:55.979125 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8effc-d5fb-4c9e-8fbc-4ff30e36dba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9135071ad4c4d8e821a2d000ca5068d, user_id=97085ade451a4940ad5a67f50bb84725, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:55.982026 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8effc-d5fb-4c9e-8fbc-4ff30e36dba8 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:56.130404 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1068/2129] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:55 2022] PUT /identity/v3/projects/a9135071ad4c4d8e821a2d000ca5068d/users/97085ade451a4940ad5a67f50bb84725/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:20:56.134387 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:56.140752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254c088-e9b5-4c42-94b6-cd84eaca9ab0 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:56.141077 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254c088-e9b5-4c42-94b6-cd84eaca9ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:56.141360 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254c088-e9b5-4c42-94b6-cd84eaca9ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:56.143162 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-7b9edfc2-36d1-4eb0-8574-0cd7832d55c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68b7839e4b984665bfbcf49c8f5cfc11', 'request_id': 'req-7b9edfc2-36d1-4eb0-8574-0cd7832d55c2'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:56.150444 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-7b9edfc2-36d1-4eb0-8574-0cd7832d55c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68b7839e4b984665bfbcf49c8f5cfc11', 'request_id': 'req-7b9edfc2-36d1-4eb0-8574-0cd7832d55c2'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:56.170151 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-d254c088-e9b5-4c42-94b6-cd84eaca9ab0 None None] MFA Rules not processed for user `97085ade451a4940ad5a67f50bb84725`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:56.171384 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-d254c088-e9b5-4c42-94b6-cd84eaca9ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:56.229430 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-7b9edfc2-36d1-4eb0-8574-0cd7832d55c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68b7839e4b984665bfbcf49c8f5cfc11', 'request_id': 'req-7b9edfc2-36d1-4eb0-8574-0cd7832d55c2'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:56.235431 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1069/2130] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:20:56.239896 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254c088-e9b5-4c42-94b6-cd84eaca9ab0 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:56.240809 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-7b9edfc2-36d1-4eb0-8574-0cd7832d55c2 admin admin] The token cache is being invalidate because project 68b7839e4b984665bfbcf49c8f5cfc11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:20:56.241131 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-7b9edfc2-36d1-4eb0-8574-0cd7832d55c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:56.241839 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-7b9edfc2-36d1-4eb0-8574-0cd7832d55c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:56.243992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1062/2131] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:20:55 2022] DELETE /identity/v3/projects/68b7839e4b984665bfbcf49c8f5cfc11 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:56.249460 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751589a-a13d-4a80-b5f2-4c9a40f0f08a None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:56.249750 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751589a-a13d-4a80-b5f2-4c9a40f0f08a None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:56.250033 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751589a-a13d-4a80-b5f2-4c9a40f0f08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:56.269126 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-f751589a-a13d-4a80-b5f2-4c9a40f0f08a None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:56.270424 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-f751589a-a13d-4a80-b5f2-4c9a40f0f08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:56.311999 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254c088-e9b5-4c42-94b6-cd84eaca9ab0 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:56.317505 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0480c6-c26d-4dd6-9102-8d6d5cf9065c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:56.318530 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0480c6-c26d-4dd6-9102-8d6d5cf9065c admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:56.318915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0480c6-c26d-4dd6-9102-8d6d5cf9065c admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:56.319240 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0480c6-c26d-4dd6-9102-8d6d5cf9065c admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:56.319856 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0480c6-c26d-4dd6-9102-8d6d5cf9065c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:56.322428 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0480c6-c26d-4dd6-9102-8d6d5cf9065c admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:56.335223 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1063/2132] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:20:56.341956 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54a8cb-dda5-4a2e-9d82-26c049be1028 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:56.342374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54a8cb-dda5-4a2e-9d82-26c049be1028 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:56.343425 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54a8cb-dda5-4a2e-9d82-26c049be1028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:56.369524 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-cd54a8cb-dda5-4a2e-9d82-26c049be1028 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:56.370849 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-cd54a8cb-dda5-4a2e-9d82-26c049be1028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:56.380590 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1064/2133] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:20:56.382332 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb69382-5bde-4096-9fa8-a2e27d6e3054 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:56.384929 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb69382-5bde-4096-9fa8-a2e27d6e3054 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:56.384929 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb69382-5bde-4096-9fa8-a2e27d6e3054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:56.402417 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-6bb69382-5bde-4096-9fa8-a2e27d6e3054 None None] MFA Rules not processed for user `c2e02737f0cc423d95db9c3324f7215e`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:56.403544 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-6bb69382-5bde-4096-9fa8-a2e27d6e3054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:56.466302 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1070/2134] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:56 2022] POST /identity/v3/projects => generated 405 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:20:56.466302 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0480c6-c26d-4dd6-9102-8d6d5cf9065c admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:56.468425 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1065/2135] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:56.469362 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb69382-5bde-4096-9fa8-a2e27d6e3054 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:56.471249 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-6bb69382-5bde-4096-9fa8-a2e27d6e3054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:56.489266 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb69382-5bde-4096-9fa8-a2e27d6e3054 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:56.525315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:56.539269 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0480c6-c26d-4dd6-9102-8d6d5cf9065c admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:56.545138 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58377e12-cc43-4b57-aa10-fd9572b39fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:56.545837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58377e12-cc43-4b57-aa10-fd9572b39fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:56.546121 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58377e12-cc43-4b57-aa10-fd9572b39fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:56.546403 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58377e12-cc43-4b57-aa10-fd9572b39fe5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:56.547214 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58377e12-cc43-4b57-aa10-fd9572b39fe5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:20:56.547528 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58377e12-cc43-4b57-aa10-fd9572b39fe5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:56.549184 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58377e12-cc43-4b57-aa10-fd9572b39fe5 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:56.563794 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1071/2136] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:20:56.567859 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58377e12-cc43-4b57-aa10-fd9572b39fe5 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:56.573916 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31176162-ce38-4c11-a340-cace8853b999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:56.574766 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31176162-ce38-4c11-a340-cace8853b999 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:56.575429 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31176162-ce38-4c11-a340-cace8853b999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:56.576504 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31176162-ce38-4c11-a340-cace8853b999 admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:56.577273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31176162-ce38-4c11-a340-cace8853b999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:56.578643 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58377e12-cc43-4b57-aa10-fd9572b39fe5 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:56.580076 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31176162-ce38-4c11-a340-cace8853b999 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:56.583890 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f0ff8-d030-4a0a-bcc9-8c565fbb9567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:56.584638 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f0ff8-d030-4a0a-bcc9-8c565fbb9567 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:56.585024 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f0ff8-d030-4a0a-bcc9-8c565fbb9567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:56.585376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f0ff8-d030-4a0a-bcc9-8c565fbb9567 admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:56.586161 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f0ff8-d030-4a0a-bcc9-8c565fbb9567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:56.588291 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f0ff8-d030-4a0a-bcc9-8c565fbb9567 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:56.712694 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1066/2137] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:56 2022] POST /identity/v3/users => generated 309 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:56.713957 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31176162-ce38-4c11-a340-cace8853b999 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:56.717034 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1072/2138] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:56 2022] POST /identity/v3/projects => generated 365 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:20:56.717950 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f0ff8-d030-4a0a-bcc9-8c565fbb9567 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:56.724860 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31176162-ce38-4c11-a340-cace8853b999 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:56.786129 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f0ff8-d030-4a0a-bcc9-8c565fbb9567 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:56.791407 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5ca00-5336-4e92-babc-67b634e8d791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:56.792087 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5ca00-5336-4e92-babc-67b634e8d791 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:56.792369 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5ca00-5336-4e92-babc-67b634e8d791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:56.792468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1f684-75e2-4820-b641-cfde0b1307da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:56.792650 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5ca00-5336-4e92-babc-67b634e8d791 admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:56.793249 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1f684-75e2-4820-b641-cfde0b1307da admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:56.793352 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f5ca00-5336-4e92-babc-67b634e8d791 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:56.793603 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1f684-75e2-4820-b641-cfde0b1307da admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:56.793955 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1f684-75e2-4820-b641-cfde0b1307da admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:56.794776 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1f684-75e2-4820-b641-cfde0b1307da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:56.795332 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f5ca00-5336-4e92-babc-67b634e8d791 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:56.796705 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1f684-75e2-4820-b641-cfde0b1307da admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:56.810918 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1067/2139] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:20:56.815160 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1f684-75e2-4820-b641-cfde0b1307da admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:56.826302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1f684-75e2-4820-b641-cfde0b1307da admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:56.831717 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e2908-29a9-461a-9725-d1fa1a07d9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:56.832618 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e2908-29a9-461a-9725-d1fa1a07d9ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:56.832932 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e2908-29a9-461a-9725-d1fa1a07d9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:56.833213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e2908-29a9-461a-9725-d1fa1a07d9ac admin admin] PATH_INFO: `/v3/projects/c899bc0f3f424ebd82886b394da70a41/users/3402bd824f6e42639802177d40429c31/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:56.844312 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:56.851743 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e2908-29a9-461a-9725-d1fa1a07d9ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c899bc0f3f424ebd82886b394da70a41, user_id=3402bd824f6e42639802177d40429c31, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:56.855181 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e2908-29a9-461a-9725-d1fa1a07d9ac admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:56.876008 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1073/2140] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:56 2022] POST /identity/v3/users => generated 283 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:20:56.880357 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5ca00-5336-4e92-babc-67b634e8d791 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:56.891160 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5ca00-5336-4e92-babc-67b634e8d791 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:56.896078 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa274b2-8797-49d3-b8cf-d9f7fd6f3121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:56.897076 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa274b2-8797-49d3-b8cf-d9f7fd6f3121 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:56.897513 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa274b2-8797-49d3-b8cf-d9f7fd6f3121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:56.897860 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa274b2-8797-49d3-b8cf-d9f7fd6f3121 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:56.898556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa274b2-8797-49d3-b8cf-d9f7fd6f3121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:56.900254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa274b2-8797-49d3-b8cf-d9f7fd6f3121 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:56.914703 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1074/2141] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:56.916414 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa274b2-8797-49d3-b8cf-d9f7fd6f3121 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:56.926966 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa274b2-8797-49d3-b8cf-d9f7fd6f3121 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:56.933078 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44226f-d3a3-4fa0-ac7b-173974cbd5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:56.933764 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44226f-d3a3-4fa0-ac7b-173974cbd5b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:56.934051 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44226f-d3a3-4fa0-ac7b-173974cbd5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:56.934335 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44226f-d3a3-4fa0-ac7b-173974cbd5b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:56.935081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44226f-d3a3-4fa0-ac7b-173974cbd5b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:56.936907 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44226f-d3a3-4fa0-ac7b-173974cbd5b6 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:56.952434 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1075/2142] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:56.953078 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1068/2143] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:56 2022] PUT /identity/v3/projects/c899bc0f3f424ebd82886b394da70a41/users/3402bd824f6e42639802177d40429c31/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:56.953905 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e2908-29a9-461a-9725-d1fa1a07d9ac admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:56.954105 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44226f-d3a3-4fa0-ac7b-173974cbd5b6 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:56.966723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44226f-d3a3-4fa0-ac7b-173974cbd5b6 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:57.019879 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e2908-29a9-461a-9725-d1fa1a07d9ac admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:57.025966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381bfd7-dc98-46ee-a9a1-c1e25fdf9de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:57.026765 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381bfd7-dc98-46ee-a9a1-c1e25fdf9de5 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:57.027041 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381bfd7-dc98-46ee-a9a1-c1e25fdf9de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:57.027295 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381bfd7-dc98-46ee-a9a1-c1e25fdf9de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:57.035429 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9381bfd7-dc98-46ee-a9a1-c1e25fdf9de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:57.035429 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9381bfd7-dc98-46ee-a9a1-c1e25fdf9de5 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:57.038337 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769dbb7b-e5b9-4bc2-ba4b-5985aca111dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:57.039661 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769dbb7b-e5b9-4bc2-ba4b-5985aca111dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:57.040133 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769dbb7b-e5b9-4bc2-ba4b-5985aca111dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:57.041317 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769dbb7b-e5b9-4bc2-ba4b-5985aca111dc admin admin] PATH_INFO: `/v3/projects/54ed302299834aff9fa003fb708630a1/users/70d76e402e784a8683493fb718f29d57/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:57.041464 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1069/2144] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:57.046140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381bfd7-dc98-46ee-a9a1-c1e25fdf9de5 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:57.061539 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381bfd7-dc98-46ee-a9a1-c1e25fdf9de5 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:57.061702 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769dbb7b-e5b9-4bc2-ba4b-5985aca111dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ed302299834aff9fa003fb708630a1, user_id=70d76e402e784a8683493fb718f29d57, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:57.064385 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769dbb7b-e5b9-4bc2-ba4b-5985aca111dc admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:57.065471 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9d658-8885-4664-9c88-7f61896c6458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:57.066370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9d658-8885-4664-9c88-7f61896c6458 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:57.066656 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9d658-8885-4664-9c88-7f61896c6458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:57.066932 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9d658-8885-4664-9c88-7f61896c6458 admin admin] PATH_INFO: `/v3/projects/c899bc0f3f424ebd82886b394da70a41/users/3402bd824f6e42639802177d40429c31/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:57.069052 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9d658-8885-4664-9c88-7f61896c6458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c899bc0f3f424ebd82886b394da70a41, user_id=3402bd824f6e42639802177d40429c31, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:57.071721 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9d658-8885-4664-9c88-7f61896c6458 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:57.086783 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1070/2145] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:57 2022] PUT /identity/v3/projects/c899bc0f3f424ebd82886b394da70a41/users/3402bd824f6e42639802177d40429c31/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:57.101372 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9d658-8885-4664-9c88-7f61896c6458 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:57.103787 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-aad9d658-8885-4664-9c88-7f61896c6458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:57.140061 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1076/2146] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:56 2022] PUT /identity/v3/projects/54ed302299834aff9fa003fb708630a1/users/70d76e402e784a8683493fb718f29d57/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:57.141742 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e091c-c345-4b71-bfe4-0204791d042d None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:57.142040 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e091c-c345-4b71-bfe4-0204791d042d None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:57.142323 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e091c-c345-4b71-bfe4-0204791d042d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:57.161006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:57.178898 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9d658-8885-4664-9c88-7f61896c6458 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:57.180650 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-9b9e091c-c345-4b71-bfe4-0204791d042d None None] MFA Rules not processed for user `3402bd824f6e42639802177d40429c31`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:57.181924 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-9b9e091c-c345-4b71-bfe4-0204791d042d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:57.187352 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:57.242027 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac16634-6c96-43e1-a4b4-5c945a79659a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:57.242923 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac16634-6c96-43e1-a4b4-5c945a79659a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:57.243238 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac16634-6c96-43e1-a4b4-5c945a79659a admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:57.243606 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac16634-6c96-43e1-a4b4-5c945a79659a admin admin] PATH_INFO: `/v3/users/8bcfa9ff0b6f411d80cab1501e1fa3ec` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:57.244856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac16634-6c96-43e1-a4b4-5c945a79659a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bcfa9ff0b6f411d80cab1501e1fa3ec)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:57.246846 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac16634-6c96-43e1-a4b4-5c945a79659a admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:57.257756 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1077/2147] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:57 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:57.259151 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7db27f-c2b8-4aa9-a4fd-d236c2aad8b7 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:57.259439 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7db27f-c2b8-4aa9-a4fd-d236c2aad8b7 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:57.259719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7db27f-c2b8-4aa9-a4fd-d236c2aad8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:57.289736 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-9f7db27f-c2b8-4aa9-a4fd-d236c2aad8b7 None None] MFA Rules not processed for user `70d76e402e784a8683493fb718f29d57`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:57.290940 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-9f7db27f-c2b8-4aa9-a4fd-d236c2aad8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:57.357023 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1078/2148] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:57 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:57.357797 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7db27f-c2b8-4aa9-a4fd-d236c2aad8b7 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:57.359250 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-9f7db27f-c2b8-4aa9-a4fd-d236c2aad8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:57.423913 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7db27f-c2b8-4aa9-a4fd-d236c2aad8b7 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:57.428335 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de99302-01cf-4625-9152-74c29413070f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:57.429427 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de99302-01cf-4625-9152-74c29413070f service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:57.429728 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de99302-01cf-4625-9152-74c29413070f service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:57.430080 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de99302-01cf-4625-9152-74c29413070f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:57.440961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de99302-01cf-4625-9152-74c29413070f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:57.442405 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de99302-01cf-4625-9152-74c29413070f service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:57.453589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1079/2149] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:57 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:57.454513 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de99302-01cf-4625-9152-74c29413070f service cinder] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:57.455947 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-4de99302-01cf-4625-9152-74c29413070f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:57.467582 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de99302-01cf-4625-9152-74c29413070f service cinder] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:57.471687 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a34bc-cdf7-4e6e-b1b6-54673725d41b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:57.472368 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a34bc-cdf7-4e6e-b1b6-54673725d41b service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:57.472646 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a34bc-cdf7-4e6e-b1b6-54673725d41b service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:57.472963 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a34bc-cdf7-4e6e-b1b6-54673725d41b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:57.483218 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a34bc-cdf7-4e6e-b1b6-54673725d41b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:57.484728 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a34bc-cdf7-4e6e-b1b6-54673725d41b service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:57.499397 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1080/2150] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:57 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:57.593460 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-aac16634-6c96-43e1-a4b4-5c945a79659a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bcfa9ff0b6f411d80cab1501e1fa3ec'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:57.616662 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-aac16634-6c96-43e1-a4b4-5c945a79659a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bcfa9ff0b6f411d80cab1501e1fa3ec'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:57.699035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a34bc-cdf7-4e6e-b1b6-54673725d41b service cinder] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:57.710533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a34bc-cdf7-4e6e-b1b6-54673725d41b service cinder] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:57.714657 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-aac16634-6c96-43e1-a4b4-5c945a79659a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bcfa9ff0b6f411d80cab1501e1fa3ec'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:57.716138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-aac16634-6c96-43e1-a4b4-5c945a79659a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bcfa9ff0b6f411d80cab1501e1fa3ec'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:57.716655 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1a995-3776-4144-ad6c-60a6401106d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:57.717585 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1a995-3776-4144-ad6c-60a6401106d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:57.718054 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1a995-3776-4144-ad6c-60a6401106d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:57.720912 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1a995-3776-4144-ad6c-60a6401106d2 admin admin] PATH_INFO: `/v3/users/97085ade451a4940ad5a67f50bb84725` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:57.720912 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1a995-3776-4144-ad6c-60a6401106d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97085ade451a4940ad5a67f50bb84725)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:57.722086 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1a995-3776-4144-ad6c-60a6401106d2 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:57.727555 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-aac16634-6c96-43e1-a4b4-5c945a79659a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bcfa9ff0b6f411d80cab1501e1fa3ec'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:57.734967 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1071/2151] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:20:57 2022] DELETE /identity/v3/users/8bcfa9ff0b6f411d80cab1501e1fa3ec => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:20:57.739528 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570c377-9ce8-4da6-b601-96a59d468a41 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:57.740083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570c377-9ce8-4da6-b601-96a59d468a41 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:57.740465 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570c377-9ce8-4da6-b601-96a59d468a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:57.750725 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:57.761916 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-5570c377-9ce8-4da6-b601-96a59d468a41 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:57.763269 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-5570c377-9ce8-4da6-b601-96a59d468a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:57.826230 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1072/2152] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:20:57.835950 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570c377-9ce8-4da6-b601-96a59d468a41 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:57.837407 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-5570c377-9ce8-4da6-b601-96a59d468a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:57.851086 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:57.893852 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570c377-9ce8-4da6-b601-96a59d468a41 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:57.897863 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc41aa-083a-4790-bb7b-8bccf27fe923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:57.898507 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc41aa-083a-4790-bb7b-8bccf27fe923 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:57.898789 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc41aa-083a-4790-bb7b-8bccf27fe923 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:57.899067 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc41aa-083a-4790-bb7b-8bccf27fe923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:57.915652 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc41aa-083a-4790-bb7b-8bccf27fe923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:57.917225 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc41aa-083a-4790-bb7b-8bccf27fe923 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:57.928681 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1073/2153] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:58.025099 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-dca1a995-3776-4144-ad6c-60a6401106d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97085ade451a4940ad5a67f50bb84725'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:58.025783 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-dca1a995-3776-4144-ad6c-60a6401106d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97085ade451a4940ad5a67f50bb84725'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:58.161299 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-dca1a995-3776-4144-ad6c-60a6401106d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97085ade451a4940ad5a67f50bb84725'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:58.174458 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-dca1a995-3776-4144-ad6c-60a6401106d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97085ade451a4940ad5a67f50bb84725'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:58.182543 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-dca1a995-3776-4144-ad6c-60a6401106d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97085ade451a4940ad5a67f50bb84725'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:58.188857 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1081/2154] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:20:57 2022] DELETE /identity/v3/users/97085ade451a4940ad5a67f50bb84725 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:58.193654 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda9014-4fa4-4a5d-bf9b-023bbaa4ad05 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:58.193807 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda9014-4fa4-4a5d-bf9b-023bbaa4ad05 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:58.193992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda9014-4fa4-4a5d-bf9b-023bbaa4ad05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:58.212377 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-ccda9014-4fa4-4a5d-bf9b-023bbaa4ad05 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:58.213642 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-ccda9014-4fa4-4a5d-bf9b-023bbaa4ad05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:58.295212 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1074/2155] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:58.305279 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1a995-3776-4144-ad6c-60a6401106d2 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:58.306744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-dca1a995-3776-4144-ad6c-60a6401106d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:58.337733 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda9014-4fa4-4a5d-bf9b-023bbaa4ad05 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:58.339235 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-ccda9014-4fa4-4a5d-bf9b-023bbaa4ad05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:58.371906 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1a995-3776-4144-ad6c-60a6401106d2 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:58.376396 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a1244-91d1-472a-b15f-7661fced1c7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:58.377088 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a1244-91d1-472a-b15f-7661fced1c7d service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:58.378028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a1244-91d1-472a-b15f-7661fced1c7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:58.378145 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda9014-4fa4-4a5d-bf9b-023bbaa4ad05 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:58.378240 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a1244-91d1-472a-b15f-7661fced1c7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:58.384096 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162aee98-f9ee-4d11-8f5a-0c7be5281277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:58.385248 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aee98-f9ee-4d11-8f5a-0c7be5281277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:58.386286 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aee98-f9ee-4d11-8f5a-0c7be5281277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:58.386589 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162aee98-f9ee-4d11-8f5a-0c7be5281277 admin admin] PATH_INFO: `/v3/projects/bfcee8e74281416db19b906e412cf67b` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:58.388119 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162aee98-f9ee-4d11-8f5a-0c7be5281277 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfcee8e74281416db19b906e412cf67b)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:58.392075 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a1244-91d1-472a-b15f-7661fced1c7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:58.392075 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a1244-91d1-472a-b15f-7661fced1c7d service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:58.392376 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162aee98-f9ee-4d11-8f5a-0c7be5281277 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:58.404426 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1082/2156] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:58.527908 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-162aee98-f9ee-4d11-8f5a-0c7be5281277 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfcee8e74281416db19b906e412cf67b', 'request_id': 'req-162aee98-f9ee-4d11-8f5a-0c7be5281277'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:58.534392 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-162aee98-f9ee-4d11-8f5a-0c7be5281277 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfcee8e74281416db19b906e412cf67b', 'request_id': 'req-162aee98-f9ee-4d11-8f5a-0c7be5281277'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:58.624220 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-162aee98-f9ee-4d11-8f5a-0c7be5281277 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfcee8e74281416db19b906e412cf67b', 'request_id': 'req-162aee98-f9ee-4d11-8f5a-0c7be5281277'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:58.635711 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-162aee98-f9ee-4d11-8f5a-0c7be5281277 admin admin] The token cache is being invalidate because project bfcee8e74281416db19b906e412cf67b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:20:58.636732 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-162aee98-f9ee-4d11-8f5a-0c7be5281277 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:58.637100 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-162aee98-f9ee-4d11-8f5a-0c7be5281277 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:58.638925 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1075/2157] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:20:58 2022] DELETE /identity/v3/projects/bfcee8e74281416db19b906e412cf67b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:58.643639 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3563ab-e24e-4925-ba13-ad64a82e17ef None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:58.643955 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3563ab-e24e-4925-ba13-ad64a82e17ef None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:58.644239 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3563ab-e24e-4925-ba13-ad64a82e17ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:58.665095 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-4b3563ab-e24e-4925-ba13-ad64a82e17ef None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:58.667035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-4b3563ab-e24e-4925-ba13-ad64a82e17ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:58.774198 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1083/2158] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:58.776311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730d501-1cdd-43fe-818f-20946a6929db None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:58.777026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730d501-1cdd-43fe-818f-20946a6929db None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:58.777512 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730d501-1cdd-43fe-818f-20946a6929db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:58.808988 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-b730d501-1cdd-43fe-818f-20946a6929db None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:58.810718 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-b730d501-1cdd-43fe-818f-20946a6929db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:58.826173 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1076/2159] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:58.826937 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3563ab-e24e-4925-ba13-ad64a82e17ef None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:58.838547 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3563ab-e24e-4925-ba13-ad64a82e17ef None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:58.845652 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd8a0b-b0aa-4c79-a16b-ef04deb17320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:58.846337 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd8a0b-b0aa-4c79-a16b-ef04deb17320 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:58.846670 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd8a0b-b0aa-4c79-a16b-ef04deb17320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:58.846954 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd8a0b-b0aa-4c79-a16b-ef04deb17320 admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:58.847937 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd8a0b-b0aa-4c79-a16b-ef04deb17320 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:20:58.848249 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd8a0b-b0aa-4c79-a16b-ef04deb17320 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:58.858660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd8a0b-b0aa-4c79-a16b-ef04deb17320 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:58.872996 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1084/2160] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:20:58.878330 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730d501-1cdd-43fe-818f-20946a6929db None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:58.885888 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730d501-1cdd-43fe-818f-20946a6929db None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:58.892072 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345fa24-aa00-459e-a496-ecb1645e0b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:58.892752 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345fa24-aa00-459e-a496-ecb1645e0b18 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:58.893075 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345fa24-aa00-459e-a496-ecb1645e0b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:58.893548 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345fa24-aa00-459e-a496-ecb1645e0b18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:58.894060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a345fa24-aa00-459e-a496-ecb1645e0b18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:58.896314 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a345fa24-aa00-459e-a496-ecb1645e0b18 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:58.958448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd8a0b-b0aa-4c79-a16b-ef04deb17320 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:58.960288 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-c3bd8a0b-b0aa-4c79-a16b-ef04deb17320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:58.991126 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1077/2161] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:20:58 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:20:58.995265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd8a0b-b0aa-4c79-a16b-ef04deb17320 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:58.995404 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345fa24-aa00-459e-a496-ecb1645e0b18 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:59.009922 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:59.018426 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:59.062069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345fa24-aa00-459e-a496-ecb1645e0b18 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:59.063772 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5eb765-b8bd-4fd5-b251-e283fe670cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:59.064713 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5eb765-b8bd-4fd5-b251-e283fe670cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:59.065030 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5eb765-b8bd-4fd5-b251-e283fe670cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:59.065316 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5eb765-b8bd-4fd5-b251-e283fe670cd2 admin admin] PATH_INFO: `/v3/projects/a9135071ad4c4d8e821a2d000ca5068d` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:59.066612 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5eb765-b8bd-4fd5-b251-e283fe670cd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9135071ad4c4d8e821a2d000ca5068d)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:59.068625 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5eb765-b8bd-4fd5-b251-e283fe670cd2 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:59.069340 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57699e37-5774-4cfd-b414-9c82d31416b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:59.070483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57699e37-5774-4cfd-b414-9c82d31416b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:59.070990 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57699e37-5774-4cfd-b414-9c82d31416b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:59.071489 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57699e37-5774-4cfd-b414-9c82d31416b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:59.072867 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57699e37-5774-4cfd-b414-9c82d31416b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:59.076606 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57699e37-5774-4cfd-b414-9c82d31416b1 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:59.252880 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1078/2162] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:20:58 2022] POST /identity/v3/users => generated 288 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:20:59.256799 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57699e37-5774-4cfd-b414-9c82d31416b1 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:59.266670 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57699e37-5774-4cfd-b414-9c82d31416b1 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:59.271402 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763895d-51bd-4ea7-aaac-9c7d69dfd4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:59.272305 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763895d-51bd-4ea7-aaac-9c7d69dfd4ba admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:59.272594 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763895d-51bd-4ea7-aaac-9c7d69dfd4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:59.272904 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763895d-51bd-4ea7-aaac-9c7d69dfd4ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:59.273643 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763895d-51bd-4ea7-aaac-9c7d69dfd4ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:59.275758 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763895d-51bd-4ea7-aaac-9c7d69dfd4ba admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:59.286247 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1079/2163] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:20:59.290463 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763895d-51bd-4ea7-aaac-9c7d69dfd4ba admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:59.301651 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763895d-51bd-4ea7-aaac-9c7d69dfd4ba admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:59.308896 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-ce5eb765-b8bd-4fd5-b251-e283fe670cd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9135071ad4c4d8e821a2d000ca5068d', 'request_id': 'req-ce5eb765-b8bd-4fd5-b251-e283fe670cd2'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:59.314312 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-ce5eb765-b8bd-4fd5-b251-e283fe670cd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9135071ad4c4d8e821a2d000ca5068d', 'request_id': 'req-ce5eb765-b8bd-4fd5-b251-e283fe670cd2'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:59.361807 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbd916-4a8f-40f4-8f72-1e3d6851fcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:59.362484 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbd916-4a8f-40f4-8f72-1e3d6851fcdf admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:59.362771 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbd916-4a8f-40f4-8f72-1e3d6851fcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:59.363050 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbd916-4a8f-40f4-8f72-1e3d6851fcdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:59.363787 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbd916-4a8f-40f4-8f72-1e3d6851fcdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:59.370150 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbd916-4a8f-40f4-8f72-1e3d6851fcdf admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:59.381111 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1080/2164] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:20:59.384728 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbd916-4a8f-40f4-8f72-1e3d6851fcdf admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:59.394651 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbd916-4a8f-40f4-8f72-1e3d6851fcdf admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:59.399608 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d05a26-fa8f-4c2f-9b39-edf199b44194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:59.401052 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d05a26-fa8f-4c2f-9b39-edf199b44194 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:59.401357 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d05a26-fa8f-4c2f-9b39-edf199b44194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:59.401632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d05a26-fa8f-4c2f-9b39-edf199b44194 admin admin] PATH_INFO: `/v3/projects/103646863310460ab704c72a64b65a67/users/ff2c6f96ded44acfb016f8aeec012864/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:59.416731 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d05a26-fa8f-4c2f-9b39-edf199b44194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=103646863310460ab704c72a64b65a67, user_id=ff2c6f96ded44acfb016f8aeec012864, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:59.419387 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d05a26-fa8f-4c2f-9b39-edf199b44194 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:59.492281 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-ce5eb765-b8bd-4fd5-b251-e283fe670cd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9135071ad4c4d8e821a2d000ca5068d', 'request_id': 'req-ce5eb765-b8bd-4fd5-b251-e283fe670cd2'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:59.504739 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-ce5eb765-b8bd-4fd5-b251-e283fe670cd2 admin admin] The token cache is being invalidate because project a9135071ad4c4d8e821a2d000ca5068d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:20:59.504991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-ce5eb765-b8bd-4fd5-b251-e283fe670cd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:59.505650 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-ce5eb765-b8bd-4fd5-b251-e283fe670cd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:59.507229 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1085/2165] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:20:58 2022] DELETE /identity/v3/projects/a9135071ad4c4d8e821a2d000ca5068d => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:20:59.511084 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5eb765-b8bd-4fd5-b251-e283fe670cd2 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:59.512386 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-ce5eb765-b8bd-4fd5-b251-e283fe670cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:59.525681 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5eb765-b8bd-4fd5-b251-e283fe670cd2 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:59.530239 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d8e56-505d-414e-bf76-d8170535d912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:59.531093 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d8e56-505d-414e-bf76-d8170535d912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:59.531374 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d8e56-505d-414e-bf76-d8170535d912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:59.531651 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d8e56-505d-414e-bf76-d8170535d912 admin admin] PATH_INFO: `/v3/users/3402bd824f6e42639802177d40429c31` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:59.532940 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d8e56-505d-414e-bf76-d8170535d912 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3402bd824f6e42639802177d40429c31)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:59.535081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d8e56-505d-414e-bf76-d8170535d912 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:59.560805 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1081/2166] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:20:59 2022] PUT /identity/v3/projects/103646863310460ab704c72a64b65a67/users/ff2c6f96ded44acfb016f8aeec012864/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:20:59.571308 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7129fe1-220f-4372-a1dd-0725507b4e0b None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:59.572393 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7129fe1-220f-4372-a1dd-0725507b4e0b None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:59.576272 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7129fe1-220f-4372-a1dd-0725507b4e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:59.600362 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-b7129fe1-220f-4372-a1dd-0725507b4e0b None None] MFA Rules not processed for user `ff2c6f96ded44acfb016f8aeec012864`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:59.601632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-b7129fe1-220f-4372-a1dd-0725507b4e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:59.648840 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:59.667120 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1082/2167] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:20:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:20:59.678571 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7129fe1-220f-4372-a1dd-0725507b4e0b None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:59.680040 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-b7129fe1-220f-4372-a1dd-0725507b4e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:59.740774 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7129fe1-220f-4372-a1dd-0725507b4e0b None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:59.745023 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee89f3-b0ac-4fb9-9dee-93cfa99ebf57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:59.745684 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee89f3-b0ac-4fb9-9dee-93cfa99ebf57 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:59.745969 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee89f3-b0ac-4fb9-9dee-93cfa99ebf57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:59.746253 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee89f3-b0ac-4fb9-9dee-93cfa99ebf57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:59.755578 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee89f3-b0ac-4fb9-9dee-93cfa99ebf57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:59.757070 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee89f3-b0ac-4fb9-9dee-93cfa99ebf57 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:59.761211 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b65d8e56-505d-414e-bf76-d8170535d912 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3402bd824f6e42639802177d40429c31'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:59.761877 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b65d8e56-505d-414e-bf76-d8170535d912 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3402bd824f6e42639802177d40429c31'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:59.768173 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1083/2168] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:20:59.895856 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b65d8e56-505d-414e-bf76-d8170535d912 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3402bd824f6e42639802177d40429c31'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:59.985194 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b65d8e56-505d-414e-bf76-d8170535d912 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3402bd824f6e42639802177d40429c31'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:59.985194 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b65d8e56-505d-414e-bf76-d8170535d912 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3402bd824f6e42639802177d40429c31'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:20:59.985194 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1086/2169] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:20:59 2022] DELETE /identity/v3/users/3402bd824f6e42639802177d40429c31 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:21:00.473206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee89f3-b0ac-4fb9-9dee-93cfa99ebf57 service cinder] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:00.550930 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee89f3-b0ac-4fb9-9dee-93cfa99ebf57 service cinder] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:00.607834 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b3751-1d0b-496e-83b7-9e4dc85bc5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:00.617701 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b3751-1d0b-496e-83b7-9e4dc85bc5da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:00.617701 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b3751-1d0b-496e-83b7-9e4dc85bc5da admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:00.617701 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b3751-1d0b-496e-83b7-9e4dc85bc5da admin admin] PATH_INFO: `/v3/projects/c899bc0f3f424ebd82886b394da70a41` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:00.617701 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b3751-1d0b-496e-83b7-9e4dc85bc5da admin admin] RBAC: Authorizing `identity:delete_project(project_id=c899bc0f3f424ebd82886b394da70a41)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:00.617701 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b3751-1d0b-496e-83b7-9e4dc85bc5da admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:00.791622 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:00.795252 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-c82b3751-1d0b-496e-83b7-9e4dc85bc5da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c899bc0f3f424ebd82886b394da70a41', 'request_id': 'req-c82b3751-1d0b-496e-83b7-9e4dc85bc5da'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:00.801646 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-c82b3751-1d0b-496e-83b7-9e4dc85bc5da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c899bc0f3f424ebd82886b394da70a41', 'request_id': 'req-c82b3751-1d0b-496e-83b7-9e4dc85bc5da'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:00.915801 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-c82b3751-1d0b-496e-83b7-9e4dc85bc5da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c899bc0f3f424ebd82886b394da70a41', 'request_id': 'req-c82b3751-1d0b-496e-83b7-9e4dc85bc5da'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:00.929190 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-c82b3751-1d0b-496e-83b7-9e4dc85bc5da admin admin] The token cache is being invalidate because project c899bc0f3f424ebd82886b394da70a41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:00.929484 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-c82b3751-1d0b-496e-83b7-9e4dc85bc5da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:00.930229 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-c82b3751-1d0b-496e-83b7-9e4dc85bc5da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:00.932664 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1084/2170] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:00 2022] DELETE /identity/v3/projects/c899bc0f3f424ebd82886b394da70a41 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:00.937375 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2ce0b-2383-45e9-8c79-519f86a5970d None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:00.937862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2ce0b-2383-45e9-8c79-519f86a5970d None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:00.939269 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2ce0b-2383-45e9-8c79-519f86a5970d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:00.964083 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-24e2ce0b-2383-45e9-8c79-519f86a5970d None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:00.965834 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-24e2ce0b-2383-45e9-8c79-519f86a5970d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:00.988709 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:01.056212 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1087/2171] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:21:01.064806 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b1749-19ac-4f3d-a0f8-c5b77fe384e7 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:01.065153 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b1749-19ac-4f3d-a0f8-c5b77fe384e7 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:01.065463 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b1749-19ac-4f3d-a0f8-c5b77fe384e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:01.087344 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-205b1749-19ac-4f3d-a0f8-c5b77fe384e7 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:01.090594 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-205b1749-19ac-4f3d-a0f8-c5b77fe384e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:01.101020 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1085/2172] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:01.106638 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2ce0b-2383-45e9-8c79-519f86a5970d None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:01.119678 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2ce0b-2383-45e9-8c79-519f86a5970d None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:01.122324 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46d64c-66db-4c07-9546-1e6b7c49f905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:01.123003 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46d64c-66db-4c07-9546-1e6b7c49f905 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:01.123287 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46d64c-66db-4c07-9546-1e6b7c49f905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:01.123568 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46d64c-66db-4c07-9546-1e6b7c49f905 admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:01.124348 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46d64c-66db-4c07-9546-1e6b7c49f905 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:21:01.124622 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46d64c-66db-4c07-9546-1e6b7c49f905 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:01.126323 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46d64c-66db-4c07-9546-1e6b7c49f905 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:01.138777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1088/2173] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:21:01.143275 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b1749-19ac-4f3d-a0f8-c5b77fe384e7 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:01.153425 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b1749-19ac-4f3d-a0f8-c5b77fe384e7 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:01.158422 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffa82d-5833-4292-9bbc-3d5274bc41ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:01.159089 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffa82d-5833-4292-9bbc-3d5274bc41ed admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:01.159372 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffa82d-5833-4292-9bbc-3d5274bc41ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:01.159651 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffa82d-5833-4292-9bbc-3d5274bc41ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:01.160353 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ffa82d-5833-4292-9bbc-3d5274bc41ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:01.162361 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ffa82d-5833-4292-9bbc-3d5274bc41ed admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:01.286391 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1086/2174] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:01 2022] POST /identity/v3/projects => generated 403 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:01.288492 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46d64c-66db-4c07-9546-1e6b7c49f905 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:01.299721 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46d64c-66db-4c07-9546-1e6b7c49f905 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:01.359163 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3e9e6-5305-442d-b87b-82a57bb590ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:01.359847 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3e9e6-5305-442d-b87b-82a57bb590ed admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:01.360129 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3e9e6-5305-442d-b87b-82a57bb590ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:01.360404 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3e9e6-5305-442d-b87b-82a57bb590ed admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:01.361165 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a3e9e6-5305-442d-b87b-82a57bb590ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:01.363097 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a3e9e6-5305-442d-b87b-82a57bb590ed admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:01.486449 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1089/2175] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:01 2022] POST /identity/v3/users => generated 302 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:21:01.492088 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffa82d-5833-4292-9bbc-3d5274bc41ed admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:01.505473 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffa82d-5833-4292-9bbc-3d5274bc41ed admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:01.512238 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bada29-cc7a-4303-ac25-de17b6b703a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:01.513507 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bada29-cc7a-4303-ac25-de17b6b703a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:01.514072 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bada29-cc7a-4303-ac25-de17b6b703a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:01.514588 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bada29-cc7a-4303-ac25-de17b6b703a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:01.515696 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bada29-cc7a-4303-ac25-de17b6b703a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:01.518612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bada29-cc7a-4303-ac25-de17b6b703a5 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:01.531824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1087/2176] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:01.535882 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3e9e6-5305-442d-b87b-82a57bb590ed admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:01.548315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3e9e6-5305-442d-b87b-82a57bb590ed admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:01.555021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec7c3c-1d70-4f61-a442-6c9e27232500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:01.555975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec7c3c-1d70-4f61-a442-6c9e27232500 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:01.556356 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec7c3c-1d70-4f61-a442-6c9e27232500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:01.557608 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec7c3c-1d70-4f61-a442-6c9e27232500 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:01.558428 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec7c3c-1d70-4f61-a442-6c9e27232500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:01.560899 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec7c3c-1d70-4f61-a442-6c9e27232500 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:01.578738 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1090/2177] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:01.582954 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bada29-cc7a-4303-ac25-de17b6b703a5 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:01.593855 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bada29-cc7a-4303-ac25-de17b6b703a5 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:01.599011 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264b055-37d3-410a-ba04-1330f2408f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:01.599909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264b055-37d3-410a-ba04-1330f2408f81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:01.600197 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264b055-37d3-410a-ba04-1330f2408f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:01.600476 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264b055-37d3-410a-ba04-1330f2408f81 admin admin] PATH_INFO: `/v3/projects/5a94eff7041347bca8e4f84a319660d2/users/3e6ea09209ff4f9fa5ebb808e4f22b55/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:01.617190 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264b055-37d3-410a-ba04-1330f2408f81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a94eff7041347bca8e4f84a319660d2, user_id=3e6ea09209ff4f9fa5ebb808e4f22b55, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:01.620803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264b055-37d3-410a-ba04-1330f2408f81 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:01.752359 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1088/2178] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:01 2022] PUT /identity/v3/projects/5a94eff7041347bca8e4f84a319660d2/users/3e6ea09209ff4f9fa5ebb808e4f22b55/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:01.757417 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c139c2-a2fb-4ef6-86e1-1dafae0604e2 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:01.757712 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c139c2-a2fb-4ef6-86e1-1dafae0604e2 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:01.758051 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c139c2-a2fb-4ef6-86e1-1dafae0604e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:01.777822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-54c139c2-a2fb-4ef6-86e1-1dafae0604e2 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:01.781171 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-54c139c2-a2fb-4ef6-86e1-1dafae0604e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:01.848094 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1091/2179] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:01.859200 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264b055-37d3-410a-ba04-1330f2408f81 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:01.861498 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-8264b055-37d3-410a-ba04-1330f2408f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:01.924304 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264b055-37d3-410a-ba04-1330f2408f81 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:01.928340 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c0e6c-e7a7-4182-ad0d-27500318777a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:01.929037 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c0e6c-e7a7-4182-ad0d-27500318777a service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:01.929324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c0e6c-e7a7-4182-ad0d-27500318777a service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:01.929602 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c0e6c-e7a7-4182-ad0d-27500318777a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:01.941845 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c0e6c-e7a7-4182-ad0d-27500318777a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:01.943532 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c0e6c-e7a7-4182-ad0d-27500318777a service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:01.955580 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1089/2180] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:04.139816 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053b24a-da43-442b-b0c9-2b16f7954510 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:04.140304 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053b24a-da43-442b-b0c9-2b16f7954510 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:04.140426 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053b24a-da43-442b-b0c9-2b16f7954510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:04.192130 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-8053b24a-da43-442b-b0c9-2b16f7954510 None None] MFA Rules not processed for user `3e6ea09209ff4f9fa5ebb808e4f22b55`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:04.196279 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-8053b24a-da43-442b-b0c9-2b16f7954510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:04.227010 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:04.311332 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1092/2181] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:21:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:04.315938 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c0e6c-e7a7-4182-ad0d-27500318777a service neutron] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:04.326803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c0e6c-e7a7-4182-ad0d-27500318777a service neutron] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:04.338995 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463a100-2e2d-423b-a44e-40b0ad01b540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:04.339852 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463a100-2e2d-423b-a44e-40b0ad01b540 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:04.340063 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463a100-2e2d-423b-a44e-40b0ad01b540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:04.340346 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463a100-2e2d-423b-a44e-40b0ad01b540 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:04.341282 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463a100-2e2d-423b-a44e-40b0ad01b540 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:04.343298 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463a100-2e2d-423b-a44e-40b0ad01b540 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:04.477246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1090/2182] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:04 2022] POST /identity/v3/projects => generated 405 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:04.481660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053b24a-da43-442b-b0c9-2b16f7954510 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:04.511716 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053b24a-da43-442b-b0c9-2b16f7954510 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:04.577126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69fa02-8146-4056-99e1-6c2a684a2d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:04.577806 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69fa02-8146-4056-99e1-6c2a684a2d65 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:04.578242 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69fa02-8146-4056-99e1-6c2a684a2d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:04.578619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69fa02-8146-4056-99e1-6c2a684a2d65 admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:04.579473 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69fa02-8146-4056-99e1-6c2a684a2d65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:04.581454 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69fa02-8146-4056-99e1-6c2a684a2d65 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:04.715742 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1093/2183] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:04 2022] POST /identity/v3/users => generated 309 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:04.717488 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463a100-2e2d-423b-a44e-40b0ad01b540 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:04.729167 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463a100-2e2d-423b-a44e-40b0ad01b540 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:04.734012 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f80d1-db64-42f1-aed5-5a3556e2178f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:04.734684 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f80d1-db64-42f1-aed5-5a3556e2178f admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:04.735172 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f80d1-db64-42f1-aed5-5a3556e2178f admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:04.735450 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f80d1-db64-42f1-aed5-5a3556e2178f admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:04.736191 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f80d1-db64-42f1-aed5-5a3556e2178f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:04.737857 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f80d1-db64-42f1-aed5-5a3556e2178f admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:04.755276 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1091/2184] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:04.756545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69fa02-8146-4056-99e1-6c2a684a2d65 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:04.767417 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69fa02-8146-4056-99e1-6c2a684a2d65 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:04.772586 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a71dae-1261-4390-ac99-b228e7f482e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:04.774031 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a71dae-1261-4390-ac99-b228e7f482e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:04.774268 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a71dae-1261-4390-ac99-b228e7f482e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:04.774746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a71dae-1261-4390-ac99-b228e7f482e8 admin admin] PATH_INFO: `/v3/projects/88ca25c0b1c749ee9f84c7c3e38d3ce4/users/8a79aacd630940d9ad56f05b74483585/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:04.791638 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a71dae-1261-4390-ac99-b228e7f482e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88ca25c0b1c749ee9f84c7c3e38d3ce4, user_id=8a79aacd630940d9ad56f05b74483585, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:04.794443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a71dae-1261-4390-ac99-b228e7f482e8 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:04.947580 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1094/2185] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:04 2022] PUT /identity/v3/projects/88ca25c0b1c749ee9f84c7c3e38d3ce4/users/8a79aacd630940d9ad56f05b74483585/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:04.949302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f80d1-db64-42f1-aed5-5a3556e2178f admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:04.960026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f80d1-db64-42f1-aed5-5a3556e2178f admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:04.999893 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:05.024024 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673b9b6-ad0d-49b9-8cbe-dff0d1696dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:05.024929 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673b9b6-ad0d-49b9-8cbe-dff0d1696dfd admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:05.027000 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673b9b6-ad0d-49b9-8cbe-dff0d1696dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:05.027000 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673b9b6-ad0d-49b9-8cbe-dff0d1696dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:05.027000 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5673b9b6-ad0d-49b9-8cbe-dff0d1696dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:05.028846 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5673b9b6-ad0d-49b9-8cbe-dff0d1696dfd admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:05.039762 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1092/2186] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:05.044799 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a71dae-1261-4390-ac99-b228e7f482e8 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:05.057915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a71dae-1261-4390-ac99-b228e7f482e8 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:05.063021 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3212837-3fb7-42a8-a386-5c33587fbb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:05.064039 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3212837-3fb7-42a8-a386-5c33587fbb28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:05.064324 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3212837-3fb7-42a8-a386-5c33587fbb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:05.064603 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3212837-3fb7-42a8-a386-5c33587fbb28 admin admin] PATH_INFO: `/v3/projects/88ca25c0b1c749ee9f84c7c3e38d3ce4/users/8a79aacd630940d9ad56f05b74483585/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:05.067224 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3212837-3fb7-42a8-a386-5c33587fbb28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88ca25c0b1c749ee9f84c7c3e38d3ce4, user_id=8a79aacd630940d9ad56f05b74483585, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:05.070013 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3212837-3fb7-42a8-a386-5c33587fbb28 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:05.081644 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1095/2187] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:05 2022] PUT /identity/v3/projects/88ca25c0b1c749ee9f84c7c3e38d3ce4/users/8a79aacd630940d9ad56f05b74483585/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:21:05.535866 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673b9b6-ad0d-49b9-8cbe-dff0d1696dfd admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:05.538418 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-5673b9b6-ad0d-49b9-8cbe-dff0d1696dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:05.566443 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673b9b6-ad0d-49b9-8cbe-dff0d1696dfd admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:05.635974 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827712d8-f189-40ae-9ad6-d0c244914428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:05.637071 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827712d8-f189-40ae-9ad6-d0c244914428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:05.637523 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827712d8-f189-40ae-9ad6-d0c244914428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:05.639088 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827712d8-f189-40ae-9ad6-d0c244914428 admin admin] PATH_INFO: `/v3/users/ff2c6f96ded44acfb016f8aeec012864` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:05.640599 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827712d8-f189-40ae-9ad6-d0c244914428 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff2c6f96ded44acfb016f8aeec012864)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:05.643982 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827712d8-f189-40ae-9ad6-d0c244914428 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:05.857586 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-827712d8-f189-40ae-9ad6-d0c244914428 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff2c6f96ded44acfb016f8aeec012864'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:05.873002 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-827712d8-f189-40ae-9ad6-d0c244914428 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff2c6f96ded44acfb016f8aeec012864'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:06.000152 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-827712d8-f189-40ae-9ad6-d0c244914428 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff2c6f96ded44acfb016f8aeec012864'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:06.000956 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-827712d8-f189-40ae-9ad6-d0c244914428 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff2c6f96ded44acfb016f8aeec012864'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:06.009371 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-827712d8-f189-40ae-9ad6-d0c244914428 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff2c6f96ded44acfb016f8aeec012864'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:06.015853 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1093/2188] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:05 2022] DELETE /identity/v3/users/ff2c6f96ded44acfb016f8aeec012864 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:06.020342 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6306e-af05-45c8-81d4-a117ddda44fb None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:06.020885 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6306e-af05-45c8-81d4-a117ddda44fb None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:06.021003 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6306e-af05-45c8-81d4-a117ddda44fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:06.039792 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-c4f6306e-af05-45c8-81d4-a117ddda44fb None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:06.042278 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-c4f6306e-af05-45c8-81d4-a117ddda44fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:06.108462 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1096/2189] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:21:06.119205 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827712d8-f189-40ae-9ad6-d0c244914428 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:06.131276 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-827712d8-f189-40ae-9ad6-d0c244914428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:06.205849 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827712d8-f189-40ae-9ad6-d0c244914428 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:06.209843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29707c-023a-476c-b637-7e3d80cc7eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:06.210498 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29707c-023a-476c-b637-7e3d80cc7eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:06.210785 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29707c-023a-476c-b637-7e3d80cc7eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:06.211071 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29707c-023a-476c-b637-7e3d80cc7eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:06.219239 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:06.221617 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29707c-023a-476c-b637-7e3d80cc7eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:06.223160 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29707c-023a-476c-b637-7e3d80cc7eb3 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:06.234361 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1094/2190] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:06.723680 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6306e-af05-45c8-81d4-a117ddda44fb None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:06.724933 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-c4f6306e-af05-45c8-81d4-a117ddda44fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:06.734378 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1db38-aaf8-47c6-a6e2-d8067b9a52e6 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:06.734895 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1db38-aaf8-47c6-a6e2-d8067b9a52e6 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:06.734993 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1db38-aaf8-47c6-a6e2-d8067b9a52e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:06.749764 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6306e-af05-45c8-81d4-a117ddda44fb None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:06.766878 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4c66b-27c8-403d-8dd5-a94110892742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:06.768289 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4c66b-27c8-403d-8dd5-a94110892742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:06.768289 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4c66b-27c8-403d-8dd5-a94110892742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:06.768597 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4c66b-27c8-403d-8dd5-a94110892742 admin admin] PATH_INFO: `/v3/projects/103646863310460ab704c72a64b65a67` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:06.769650 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4c66b-27c8-403d-8dd5-a94110892742 admin admin] RBAC: Authorizing `identity:delete_project(project_id=103646863310460ab704c72a64b65a67)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:06.771694 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4c66b-27c8-403d-8dd5-a94110892742 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:06.781928 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:06.796533 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-eec1db38-aaf8-47c6-a6e2-d8067b9a52e6 None None] MFA Rules not processed for user `8a79aacd630940d9ad56f05b74483585`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:06.798056 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-eec1db38-aaf8-47c6-a6e2-d8067b9a52e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:06.892026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1095/2191] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:21:06 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:06.913736 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-14a4c66b-27c8-403d-8dd5-a94110892742 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '103646863310460ab704c72a64b65a67', 'request_id': 'req-14a4c66b-27c8-403d-8dd5-a94110892742'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:06.920593 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-14a4c66b-27c8-403d-8dd5-a94110892742 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '103646863310460ab704c72a64b65a67', 'request_id': 'req-14a4c66b-27c8-403d-8dd5-a94110892742'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:07.000633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-14a4c66b-27c8-403d-8dd5-a94110892742 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '103646863310460ab704c72a64b65a67', 'request_id': 'req-14a4c66b-27c8-403d-8dd5-a94110892742'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:07.022123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-14a4c66b-27c8-403d-8dd5-a94110892742 admin admin] The token cache is being invalidate because project 103646863310460ab704c72a64b65a67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:07.023025 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-14a4c66b-27c8-403d-8dd5-a94110892742 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:07.023350 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-14a4c66b-27c8-403d-8dd5-a94110892742 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:07.025670 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1097/2192] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:06 2022] DELETE /identity/v3/projects/103646863310460ab704c72a64b65a67 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:07.618625 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dd20e-b4b1-41e1-822e-c815242c8577 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:07.619135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dd20e-b4b1-41e1-822e-c815242c8577 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:07.620292 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dd20e-b4b1-41e1-822e-c815242c8577 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:07.623567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1096/2193] 10.222.0.46 () {54 vars in 921 bytes} [Wed Jun 22 10:21:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:21:07.635041 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6e897-ea35-40a0-bcc5-7aa9099f56b8 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:07.635673 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6e897-ea35-40a0-bcc5-7aa9099f56b8 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:07.635673 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6e897-ea35-40a0-bcc5-7aa9099f56b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:07.704371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-cbe6e897-ea35-40a0-bcc5-7aa9099f56b8 None None] MFA Rules not processed for user `675892a676054b4f86f9ac12d95f4f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:07.705636 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-cbe6e897-ea35-40a0-bcc5-7aa9099f56b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:07.787618 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1098/2194] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Jun 22 10:21:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:07.799656 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dd20e-b4b1-41e1-822e-c815242c8577 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:07.805056 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-7f6dd20e-b4b1-41e1-822e-c815242c8577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:07.821800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dd20e-b4b1-41e1-822e-c815242c8577 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:07.828673 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6427e1-8471-47ea-a362-b30347edceeb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '675892a676054b4f86f9ac12d95f4f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:07.829509 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6427e1-8471-47ea-a362-b30347edceeb service placement] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:07.829960 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6427e1-8471-47ea-a362-b30347edceeb service placement] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:07.830344 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6427e1-8471-47ea-a362-b30347edceeb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:07.843086 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6427e1-8471-47ea-a362-b30347edceeb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:07.845375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6427e1-8471-47ea-a362-b30347edceeb service placement] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:07.858265 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1097/2195] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:08.505907 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6e897-ea35-40a0-bcc5-7aa9099f56b8 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:08.507406 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-cbe6e897-ea35-40a0-bcc5-7aa9099f56b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:08.562340 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:08.575625 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6e897-ea35-40a0-bcc5-7aa9099f56b8 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:08.580250 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286746d7-11a3-4bc4-956d-8850c7418b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:08.581195 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286746d7-11a3-4bc4-956d-8850c7418b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:08.581475 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286746d7-11a3-4bc4-956d-8850c7418b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:08.581775 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286746d7-11a3-4bc4-956d-8850c7418b82 admin admin] PATH_INFO: `/v3/users/3e6ea09209ff4f9fa5ebb808e4f22b55` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:08.583029 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286746d7-11a3-4bc4-956d-8850c7418b82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e6ea09209ff4f9fa5ebb808e4f22b55)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:08.585003 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286746d7-11a3-4bc4-956d-8850c7418b82 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:08.790886 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-286746d7-11a3-4bc4-956d-8850c7418b82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e6ea09209ff4f9fa5ebb808e4f22b55'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:08.792148 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-286746d7-11a3-4bc4-956d-8850c7418b82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e6ea09209ff4f9fa5ebb808e4f22b55'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:08.973383 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-286746d7-11a3-4bc4-956d-8850c7418b82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e6ea09209ff4f9fa5ebb808e4f22b55'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:08.986635 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-286746d7-11a3-4bc4-956d-8850c7418b82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e6ea09209ff4f9fa5ebb808e4f22b55'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:08.996848 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-286746d7-11a3-4bc4-956d-8850c7418b82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e6ea09209ff4f9fa5ebb808e4f22b55'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:08.999977 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1099/2196] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:08 2022] DELETE /identity/v3/users/3e6ea09209ff4f9fa5ebb808e4f22b55 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:09.350038 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6427e1-8471-47ea-a362-b30347edceeb service placement] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:09.383816 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6427e1-8471-47ea-a362-b30347edceeb service placement] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:09.447035 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4c6dc-b5fd-42dc-a345-352cc97d552a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:09.451010 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4c6dc-b5fd-42dc-a345-352cc97d552a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:09.451010 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4c6dc-b5fd-42dc-a345-352cc97d552a admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:09.451010 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4c6dc-b5fd-42dc-a345-352cc97d552a admin admin] PATH_INFO: `/v3/projects/5a94eff7041347bca8e4f84a319660d2` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:09.451010 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4c6dc-b5fd-42dc-a345-352cc97d552a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a94eff7041347bca8e4f84a319660d2)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:09.452706 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4c6dc-b5fd-42dc-a345-352cc97d552a admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:09.684101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-4ce4c6dc-b5fd-42dc-a345-352cc97d552a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a94eff7041347bca8e4f84a319660d2', 'request_id': 'req-4ce4c6dc-b5fd-42dc-a345-352cc97d552a'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:09.690830 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-4ce4c6dc-b5fd-42dc-a345-352cc97d552a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a94eff7041347bca8e4f84a319660d2', 'request_id': 'req-4ce4c6dc-b5fd-42dc-a345-352cc97d552a'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:09.882356 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-4ce4c6dc-b5fd-42dc-a345-352cc97d552a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a94eff7041347bca8e4f84a319660d2', 'request_id': 'req-4ce4c6dc-b5fd-42dc-a345-352cc97d552a'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:09.890137 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:09.894765 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-4ce4c6dc-b5fd-42dc-a345-352cc97d552a admin admin] The token cache is being invalidate because project 5a94eff7041347bca8e4f84a319660d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:09.895096 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-4ce4c6dc-b5fd-42dc-a345-352cc97d552a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:09.895736 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-4ce4c6dc-b5fd-42dc-a345-352cc97d552a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:09.897635 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1098/2197] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:09 2022] DELETE /identity/v3/projects/5a94eff7041347bca8e4f84a319660d2 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:09.902510 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286746d7-11a3-4bc4-956d-8850c7418b82 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:09.903985 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-286746d7-11a3-4bc4-956d-8850c7418b82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:09.917246 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286746d7-11a3-4bc4-956d-8850c7418b82 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:09.973064 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2cd03-fe52-44e7-b283-89412d05d580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:09.973844 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2cd03-fe52-44e7-b283-89412d05d580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:09.974126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2cd03-fe52-44e7-b283-89412d05d580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:09.974405 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2cd03-fe52-44e7-b283-89412d05d580 admin admin] PATH_INFO: `/v3/users/8a79aacd630940d9ad56f05b74483585` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:09.975611 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2cd03-fe52-44e7-b283-89412d05d580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a79aacd630940d9ad56f05b74483585)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:09.977564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2cd03-fe52-44e7-b283-89412d05d580 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:10.255998 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-74a2cd03-fe52-44e7-b283-89412d05d580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a79aacd630940d9ad56f05b74483585'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:10.255998 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-74a2cd03-fe52-44e7-b283-89412d05d580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a79aacd630940d9ad56f05b74483585'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:10.368106 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-74a2cd03-fe52-44e7-b283-89412d05d580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a79aacd630940d9ad56f05b74483585'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:10.380738 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-74a2cd03-fe52-44e7-b283-89412d05d580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a79aacd630940d9ad56f05b74483585'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:10.387769 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-74a2cd03-fe52-44e7-b283-89412d05d580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a79aacd630940d9ad56f05b74483585'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:10.395815 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1100/2198] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:09 2022] DELETE /identity/v3/users/8a79aacd630940d9ad56f05b74483585 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:10.597506 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:10.709500 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4c6dc-b5fd-42dc-a345-352cc97d552a admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:10.709500 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-4ce4c6dc-b5fd-42dc-a345-352cc97d552a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:10.724173 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4c6dc-b5fd-42dc-a345-352cc97d552a admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:10.802887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a0518-33e9-4eee-9a43-490ffe60f12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:10.803739 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a0518-33e9-4eee-9a43-490ffe60f12a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:10.804024 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a0518-33e9-4eee-9a43-490ffe60f12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:10.804301 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a0518-33e9-4eee-9a43-490ffe60f12a admin admin] PATH_INFO: `/v3/projects/88ca25c0b1c749ee9f84c7c3e38d3ce4` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:10.805531 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a0518-33e9-4eee-9a43-490ffe60f12a admin admin] RBAC: Authorizing `identity:delete_project(project_id=88ca25c0b1c749ee9f84c7c3e38d3ce4)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:10.808067 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a0518-33e9-4eee-9a43-490ffe60f12a admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:10.908243 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-ad4a0518-33e9-4eee-9a43-490ffe60f12a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88ca25c0b1c749ee9f84c7c3e38d3ce4', 'request_id': 'req-ad4a0518-33e9-4eee-9a43-490ffe60f12a'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:10.914796 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-ad4a0518-33e9-4eee-9a43-490ffe60f12a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88ca25c0b1c749ee9f84c7c3e38d3ce4', 'request_id': 'req-ad4a0518-33e9-4eee-9a43-490ffe60f12a'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:10.961947 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-ad4a0518-33e9-4eee-9a43-490ffe60f12a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88ca25c0b1c749ee9f84c7c3e38d3ce4', 'request_id': 'req-ad4a0518-33e9-4eee-9a43-490ffe60f12a'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:10.973747 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-ad4a0518-33e9-4eee-9a43-490ffe60f12a admin admin] The token cache is being invalidate because project 88ca25c0b1c749ee9f84c7c3e38d3ce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:10.974032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-ad4a0518-33e9-4eee-9a43-490ffe60f12a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:10.974769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-ad4a0518-33e9-4eee-9a43-490ffe60f12a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:10.976354 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1099/2199] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:10 2022] DELETE /identity/v3/projects/88ca25c0b1c749ee9f84c7c3e38d3ce4 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:21:10.982619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df5f27-1678-40c3-ac9e-e78a822a4f21 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:10.983092 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df5f27-1678-40c3-ac9e-e78a822a4f21 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:10.983183 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df5f27-1678-40c3-ac9e-e78a822a4f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:11.001761 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-f0df5f27-1678-40c3-ac9e-e78a822a4f21 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:11.002851 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-f0df5f27-1678-40c3-ac9e-e78a822a4f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:11.067874 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1101/2200] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:11.076568 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e84f49-0392-4d12-b5a7-054f52ad2902 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:11.076925 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e84f49-0392-4d12-b5a7-054f52ad2902 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:11.077219 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e84f49-0392-4d12-b5a7-054f52ad2902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:11.095677 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-13e84f49-0392-4d12-b5a7-054f52ad2902 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:11.096951 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-13e84f49-0392-4d12-b5a7-054f52ad2902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:11.105221 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1100/2201] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:11.109850 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df5f27-1678-40c3-ac9e-e78a822a4f21 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:11.119483 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df5f27-1678-40c3-ac9e-e78a822a4f21 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:11.129354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe32f1-361b-4375-be45-952c13216c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:11.130027 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe32f1-361b-4375-be45-952c13216c67 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:11.130312 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe32f1-361b-4375-be45-952c13216c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:11.130690 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe32f1-361b-4375-be45-952c13216c67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:11.131442 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe32f1-361b-4375-be45-952c13216c67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:21:11.131770 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe32f1-361b-4375-be45-952c13216c67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:11.133410 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe32f1-361b-4375-be45-952c13216c67 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:11.146230 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1102/2202] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:21:11.151549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e84f49-0392-4d12-b5a7-054f52ad2902 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:11.161329 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e84f49-0392-4d12-b5a7-054f52ad2902 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:11.166244 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84ed30-e68d-4441-9831-1c0c46380693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:11.166986 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84ed30-e68d-4441-9831-1c0c46380693 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:11.167354 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84ed30-e68d-4441-9831-1c0c46380693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:11.167700 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84ed30-e68d-4441-9831-1c0c46380693 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:11.168478 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84ed30-e68d-4441-9831-1c0c46380693 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:11.170504 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84ed30-e68d-4441-9831-1c0c46380693 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:11.296178 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1101/2203] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:11 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:11.300677 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe32f1-361b-4375-be45-952c13216c67 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:11.311436 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe32f1-361b-4375-be45-952c13216c67 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:11.367708 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ce465-cf0a-402f-ae75-9ba4d422a845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:11.368379 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ce465-cf0a-402f-ae75-9ba4d422a845 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:11.368665 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ce465-cf0a-402f-ae75-9ba4d422a845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:11.368973 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ce465-cf0a-402f-ae75-9ba4d422a845 admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:11.369681 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ce465-cf0a-402f-ae75-9ba4d422a845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:11.372626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ce465-cf0a-402f-ae75-9ba4d422a845 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:11.511026 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1103/2204] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:11 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:21:11.515159 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84ed30-e68d-4441-9831-1c0c46380693 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:11.525932 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84ed30-e68d-4441-9831-1c0c46380693 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:11.530523 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ad604-4afa-48b3-b6a0-fda74759939c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:11.531179 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ad604-4afa-48b3-b6a0-fda74759939c admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:11.531466 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ad604-4afa-48b3-b6a0-fda74759939c admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:11.531747 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ad604-4afa-48b3-b6a0-fda74759939c admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:11.532479 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ad604-4afa-48b3-b6a0-fda74759939c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:11.534135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ad604-4afa-48b3-b6a0-fda74759939c admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:11.545238 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1102/2205] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:11.553148 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ce465-cf0a-402f-ae75-9ba4d422a845 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:11.563866 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ce465-cf0a-402f-ae75-9ba4d422a845 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:11.568535 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c0419-40f9-4fec-aaed-570b7578d22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:11.569235 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c0419-40f9-4fec-aaed-570b7578d22d admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:11.569522 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c0419-40f9-4fec-aaed-570b7578d22d admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:11.569800 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c0419-40f9-4fec-aaed-570b7578d22d admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:11.570526 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c0419-40f9-4fec-aaed-570b7578d22d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:11.572118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c0419-40f9-4fec-aaed-570b7578d22d admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:11.582110 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1104/2206] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:11.589321 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ad604-4afa-48b3-b6a0-fda74759939c admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:11.599344 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ad604-4afa-48b3-b6a0-fda74759939c admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:11.603970 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09da18-67c1-4fba-a0fb-1609ea572c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:11.605462 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09da18-67c1-4fba-a0fb-1609ea572c11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:11.605739 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09da18-67c1-4fba-a0fb-1609ea572c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:11.608779 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09da18-67c1-4fba-a0fb-1609ea572c11 admin admin] PATH_INFO: `/v3/projects/6ab33cfdc2164b3b9cdfd9f575ee96a3/users/45740b23621549e3a12c011db0238285/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:11.620358 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09da18-67c1-4fba-a0fb-1609ea572c11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ab33cfdc2164b3b9cdfd9f575ee96a3, user_id=45740b23621549e3a12c011db0238285, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:11.623132 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09da18-67c1-4fba-a0fb-1609ea572c11 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:11.728788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1103/2207] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:11 2022] PUT /identity/v3/projects/6ab33cfdc2164b3b9cdfd9f575ee96a3/users/45740b23621549e3a12c011db0238285/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:11.740713 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a865a33-209c-4f9d-8e94-cfe7f2f75d56 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:11.741030 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a865a33-209c-4f9d-8e94-cfe7f2f75d56 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:11.741314 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a865a33-209c-4f9d-8e94-cfe7f2f75d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:11.769515 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-7a865a33-209c-4f9d-8e94-cfe7f2f75d56 None None] MFA Rules not processed for user `45740b23621549e3a12c011db0238285`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:11.770798 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-7a865a33-209c-4f9d-8e94-cfe7f2f75d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:11.819324 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:11.840674 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1105/2208] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:21:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:11.845362 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09da18-67c1-4fba-a0fb-1609ea572c11 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:11.873449 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:11.911253 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09da18-67c1-4fba-a0fb-1609ea572c11 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:11.916698 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be95eb-9ad6-4c55-8d06-01bab3e6201e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:11.917961 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be95eb-9ad6-4c55-8d06-01bab3e6201e admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:11.918247 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be95eb-9ad6-4c55-8d06-01bab3e6201e admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:11.918615 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be95eb-9ad6-4c55-8d06-01bab3e6201e admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:11.919319 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be95eb-9ad6-4c55-8d06-01bab3e6201e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:11.921270 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be95eb-9ad6-4c55-8d06-01bab3e6201e admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:12.013067 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1104/2209] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:11 2022] POST /identity/v3/projects => generated 381 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:12.017272 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a865a33-209c-4f9d-8e94-cfe7f2f75d56 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:12.028660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a865a33-209c-4f9d-8e94-cfe7f2f75d56 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:12.084598 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d477080-fb31-40d4-b9e9-02ee45deb783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:12.085298 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d477080-fb31-40d4-b9e9-02ee45deb783 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:12.085588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d477080-fb31-40d4-b9e9-02ee45deb783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:12.085869 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d477080-fb31-40d4-b9e9-02ee45deb783 admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:12.086572 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d477080-fb31-40d4-b9e9-02ee45deb783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:12.088490 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d477080-fb31-40d4-b9e9-02ee45deb783 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:12.178408 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1106/2210] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:12 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:12.182389 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be95eb-9ad6-4c55-8d06-01bab3e6201e admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:12.193420 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be95eb-9ad6-4c55-8d06-01bab3e6201e admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:12.198312 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2f8b5-4860-48c0-871c-db4e8796bf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:12.198974 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2f8b5-4860-48c0-871c-db4e8796bf87 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:12.199258 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2f8b5-4860-48c0-871c-db4e8796bf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:12.199574 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2f8b5-4860-48c0-871c-db4e8796bf87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:12.200341 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2f8b5-4860-48c0-871c-db4e8796bf87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:12.201988 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2f8b5-4860-48c0-871c-db4e8796bf87 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:12.213321 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1105/2211] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:12.219433 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d477080-fb31-40d4-b9e9-02ee45deb783 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:12.230220 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d477080-fb31-40d4-b9e9-02ee45deb783 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:12.234985 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2424d-8825-4f4c-bfc1-cfbe222512d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:12.235870 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2424d-8825-4f4c-bfc1-cfbe222512d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:12.236153 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2424d-8825-4f4c-bfc1-cfbe222512d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:12.236430 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2424d-8825-4f4c-bfc1-cfbe222512d7 admin admin] PATH_INFO: `/v3/projects/311bd0bbf11745bdbd1a141df76245f8/users/c7fc8b7204a84dc9852a67dd2c125e09/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:12.251579 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2424d-8825-4f4c-bfc1-cfbe222512d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=311bd0bbf11745bdbd1a141df76245f8, user_id=c7fc8b7204a84dc9852a67dd2c125e09, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:12.254265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2424d-8825-4f4c-bfc1-cfbe222512d7 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:12.349369 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1107/2212] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:12 2022] PUT /identity/v3/projects/311bd0bbf11745bdbd1a141df76245f8/users/c7fc8b7204a84dc9852a67dd2c125e09/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:12.353457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2f8b5-4860-48c0-871c-db4e8796bf87 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:12.367529 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2f8b5-4860-48c0-871c-db4e8796bf87 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:12.423955 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf8753-e753-4d84-b05b-4acf074ee44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:12.424615 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf8753-e753-4d84-b05b-4acf074ee44b admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:12.424931 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf8753-e753-4d84-b05b-4acf074ee44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:12.425214 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf8753-e753-4d84-b05b-4acf074ee44b admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:12.425944 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf8753-e753-4d84-b05b-4acf074ee44b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:12.427618 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf8753-e753-4d84-b05b-4acf074ee44b admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:12.437282 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1106/2213] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:12.441608 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2424d-8825-4f4c-bfc1-cfbe222512d7 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:12.451794 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2424d-8825-4f4c-bfc1-cfbe222512d7 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:12.456436 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d385b00-a3c9-448c-b385-a059646dcea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:12.457350 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d385b00-a3c9-448c-b385-a059646dcea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:12.457638 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d385b00-a3c9-448c-b385-a059646dcea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:12.457924 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d385b00-a3c9-448c-b385-a059646dcea2 admin admin] PATH_INFO: `/v3/projects/311bd0bbf11745bdbd1a141df76245f8/users/c7fc8b7204a84dc9852a67dd2c125e09/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:12.459922 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d385b00-a3c9-448c-b385-a059646dcea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=311bd0bbf11745bdbd1a141df76245f8, user_id=c7fc8b7204a84dc9852a67dd2c125e09, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:12.462592 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d385b00-a3c9-448c-b385-a059646dcea2 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:12.473439 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1108/2214] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:12 2022] PUT /identity/v3/projects/311bd0bbf11745bdbd1a141df76245f8/users/c7fc8b7204a84dc9852a67dd2c125e09/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:12.483985 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175353dd-78d3-4a61-b34f-ecfe86cf31fe None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:12.484279 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175353dd-78d3-4a61-b34f-ecfe86cf31fe None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:12.484560 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175353dd-78d3-4a61-b34f-ecfe86cf31fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:12.510171 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-175353dd-78d3-4a61-b34f-ecfe86cf31fe None None] MFA Rules not processed for user `c7fc8b7204a84dc9852a67dd2c125e09`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:12.511382 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-175353dd-78d3-4a61-b34f-ecfe86cf31fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:12.578572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1107/2215] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:21:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:12.591782 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d385b00-a3c9-448c-b385-a059646dcea2 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:12.593494 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-0d385b00-a3c9-448c-b385-a059646dcea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:12.672381 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d385b00-a3c9-448c-b385-a059646dcea2 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:12.676171 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dec5d4-fe4b-4967-8fad-7407ff2b0388 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:12.676837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dec5d4-fe4b-4967-8fad-7407ff2b0388 service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:12.677158 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dec5d4-fe4b-4967-8fad-7407ff2b0388 service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:12.677438 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dec5d4-fe4b-4967-8fad-7407ff2b0388 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:12.686911 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dec5d4-fe4b-4967-8fad-7407ff2b0388 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:12.688347 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dec5d4-fe4b-4967-8fad-7407ff2b0388 service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:12.697892 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1109/2216] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:12.866322 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175353dd-78d3-4a61-b34f-ecfe86cf31fe None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:12.876179 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175353dd-78d3-4a61-b34f-ecfe86cf31fe None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:12.880029 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03030400-0ce4-4ed6-9dde-13331f799061 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:12.880675 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03030400-0ce4-4ed6-9dde-13331f799061 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:12.880988 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03030400-0ce4-4ed6-9dde-13331f799061 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:12.881263 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03030400-0ce4-4ed6-9dde-13331f799061 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:12.898834 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:12.939108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03030400-0ce4-4ed6-9dde-13331f799061 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:12.940475 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03030400-0ce4-4ed6-9dde-13331f799061 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:12.950023 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1108/2217] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:13.587149 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dec5d4-fe4b-4967-8fad-7407ff2b0388 service cinder] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:13.608858 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:13.651844 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dec5d4-fe4b-4967-8fad-7407ff2b0388 service cinder] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:13.656503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afe400-fbaf-4685-bc3f-e34ef812eacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:13.657407 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afe400-fbaf-4685-bc3f-e34ef812eacf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:13.657689 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afe400-fbaf-4685-bc3f-e34ef812eacf admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:13.657967 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afe400-fbaf-4685-bc3f-e34ef812eacf admin admin] PATH_INFO: `/v3/users/45740b23621549e3a12c011db0238285` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:13.659158 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afe400-fbaf-4685-bc3f-e34ef812eacf admin admin] RBAC: Authorizing `identity:delete_user(user_id=45740b23621549e3a12c011db0238285)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:13.661111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afe400-fbaf-4685-bc3f-e34ef812eacf admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:13.883099 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-17afe400-fbaf-4685-bc3f-e34ef812eacf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45740b23621549e3a12c011db0238285'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:13.883684 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-17afe400-fbaf-4685-bc3f-e34ef812eacf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45740b23621549e3a12c011db0238285'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:14.019799 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-17afe400-fbaf-4685-bc3f-e34ef812eacf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45740b23621549e3a12c011db0238285'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:14.032632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-17afe400-fbaf-4685-bc3f-e34ef812eacf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45740b23621549e3a12c011db0238285'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:14.039674 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-17afe400-fbaf-4685-bc3f-e34ef812eacf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45740b23621549e3a12c011db0238285'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:14.045674 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1110/2218] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:13 2022] DELETE /identity/v3/users/45740b23621549e3a12c011db0238285 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:14.050312 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec058e-dd3b-4642-944b-4c4cdea97d52 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:14.050808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec058e-dd3b-4642-944b-4c4cdea97d52 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:14.050901 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec058e-dd3b-4642-944b-4c4cdea97d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:14.070185 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-27ec058e-dd3b-4642-944b-4c4cdea97d52 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:14.071407 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-27ec058e-dd3b-4642-944b-4c4cdea97d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:14.132019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1109/2219] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:14.142637 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afe400-fbaf-4685-bc3f-e34ef812eacf admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:14.144140 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-17afe400-fbaf-4685-bc3f-e34ef812eacf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:14.202124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afe400-fbaf-4685-bc3f-e34ef812eacf admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:14.205729 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d43b8b-5ba9-493c-8f68-1a56dd56dc6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:14.206381 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d43b8b-5ba9-493c-8f68-1a56dd56dc6b service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:14.206669 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d43b8b-5ba9-493c-8f68-1a56dd56dc6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:14.206950 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d43b8b-5ba9-493c-8f68-1a56dd56dc6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:14.216367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d43b8b-5ba9-493c-8f68-1a56dd56dc6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:14.217827 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d43b8b-5ba9-493c-8f68-1a56dd56dc6b service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:14.227264 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1111/2220] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:14.712708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec058e-dd3b-4642-944b-4c4cdea97d52 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:14.714321 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-27ec058e-dd3b-4642-944b-4c4cdea97d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:14.729335 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec058e-dd3b-4642-944b-4c4cdea97d52 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:14.736198 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abfc0a-398e-4cce-a2ea-536e39ee9c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:14.737882 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abfc0a-398e-4cce-a2ea-536e39ee9c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:14.738397 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abfc0a-398e-4cce-a2ea-536e39ee9c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:14.738521 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abfc0a-398e-4cce-a2ea-536e39ee9c88 admin admin] PATH_INFO: `/v3/projects/6ab33cfdc2164b3b9cdfd9f575ee96a3` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:14.739767 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4abfc0a-398e-4cce-a2ea-536e39ee9c88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ab33cfdc2164b3b9cdfd9f575ee96a3)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:14.741953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4abfc0a-398e-4cce-a2ea-536e39ee9c88 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:14.905800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e4abfc0a-398e-4cce-a2ea-536e39ee9c88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ab33cfdc2164b3b9cdfd9f575ee96a3', 'request_id': 'req-e4abfc0a-398e-4cce-a2ea-536e39ee9c88'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:14.920755 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e4abfc0a-398e-4cce-a2ea-536e39ee9c88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ab33cfdc2164b3b9cdfd9f575ee96a3', 'request_id': 'req-e4abfc0a-398e-4cce-a2ea-536e39ee9c88'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:15.013386 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e4abfc0a-398e-4cce-a2ea-536e39ee9c88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ab33cfdc2164b3b9cdfd9f575ee96a3', 'request_id': 'req-e4abfc0a-398e-4cce-a2ea-536e39ee9c88'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:15.032605 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e4abfc0a-398e-4cce-a2ea-536e39ee9c88 admin admin] The token cache is being invalidate because project 6ab33cfdc2164b3b9cdfd9f575ee96a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:15.033169 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e4abfc0a-398e-4cce-a2ea-536e39ee9c88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:15.034233 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e4abfc0a-398e-4cce-a2ea-536e39ee9c88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:15.037011 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1110/2221] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:14 2022] DELETE /identity/v3/projects/6ab33cfdc2164b3b9cdfd9f575ee96a3 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:15.041250 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d43b8b-5ba9-493c-8f68-1a56dd56dc6b service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:15.052189 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d43b8b-5ba9-493c-8f68-1a56dd56dc6b service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:15.101746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:15.121625 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8bd62-80af-4a2d-9400-f919fe528dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:15.124264 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8bd62-80af-4a2d-9400-f919fe528dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:15.124264 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8bd62-80af-4a2d-9400-f919fe528dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:15.124264 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8bd62-80af-4a2d-9400-f919fe528dae admin admin] PATH_INFO: `/v3/users/c7fc8b7204a84dc9852a67dd2c125e09` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:15.124599 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d8bd62-80af-4a2d-9400-f919fe528dae admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7fc8b7204a84dc9852a67dd2c125e09)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:15.126616 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d8bd62-80af-4a2d-9400-f919fe528dae admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:15.400078 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-d0d8bd62-80af-4a2d-9400-f919fe528dae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7fc8b7204a84dc9852a67dd2c125e09'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:15.400791 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-d0d8bd62-80af-4a2d-9400-f919fe528dae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7fc8b7204a84dc9852a67dd2c125e09'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:15.500366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-d0d8bd62-80af-4a2d-9400-f919fe528dae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7fc8b7204a84dc9852a67dd2c125e09'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:15.516409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-d0d8bd62-80af-4a2d-9400-f919fe528dae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7fc8b7204a84dc9852a67dd2c125e09'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:15.524281 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-d0d8bd62-80af-4a2d-9400-f919fe528dae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7fc8b7204a84dc9852a67dd2c125e09'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:15.530697 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1112/2222] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:15 2022] DELETE /identity/v3/users/c7fc8b7204a84dc9852a67dd2c125e09 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:16.113400 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abfc0a-398e-4cce-a2ea-536e39ee9c88 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:16.114906 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-e4abfc0a-398e-4cce-a2ea-536e39ee9c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:16.128684 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abfc0a-398e-4cce-a2ea-536e39ee9c88 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:16.171306 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:16.187163 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4f39b-0f3e-4111-b4bd-a6a2e871a7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:16.188012 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4f39b-0f3e-4111-b4bd-a6a2e871a7ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:16.188292 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4f39b-0f3e-4111-b4bd-a6a2e871a7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:16.188564 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4f39b-0f3e-4111-b4bd-a6a2e871a7ed admin admin] PATH_INFO: `/v3/projects/311bd0bbf11745bdbd1a141df76245f8` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:16.189771 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4f39b-0f3e-4111-b4bd-a6a2e871a7ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=311bd0bbf11745bdbd1a141df76245f8)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:16.191709 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4f39b-0f3e-4111-b4bd-a6a2e871a7ed admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:16.321261 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-7db4f39b-0f3e-4111-b4bd-a6a2e871a7ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '311bd0bbf11745bdbd1a141df76245f8', 'request_id': 'req-7db4f39b-0f3e-4111-b4bd-a6a2e871a7ed'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:16.327300 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-7db4f39b-0f3e-4111-b4bd-a6a2e871a7ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '311bd0bbf11745bdbd1a141df76245f8', 'request_id': 'req-7db4f39b-0f3e-4111-b4bd-a6a2e871a7ed'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:16.517307 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-7db4f39b-0f3e-4111-b4bd-a6a2e871a7ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '311bd0bbf11745bdbd1a141df76245f8', 'request_id': 'req-7db4f39b-0f3e-4111-b4bd-a6a2e871a7ed'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:16.528763 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-7db4f39b-0f3e-4111-b4bd-a6a2e871a7ed admin admin] The token cache is being invalidate because project 311bd0bbf11745bdbd1a141df76245f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:16.529076 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-7db4f39b-0f3e-4111-b4bd-a6a2e871a7ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:16.529710 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-7db4f39b-0f3e-4111-b4bd-a6a2e871a7ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:16.531245 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1111/2223] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:16 2022] DELETE /identity/v3/projects/311bd0bbf11745bdbd1a141df76245f8 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:16.536121 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42fd40-362c-45f9-baa7-0612caa06f0c None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:16.536647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42fd40-362c-45f9-baa7-0612caa06f0c None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:16.536760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42fd40-362c-45f9-baa7-0612caa06f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:16.554237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-8f42fd40-362c-45f9-baa7-0612caa06f0c None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:16.555507 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-8f42fd40-362c-45f9-baa7-0612caa06f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:16.646993 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1113/2224] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:16.650575 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1b20d-bf56-4127-8070-914e5a81f248 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:16.650863 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1b20d-bf56-4127-8070-914e5a81f248 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:16.651141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1b20d-bf56-4127-8070-914e5a81f248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:16.675746 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-dad1b20d-bf56-4127-8070-914e5a81f248 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:16.677011 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-dad1b20d-bf56-4127-8070-914e5a81f248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:16.685388 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1112/2225] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:16.690359 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42fd40-362c-45f9-baa7-0612caa06f0c None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:16.700931 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42fd40-362c-45f9-baa7-0612caa06f0c None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:16.705563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d41d1a4-4e7e-4650-a308-81f702efa778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:16.706214 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41d1a4-4e7e-4650-a308-81f702efa778 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:16.706497 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41d1a4-4e7e-4650-a308-81f702efa778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:16.706776 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41d1a4-4e7e-4650-a308-81f702efa778 admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:16.707572 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d41d1a4-4e7e-4650-a308-81f702efa778 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:21:16.707869 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d41d1a4-4e7e-4650-a308-81f702efa778 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:16.709516 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d41d1a4-4e7e-4650-a308-81f702efa778 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:16.721583 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1114/2226] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:21:16.726291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1b20d-bf56-4127-8070-914e5a81f248 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:16.736352 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1b20d-bf56-4127-8070-914e5a81f248 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:16.741162 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4a045-aa54-4dc9-824c-4fa306ee9164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:16.741820 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4a045-aa54-4dc9-824c-4fa306ee9164 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:16.742102 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4a045-aa54-4dc9-824c-4fa306ee9164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:16.742376 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4a045-aa54-4dc9-824c-4fa306ee9164 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:16.743069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4a045-aa54-4dc9-824c-4fa306ee9164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:16.745040 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4a045-aa54-4dc9-824c-4fa306ee9164 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:16.868315 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1113/2227] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:16 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:16.870383 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d41d1a4-4e7e-4650-a308-81f702efa778 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:16.882014 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d41d1a4-4e7e-4650-a308-81f702efa778 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:16.932014 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:16.944281 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ed1f6-256e-4087-ad65-1c0c549d2a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:16.945006 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ed1f6-256e-4087-ad65-1c0c549d2a4d admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:16.945294 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ed1f6-256e-4087-ad65-1c0c549d2a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:16.945676 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ed1f6-256e-4087-ad65-1c0c549d2a4d admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:16.946322 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ed1f6-256e-4087-ad65-1c0c549d2a4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:16.948246 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ed1f6-256e-4087-ad65-1c0c549d2a4d admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:17.073743 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1115/2228] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:16 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:21:17.075518 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4a045-aa54-4dc9-824c-4fa306ee9164 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:17.085922 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4a045-aa54-4dc9-824c-4fa306ee9164 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:17.091017 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad565ad9-9499-443a-963d-49332647d393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:17.091676 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad565ad9-9499-443a-963d-49332647d393 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:17.091953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad565ad9-9499-443a-963d-49332647d393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:17.092225 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad565ad9-9499-443a-963d-49332647d393 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:17.092992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad565ad9-9499-443a-963d-49332647d393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:17.094591 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad565ad9-9499-443a-963d-49332647d393 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:17.105112 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1114/2229] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:17.109575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ed1f6-256e-4087-ad65-1c0c549d2a4d admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:17.119876 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ed1f6-256e-4087-ad65-1c0c549d2a4d admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:17.125673 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1bd324-aff7-4301-959e-7e669ec2bdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:17.131533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bd324-aff7-4301-959e-7e669ec2bdee admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:17.131533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bd324-aff7-4301-959e-7e669ec2bdee admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:17.131533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bd324-aff7-4301-959e-7e669ec2bdee admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:17.131533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1bd324-aff7-4301-959e-7e669ec2bdee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:17.131533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1bd324-aff7-4301-959e-7e669ec2bdee admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:17.140566 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1116/2230] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:17.144796 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad565ad9-9499-443a-963d-49332647d393 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:17.154952 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad565ad9-9499-443a-963d-49332647d393 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:17.159546 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afe934-aaed-4da6-80d7-0c7ee2eb1fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:17.160414 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afe934-aaed-4da6-80d7-0c7ee2eb1fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:17.160691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afe934-aaed-4da6-80d7-0c7ee2eb1fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:17.160995 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afe934-aaed-4da6-80d7-0c7ee2eb1fa3 admin admin] PATH_INFO: `/v3/projects/066513b5ccd9407fb9c6eb15e3e1949b/users/079e328bcad04b559e0888494b79daa4/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:17.180758 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24afe934-aaed-4da6-80d7-0c7ee2eb1fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=066513b5ccd9407fb9c6eb15e3e1949b, user_id=079e328bcad04b559e0888494b79daa4, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:17.183585 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24afe934-aaed-4da6-80d7-0c7ee2eb1fa3 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:17.282068 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1115/2231] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:17 2022] PUT /identity/v3/projects/066513b5ccd9407fb9c6eb15e3e1949b/users/079e328bcad04b559e0888494b79daa4/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:17.293149 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90809c84-f5df-44e0-ada5-41145947133f None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:17.293439 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90809c84-f5df-44e0-ada5-41145947133f None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:17.293723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90809c84-f5df-44e0-ada5-41145947133f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:17.321157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-90809c84-f5df-44e0-ada5-41145947133f None None] MFA Rules not processed for user `079e328bcad04b559e0888494b79daa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:17.322523 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-90809c84-f5df-44e0-ada5-41145947133f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:17.388406 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1117/2232] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:21:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:21:17.393013 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afe934-aaed-4da6-80d7-0c7ee2eb1fa3 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:17.461586 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afe934-aaed-4da6-80d7-0c7ee2eb1fa3 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:17.468031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f88647-9562-419a-af8d-4470703affa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:17.469046 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f88647-9562-419a-af8d-4470703affa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:17.469465 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f88647-9562-419a-af8d-4470703affa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:17.469751 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f88647-9562-419a-af8d-4470703affa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:17.470475 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f88647-9562-419a-af8d-4470703affa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:17.472401 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f88647-9562-419a-af8d-4470703affa9 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:17.485929 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:17.615250 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1116/2233] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:17 2022] POST /identity/v3/projects => generated 377 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:17.619316 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90809c84-f5df-44e0-ada5-41145947133f None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:17.630830 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90809c84-f5df-44e0-ada5-41145947133f None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:17.702475 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad97b9b-81ec-4ced-b432-e543f9da15bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:17.703155 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad97b9b-81ec-4ced-b432-e543f9da15bd admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:17.703436 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad97b9b-81ec-4ced-b432-e543f9da15bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:17.703710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad97b9b-81ec-4ced-b432-e543f9da15bd admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:17.704575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad97b9b-81ec-4ced-b432-e543f9da15bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:17.708136 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad97b9b-81ec-4ced-b432-e543f9da15bd admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:17.879243 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1118/2234] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:17 2022] POST /identity/v3/users => generated 289 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:17.888526 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f88647-9562-419a-af8d-4470703affa9 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:17.899343 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f88647-9562-419a-af8d-4470703affa9 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:17.904521 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ee2fd-8b0f-4a17-bf92-4c2a7935c3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:17.905227 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ee2fd-8b0f-4a17-bf92-4c2a7935c3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:17.905515 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ee2fd-8b0f-4a17-bf92-4c2a7935c3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:17.905816 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ee2fd-8b0f-4a17-bf92-4c2a7935c3c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:17.906532 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ee2fd-8b0f-4a17-bf92-4c2a7935c3c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:17.908385 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ee2fd-8b0f-4a17-bf92-4c2a7935c3c8 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:17.919844 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1117/2235] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:17.923989 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad97b9b-81ec-4ced-b432-e543f9da15bd admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:17.934779 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad97b9b-81ec-4ced-b432-e543f9da15bd admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:17.939454 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f399ade-ae20-43d8-9a1b-e8fe7e3f8b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:17.940107 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f399ade-ae20-43d8-9a1b-e8fe7e3f8b40 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:17.940392 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f399ade-ae20-43d8-9a1b-e8fe7e3f8b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:17.940672 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f399ade-ae20-43d8-9a1b-e8fe7e3f8b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:17.941464 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f399ade-ae20-43d8-9a1b-e8fe7e3f8b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:17.943050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f399ade-ae20-43d8-9a1b-e8fe7e3f8b40 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:17.953167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1119/2236] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:17.960948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ee2fd-8b0f-4a17-bf92-4c2a7935c3c8 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:17.970929 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ee2fd-8b0f-4a17-bf92-4c2a7935c3c8 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:17.975571 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c2230-4c9a-45c6-9b4a-323197926ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:17.976525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c2230-4c9a-45c6-9b4a-323197926ac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:17.976833 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c2230-4c9a-45c6-9b4a-323197926ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:17.977118 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c2230-4c9a-45c6-9b4a-323197926ac6 admin admin] PATH_INFO: `/v3/projects/906bffa243404443b2850ced572f25d6/users/64bf5a179a624d95b1b2d54524559ef0/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:17.992658 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c2230-4c9a-45c6-9b4a-323197926ac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=906bffa243404443b2850ced572f25d6, user_id=64bf5a179a624d95b1b2d54524559ef0, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:17.999948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c2230-4c9a-45c6-9b4a-323197926ac6 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:18.161819 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1118/2237] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:17 2022] PUT /identity/v3/projects/906bffa243404443b2850ced572f25d6/users/64bf5a179a624d95b1b2d54524559ef0/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:21:18.172551 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24c744-e7c0-416e-b5ba-4af0beb45c6e None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:18.173160 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24c744-e7c0-416e-b5ba-4af0beb45c6e None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:18.173541 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24c744-e7c0-416e-b5ba-4af0beb45c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:18.201706 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-3b24c744-e7c0-416e-b5ba-4af0beb45c6e None None] MFA Rules not processed for user `64bf5a179a624d95b1b2d54524559ef0`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:18.202923 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-3b24c744-e7c0-416e-b5ba-4af0beb45c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:18.232724 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:18.275579 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1120/2238] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:21:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:18.280627 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c2230-4c9a-45c6-9b4a-323197926ac6 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:18.343731 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c2230-4c9a-45c6-9b4a-323197926ac6 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:18.348517 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6cb87-b43f-4a58-82dc-09c4862c6ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:18.349206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6cb87-b43f-4a58-82dc-09c4862c6ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:18.349492 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6cb87-b43f-4a58-82dc-09c4862c6ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:18.349792 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6cb87-b43f-4a58-82dc-09c4862c6ab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:18.350469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6cb87-b43f-4a58-82dc-09c4862c6ab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:18.352389 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6cb87-b43f-4a58-82dc-09c4862c6ab7 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:18.467908 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1119/2239] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:18 2022] POST /identity/v3/projects => generated 375 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:18.472025 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24c744-e7c0-416e-b5ba-4af0beb45c6e None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:18.482488 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24c744-e7c0-416e-b5ba-4af0beb45c6e None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:18.540438 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658f8a0-f3be-44bd-852f-ec1cc8584a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:18.541133 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658f8a0-f3be-44bd-852f-ec1cc8584a37 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:18.541426 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658f8a0-f3be-44bd-852f-ec1cc8584a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:18.541706 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658f8a0-f3be-44bd-852f-ec1cc8584a37 admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:18.542597 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658f8a0-f3be-44bd-852f-ec1cc8584a37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:18.544516 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658f8a0-f3be-44bd-852f-ec1cc8584a37 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:18.681727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1121/2240] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:18 2022] POST /identity/v3/users => generated 294 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:21:18.682822 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6cb87-b43f-4a58-82dc-09c4862c6ab7 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:18.694516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6cb87-b43f-4a58-82dc-09c4862c6ab7 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:18.700158 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca3bdc-1474-4c0e-9680-4b0c4546c59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:18.700835 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca3bdc-1474-4c0e-9680-4b0c4546c59a admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:18.701129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca3bdc-1474-4c0e-9680-4b0c4546c59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:18.701411 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca3bdc-1474-4c0e-9680-4b0c4546c59a admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:18.702155 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca3bdc-1474-4c0e-9680-4b0c4546c59a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:18.703840 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca3bdc-1474-4c0e-9680-4b0c4546c59a admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:18.716352 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1120/2241] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:18.720552 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658f8a0-f3be-44bd-852f-ec1cc8584a37 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:18.731363 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658f8a0-f3be-44bd-852f-ec1cc8584a37 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:18.737288 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b4752-3841-4bb8-9c12-7cc82b52b498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:18.738303 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b4752-3841-4bb8-9c12-7cc82b52b498 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:18.738489 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b4752-3841-4bb8-9c12-7cc82b52b498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:18.738752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b4752-3841-4bb8-9c12-7cc82b52b498 admin admin] PATH_INFO: `/v3/projects/3228a193d39043feb3007151b4bf8b66/users/6fdc78ae4c0945639c94030fceabc4ce/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:18.755558 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b4752-3841-4bb8-9c12-7cc82b52b498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3228a193d39043feb3007151b4bf8b66, user_id=6fdc78ae4c0945639c94030fceabc4ce, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:18.758264 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b4752-3841-4bb8-9c12-7cc82b52b498 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:18.872708 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1122/2242] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:18 2022] PUT /identity/v3/projects/3228a193d39043feb3007151b4bf8b66/users/6fdc78ae4c0945639c94030fceabc4ce/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:21:18.876770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca3bdc-1474-4c0e-9680-4b0c4546c59a admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:18.886621 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca3bdc-1474-4c0e-9680-4b0c4546c59a admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:18.941565 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c9dd8-5cd5-4400-a056-dded95b5570f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:18.942223 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c9dd8-5cd5-4400-a056-dded95b5570f admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:18.942503 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c9dd8-5cd5-4400-a056-dded95b5570f admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:18.942772 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c9dd8-5cd5-4400-a056-dded95b5570f admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:18.943489 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c9dd8-5cd5-4400-a056-dded95b5570f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:18.945105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c9dd8-5cd5-4400-a056-dded95b5570f admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:18.954652 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1121/2243] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:18.958885 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b4752-3841-4bb8-9c12-7cc82b52b498 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:18.970367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b4752-3841-4bb8-9c12-7cc82b52b498 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:18.975523 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848a0e9-2f8c-44ea-945d-ce93fa640be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:18.976499 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848a0e9-2f8c-44ea-945d-ce93fa640be3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:18.976786 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848a0e9-2f8c-44ea-945d-ce93fa640be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:18.977105 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848a0e9-2f8c-44ea-945d-ce93fa640be3 admin admin] PATH_INFO: `/v3/projects/3228a193d39043feb3007151b4bf8b66/users/6fdc78ae4c0945639c94030fceabc4ce/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:18.979379 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848a0e9-2f8c-44ea-945d-ce93fa640be3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3228a193d39043feb3007151b4bf8b66, user_id=6fdc78ae4c0945639c94030fceabc4ce, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:18.982663 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848a0e9-2f8c-44ea-945d-ce93fa640be3 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:18.994166 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1123/2244] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:18 2022] PUT /identity/v3/projects/3228a193d39043feb3007151b4bf8b66/users/6fdc78ae4c0945639c94030fceabc4ce/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:21:19.004656 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20ee0c-a9a7-4e64-897d-03cbd5361f87 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:19.005102 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20ee0c-a9a7-4e64-897d-03cbd5361f87 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:19.005247 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20ee0c-a9a7-4e64-897d-03cbd5361f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:19.037939 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-7e20ee0c-a9a7-4e64-897d-03cbd5361f87 None None] MFA Rules not processed for user `6fdc78ae4c0945639c94030fceabc4ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:19.038489 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-7e20ee0c-a9a7-4e64-897d-03cbd5361f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:19.056793 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:19.123753 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1122/2245] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:21:19 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:19.143339 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848a0e9-2f8c-44ea-945d-ce93fa640be3 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:19.146538 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-7848a0e9-2f8c-44ea-945d-ce93fa640be3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:19.205905 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848a0e9-2f8c-44ea-945d-ce93fa640be3 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:19.209562 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7acd1-63ca-42dd-a10e-4a5617310212 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:19.210208 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7acd1-63ca-42dd-a10e-4a5617310212 service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:19.210494 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7acd1-63ca-42dd-a10e-4a5617310212 service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:19.210776 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7acd1-63ca-42dd-a10e-4a5617310212 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:19.245429 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:19.274599 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7acd1-63ca-42dd-a10e-4a5617310212 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:19.275459 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7acd1-63ca-42dd-a10e-4a5617310212 service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:19.285142 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1124/2246] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:21.638302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d5165-c043-470d-9100-43ab0a829e1f None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:21.638803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d5165-c043-470d-9100-43ab0a829e1f None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:21.638896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d5165-c043-470d-9100-43ab0a829e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:21.657602 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-f66d5165-c043-470d-9100-43ab0a829e1f None None] MFA Rules not processed for user `425bf40bd45642a1aafeb65bdb9650af`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:21.662066 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-f66d5165-c043-470d-9100-43ab0a829e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:21.724864 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1123/2247] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:21:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:22.398561 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7acd1-63ca-42dd-a10e-4a5617310212 service cinder] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:22.408272 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7acd1-63ca-42dd-a10e-4a5617310212 service cinder] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:22.413023 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a215c0e-0c8d-4c7c-8d9b-073f88e7755c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:22.413284 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a215c0e-0c8d-4c7c-8d9b-073f88e7755c service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:22.413462 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a215c0e-0c8d-4c7c-8d9b-073f88e7755c service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:22.413651 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a215c0e-0c8d-4c7c-8d9b-073f88e7755c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:22.473091 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a215c0e-0c8d-4c7c-8d9b-073f88e7755c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:22.474684 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a215c0e-0c8d-4c7c-8d9b-073f88e7755c service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:22.485251 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1125/2248] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:24.307166 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d5165-c043-470d-9100-43ab0a829e1f None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:24.317243 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d5165-c043-470d-9100-43ab0a829e1f None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:24.321067 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fb9f0-c3bb-4084-81ca-ff65806b3093 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:24.321777 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fb9f0-c3bb-4084-81ca-ff65806b3093 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:24.322022 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fb9f0-c3bb-4084-81ca-ff65806b3093 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:24.322308 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fb9f0-c3bb-4084-81ca-ff65806b3093 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:24.333312 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fb9f0-c3bb-4084-81ca-ff65806b3093 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:24.334722 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fb9f0-c3bb-4084-81ca-ff65806b3093 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:24.345544 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1124/2249] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:24 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:25.078538 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a215c0e-0c8d-4c7c-8d9b-073f88e7755c service cinder] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:25.079958 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-7a215c0e-0c8d-4c7c-8d9b-073f88e7755c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:25.179405 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a215c0e-0c8d-4c7c-8d9b-073f88e7755c service cinder] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:25.188629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f7c7c-45dc-4ba5-b2da-bc585f4aff93 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '675892a676054b4f86f9ac12d95f4f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:25.189584 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f7c7c-45dc-4ba5-b2da-bc585f4aff93 service placement] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:25.190025 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f7c7c-45dc-4ba5-b2da-bc585f4aff93 service placement] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:25.190543 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f7c7c-45dc-4ba5-b2da-bc585f4aff93 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:25.193538 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-393f7c7c-45dc-4ba5-b2da-bc585f4aff93 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:25.210524 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f7c7c-45dc-4ba5-b2da-bc585f4aff93 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:25.212404 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f7c7c-45dc-4ba5-b2da-bc585f4aff93 service placement] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:25.227455 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1126/2250] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:32.898582 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aaf765-be7f-4e0c-a515-3d77e8435864 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:32.899138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aaf765-be7f-4e0c-a515-3d77e8435864 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:32.899138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aaf765-be7f-4e0c-a515-3d77e8435864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:32.952115 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-83aaf765-be7f-4e0c-a515-3d77e8435864 None None] MFA Rules not processed for user `7b4d3b1fe8064cc592d89e7bab91bace`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:32.953504 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-83aaf765-be7f-4e0c-a515-3d77e8435864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:33.041442 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1125/2251] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Jun 22 10:21:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:33.083631 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f7c7c-45dc-4ba5-b2da-bc585f4aff93 service placement] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:33.085086 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-393f7c7c-45dc-4ba5-b2da-bc585f4aff93 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:33.152135 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:33.180649 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f7c7c-45dc-4ba5-b2da-bc585f4aff93 service placement] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:33.187744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e100a7d-9d68-46b3-943d-87f179238327 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c724063ce51470ca09c5c5ab231fd9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:33.188757 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e100a7d-9d68-46b3-943d-87f179238327 service swift] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:33.189123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e100a7d-9d68-46b3-943d-87f179238327 service swift] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:33.189440 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e100a7d-9d68-46b3-943d-87f179238327 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:33.198512 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e100a7d-9d68-46b3-943d-87f179238327 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:33.200120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e100a7d-9d68-46b3-943d-87f179238327 service swift] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:33.208770 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1127/2252] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 22 10:21:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 10:21:35.576952 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aaf765-be7f-4e0c-a515-3d77e8435864 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:35.591102 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:35.651048 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aaf765-be7f-4e0c-a515-3d77e8435864 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:35.656990 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cb07d-0c61-46e2-83e4-601cab7e5bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:35.657954 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cb07d-0c61-46e2-83e4-601cab7e5bae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:35.658255 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cb07d-0c61-46e2-83e4-601cab7e5bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:35.658559 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cb07d-0c61-46e2-83e4-601cab7e5bae admin admin] PATH_INFO: `/v3/users/079e328bcad04b559e0888494b79daa4` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:35.660144 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405cb07d-0c61-46e2-83e4-601cab7e5bae admin admin] RBAC: Authorizing `identity:delete_user(user_id=079e328bcad04b559e0888494b79daa4)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:35.667798 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405cb07d-0c61-46e2-83e4-601cab7e5bae admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:35.861338 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-405cb07d-0c61-46e2-83e4-601cab7e5bae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '079e328bcad04b559e0888494b79daa4'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:35.874651 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-405cb07d-0c61-46e2-83e4-601cab7e5bae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '079e328bcad04b559e0888494b79daa4'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:35.974269 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-405cb07d-0c61-46e2-83e4-601cab7e5bae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '079e328bcad04b559e0888494b79daa4'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:35.975022 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-405cb07d-0c61-46e2-83e4-601cab7e5bae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '079e328bcad04b559e0888494b79daa4'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:35.983885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-405cb07d-0c61-46e2-83e4-601cab7e5bae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '079e328bcad04b559e0888494b79daa4'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:35.991533 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1126/2253] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:35 2022] DELETE /identity/v3/users/079e328bcad04b559e0888494b79daa4 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:35.998840 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a278646-29aa-4217-a17b-2fcb5521cce1 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:36.000252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a278646-29aa-4217-a17b-2fcb5521cce1 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:36.000743 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a278646-29aa-4217-a17b-2fcb5521cce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:36.023544 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-9a278646-29aa-4217-a17b-2fcb5521cce1 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:36.024846 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-9a278646-29aa-4217-a17b-2fcb5521cce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:36.100586 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1128/2254] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:36.116772 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cb07d-0c61-46e2-83e4-601cab7e5bae admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:36.119035 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-405cb07d-0c61-46e2-83e4-601cab7e5bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:36.192904 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cb07d-0c61-46e2-83e4-601cab7e5bae admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:36.196922 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbca3b-7d11-476d-9d93-3e7a158eac82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:36.197593 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbca3b-7d11-476d-9d93-3e7a158eac82 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:36.198128 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbca3b-7d11-476d-9d93-3e7a158eac82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:36.198250 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbca3b-7d11-476d-9d93-3e7a158eac82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:36.210523 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cbca3b-7d11-476d-9d93-3e7a158eac82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:36.212089 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cbca3b-7d11-476d-9d93-3e7a158eac82 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:36.224882 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1127/2255] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:36.880661 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a278646-29aa-4217-a17b-2fcb5521cce1 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:36.882812 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-9a278646-29aa-4217-a17b-2fcb5521cce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:36.905446 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a278646-29aa-4217-a17b-2fcb5521cce1 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:36.912195 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161da83-2171-4077-858b-d03185d69abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:36.913523 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161da83-2171-4077-858b-d03185d69abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:36.914027 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161da83-2171-4077-858b-d03185d69abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:36.914316 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161da83-2171-4077-858b-d03185d69abf admin admin] PATH_INFO: `/v3/projects/066513b5ccd9407fb9c6eb15e3e1949b` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:36.915661 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161da83-2171-4077-858b-d03185d69abf admin admin] RBAC: Authorizing `identity:delete_project(project_id=066513b5ccd9407fb9c6eb15e3e1949b)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:36.918737 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161da83-2171-4077-858b-d03185d69abf admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:37.053448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-1161da83-2171-4077-858b-d03185d69abf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '066513b5ccd9407fb9c6eb15e3e1949b', 'request_id': 'req-1161da83-2171-4077-858b-d03185d69abf'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:37.062776 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-1161da83-2171-4077-858b-d03185d69abf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '066513b5ccd9407fb9c6eb15e3e1949b', 'request_id': 'req-1161da83-2171-4077-858b-d03185d69abf'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:37.220660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-1161da83-2171-4077-858b-d03185d69abf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '066513b5ccd9407fb9c6eb15e3e1949b', 'request_id': 'req-1161da83-2171-4077-858b-d03185d69abf'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:37.234860 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-1161da83-2171-4077-858b-d03185d69abf admin admin] The token cache is being invalidate because project 066513b5ccd9407fb9c6eb15e3e1949b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:37.235205 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-1161da83-2171-4077-858b-d03185d69abf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:37.236028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-1161da83-2171-4077-858b-d03185d69abf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:37.238159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1129/2256] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:36 2022] DELETE /identity/v3/projects/066513b5ccd9407fb9c6eb15e3e1949b => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:37.242035 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbca3b-7d11-476d-9d93-3e7a158eac82 service neutron] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:37.253964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbca3b-7d11-476d-9d93-3e7a158eac82 service neutron] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:37.292964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:37.322028 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b40b92-12ae-4597-9c09-5b08d1cdf143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:37.323286 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b40b92-12ae-4597-9c09-5b08d1cdf143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:37.323599 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b40b92-12ae-4597-9c09-5b08d1cdf143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:37.323824 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b40b92-12ae-4597-9c09-5b08d1cdf143 admin admin] PATH_INFO: `/v3/users/64bf5a179a624d95b1b2d54524559ef0` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:37.325141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b40b92-12ae-4597-9c09-5b08d1cdf143 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64bf5a179a624d95b1b2d54524559ef0)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:37.327989 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b40b92-12ae-4597-9c09-5b08d1cdf143 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:37.573825 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-a9b40b92-12ae-4597-9c09-5b08d1cdf143 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64bf5a179a624d95b1b2d54524559ef0'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:37.598542 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-a9b40b92-12ae-4597-9c09-5b08d1cdf143 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64bf5a179a624d95b1b2d54524559ef0'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:37.703742 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-a9b40b92-12ae-4597-9c09-5b08d1cdf143 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64bf5a179a624d95b1b2d54524559ef0'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:37.704937 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-a9b40b92-12ae-4597-9c09-5b08d1cdf143 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64bf5a179a624d95b1b2d54524559ef0'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:37.719222 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-a9b40b92-12ae-4597-9c09-5b08d1cdf143 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64bf5a179a624d95b1b2d54524559ef0'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:37.728367 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1128/2257] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:37 2022] DELETE /identity/v3/users/64bf5a179a624d95b1b2d54524559ef0 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:38.343189 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161da83-2171-4077-858b-d03185d69abf admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:38.345578 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-1161da83-2171-4077-858b-d03185d69abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:38.385785 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161da83-2171-4077-858b-d03185d69abf admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:38.463604 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:38.473825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2a944-2d9c-46f3-9641-d2ac65e55d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:38.474721 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2a944-2d9c-46f3-9641-d2ac65e55d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:38.475258 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2a944-2d9c-46f3-9641-d2ac65e55d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:38.475258 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2a944-2d9c-46f3-9641-d2ac65e55d25 admin admin] PATH_INFO: `/v3/projects/906bffa243404443b2850ced572f25d6` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:38.476491 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f2a944-2d9c-46f3-9641-d2ac65e55d25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=906bffa243404443b2850ced572f25d6)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:38.478492 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f2a944-2d9c-46f3-9641-d2ac65e55d25 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:38.635251 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-39f2a944-2d9c-46f3-9641-d2ac65e55d25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '906bffa243404443b2850ced572f25d6', 'request_id': 'req-39f2a944-2d9c-46f3-9641-d2ac65e55d25'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:38.640304 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-39f2a944-2d9c-46f3-9641-d2ac65e55d25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '906bffa243404443b2850ced572f25d6', 'request_id': 'req-39f2a944-2d9c-46f3-9641-d2ac65e55d25'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:38.797871 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-39f2a944-2d9c-46f3-9641-d2ac65e55d25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '906bffa243404443b2850ced572f25d6', 'request_id': 'req-39f2a944-2d9c-46f3-9641-d2ac65e55d25'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:38.811892 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-39f2a944-2d9c-46f3-9641-d2ac65e55d25 admin admin] The token cache is being invalidate because project 906bffa243404443b2850ced572f25d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:38.812948 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-39f2a944-2d9c-46f3-9641-d2ac65e55d25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:38.813118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-39f2a944-2d9c-46f3-9641-d2ac65e55d25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:38.815062 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1130/2258] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:38 2022] DELETE /identity/v3/projects/906bffa243404443b2850ced572f25d6 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:38.820337 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b40b92-12ae-4597-9c09-5b08d1cdf143 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:38.822133 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-a9b40b92-12ae-4597-9c09-5b08d1cdf143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:38.840864 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b40b92-12ae-4597-9c09-5b08d1cdf143 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:38.922928 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17874755-141f-4afe-96e7-d54a6bc826e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:38.923849 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17874755-141f-4afe-96e7-d54a6bc826e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:38.924115 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17874755-141f-4afe-96e7-d54a6bc826e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:38.924517 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17874755-141f-4afe-96e7-d54a6bc826e1 admin admin] PATH_INFO: `/v3/users/6fdc78ae4c0945639c94030fceabc4ce` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:38.926016 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17874755-141f-4afe-96e7-d54a6bc826e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fdc78ae4c0945639c94030fceabc4ce)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:38.928344 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17874755-141f-4afe-96e7-d54a6bc826e1 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:39.304881 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-17874755-141f-4afe-96e7-d54a6bc826e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fdc78ae4c0945639c94030fceabc4ce'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:39.314710 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:39.325271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-17874755-141f-4afe-96e7-d54a6bc826e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fdc78ae4c0945639c94030fceabc4ce'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:39.432982 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-17874755-141f-4afe-96e7-d54a6bc826e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fdc78ae4c0945639c94030fceabc4ce'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:39.433643 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-17874755-141f-4afe-96e7-d54a6bc826e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fdc78ae4c0945639c94030fceabc4ce'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:39.448018 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-17874755-141f-4afe-96e7-d54a6bc826e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fdc78ae4c0945639c94030fceabc4ce'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:39.471141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1129/2259] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:38 2022] DELETE /identity/v3/users/6fdc78ae4c0945639c94030fceabc4ce => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:21:40.002831 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2a944-2d9c-46f3-9641-d2ac65e55d25 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:40.004547 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-39f2a944-2d9c-46f3-9641-d2ac65e55d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:40.020487 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2a944-2d9c-46f3-9641-d2ac65e55d25 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:40.096292 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b559e4-c1d3-4725-9134-0631396b7899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:40.097253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b559e4-c1d3-4725-9134-0631396b7899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:40.097629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b559e4-c1d3-4725-9134-0631396b7899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:40.097845 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b559e4-c1d3-4725-9134-0631396b7899 admin admin] PATH_INFO: `/v3/projects/3228a193d39043feb3007151b4bf8b66` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:40.099145 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b559e4-c1d3-4725-9134-0631396b7899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3228a193d39043feb3007151b4bf8b66)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:40.101122 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b559e4-c1d3-4725-9134-0631396b7899 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:40.223170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-17b559e4-c1d3-4725-9134-0631396b7899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3228a193d39043feb3007151b4bf8b66', 'request_id': 'req-17b559e4-c1d3-4725-9134-0631396b7899'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:40.229146 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-17b559e4-c1d3-4725-9134-0631396b7899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3228a193d39043feb3007151b4bf8b66', 'request_id': 'req-17b559e4-c1d3-4725-9134-0631396b7899'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:40.301281 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-17b559e4-c1d3-4725-9134-0631396b7899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3228a193d39043feb3007151b4bf8b66', 'request_id': 'req-17b559e4-c1d3-4725-9134-0631396b7899'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:40.317112 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-17b559e4-c1d3-4725-9134-0631396b7899 admin admin] The token cache is being invalidate because project 3228a193d39043feb3007151b4bf8b66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:40.317399 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-17b559e4-c1d3-4725-9134-0631396b7899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:40.318096 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-17b559e4-c1d3-4725-9134-0631396b7899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:40.319647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1131/2260] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:40 2022] DELETE /identity/v3/projects/3228a193d39043feb3007151b4bf8b66 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:40.325451 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d5aeb-852c-476a-ab37-0afcd9729e78 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:40.327091 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d5aeb-852c-476a-ab37-0afcd9729e78 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:40.327091 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d5aeb-852c-476a-ab37-0afcd9729e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:40.347720 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-7d1d5aeb-852c-476a-ab37-0afcd9729e78 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:40.349004 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-7d1d5aeb-852c-476a-ab37-0afcd9729e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:40.464687 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1130/2261] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:40.476091 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd979294-537c-40f9-a805-d5aa41ae18d5 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:40.476091 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd979294-537c-40f9-a805-d5aa41ae18d5 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:40.476091 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd979294-537c-40f9-a805-d5aa41ae18d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:40.495703 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-fd979294-537c-40f9-a805-d5aa41ae18d5 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:40.498020 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-fd979294-537c-40f9-a805-d5aa41ae18d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:40.507632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1132/2262] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:40.511826 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d5aeb-852c-476a-ab37-0afcd9729e78 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:40.529160 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d5aeb-852c-476a-ab37-0afcd9729e78 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:40.535875 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65fb7c7-7dd4-4c53-9dae-54bcfb513208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:40.536863 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fb7c7-7dd4-4c53-9dae-54bcfb513208 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:40.537350 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fb7c7-7dd4-4c53-9dae-54bcfb513208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:40.537820 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fb7c7-7dd4-4c53-9dae-54bcfb513208 admin admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:40.538757 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65fb7c7-7dd4-4c53-9dae-54bcfb513208 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:21:40.539308 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65fb7c7-7dd4-4c53-9dae-54bcfb513208 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:40.541167 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65fb7c7-7dd4-4c53-9dae-54bcfb513208 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:40.556838 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1131/2263] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:21:40.561078 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd979294-537c-40f9-a805-d5aa41ae18d5 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:40.572769 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd979294-537c-40f9-a805-d5aa41ae18d5 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:40.580116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bee83b-2952-4fa9-b9d8-e159a4774c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:40.580116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bee83b-2952-4fa9-b9d8-e159a4774c5c admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:40.580116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bee83b-2952-4fa9-b9d8-e159a4774c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:40.580116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bee83b-2952-4fa9-b9d8-e159a4774c5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:40.580662 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bee83b-2952-4fa9-b9d8-e159a4774c5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:40.582255 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bee83b-2952-4fa9-b9d8-e159a4774c5c admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:40.585827 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:40.695028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1133/2264] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:40 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:21:40.698955 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65fb7c7-7dd4-4c53-9dae-54bcfb513208 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:40.711044 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65fb7c7-7dd4-4c53-9dae-54bcfb513208 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:40.810019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0cef93-1632-4893-8775-f76401797a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:40.811602 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cef93-1632-4893-8775-f76401797a51 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:40.812526 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cef93-1632-4893-8775-f76401797a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:40.812791 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cef93-1632-4893-8775-f76401797a51 admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:40.813721 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0cef93-1632-4893-8775-f76401797a51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:40.816576 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0cef93-1632-4893-8775-f76401797a51 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:40.926821 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1132/2265] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:40 2022] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:40.961429 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bee83b-2952-4fa9-b9d8-e159a4774c5c admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:40.965774 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bee83b-2952-4fa9-b9d8-e159a4774c5c admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:40.972843 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc748b57-a6c5-423a-ba1a-c60555c36cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:40.980177 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc748b57-a6c5-423a-ba1a-c60555c36cff admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:40.980177 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc748b57-a6c5-423a-ba1a-c60555c36cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:40.980177 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc748b57-a6c5-423a-ba1a-c60555c36cff admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:40.980177 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc748b57-a6c5-423a-ba1a-c60555c36cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:40.980177 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc748b57-a6c5-423a-ba1a-c60555c36cff admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:40.994276 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1134/2266] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:40.995789 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0cef93-1632-4893-8775-f76401797a51 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:41.012499 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0cef93-1632-4893-8775-f76401797a51 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:41.019820 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab8aae-1de3-44b6-ba00-c574f7993daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:41.019820 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab8aae-1de3-44b6-ba00-c574f7993daa admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:41.020233 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab8aae-1de3-44b6-ba00-c574f7993daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:41.020677 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab8aae-1de3-44b6-ba00-c574f7993daa admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:41.021708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab8aae-1de3-44b6-ba00-c574f7993daa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:41.023393 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab8aae-1de3-44b6-ba00-c574f7993daa admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:41.039084 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1133/2267] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:41.046057 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc748b57-a6c5-423a-ba1a-c60555c36cff admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:41.057646 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc748b57-a6c5-423a-ba1a-c60555c36cff admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:41.063094 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a45b9-1e58-4e80-b711-a857bccb1aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:41.064317 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a45b9-1e58-4e80-b711-a857bccb1aba admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:41.064765 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a45b9-1e58-4e80-b711-a857bccb1aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:41.065232 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a45b9-1e58-4e80-b711-a857bccb1aba admin admin] PATH_INFO: `/v3/projects/ff4fbd7758b44749b9c4b84c99a89bab/users/3293c8a3127d4d1385dfb9540ee2cd51/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:41.083947 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a45b9-1e58-4e80-b711-a857bccb1aba admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff4fbd7758b44749b9c4b84c99a89bab, user_id=3293c8a3127d4d1385dfb9540ee2cd51, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:41.086813 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a45b9-1e58-4e80-b711-a857bccb1aba admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:41.273344 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1135/2268] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:41 2022] PUT /identity/v3/projects/ff4fbd7758b44749b9c4b84c99a89bab/users/3293c8a3127d4d1385dfb9540ee2cd51/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:41.284058 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c7c68-0ee9-414d-9822-7c6dad2d0601 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:41.284468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c7c68-0ee9-414d-9822-7c6dad2d0601 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:41.284812 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c7c68-0ee9-414d-9822-7c6dad2d0601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:41.313891 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-5c2c7c68-0ee9-414d-9822-7c6dad2d0601 None None] MFA Rules not processed for user `3293c8a3127d4d1385dfb9540ee2cd51`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:41.315042 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-5c2c7c68-0ee9-414d-9822-7c6dad2d0601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:41.341895 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:41.387594 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1134/2269] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:21:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:41.392760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a45b9-1e58-4e80-b711-a857bccb1aba admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:41.495294 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a45b9-1e58-4e80-b711-a857bccb1aba admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:41.501471 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c5f24-6dd2-481b-8b91-b3745f4671e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:41.502074 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c5f24-6dd2-481b-8b91-b3745f4671e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:41.502357 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c5f24-6dd2-481b-8b91-b3745f4671e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:41.502692 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c5f24-6dd2-481b-8b91-b3745f4671e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:41.503433 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c5f24-6dd2-481b-8b91-b3745f4671e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:41.505457 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c5f24-6dd2-481b-8b91-b3745f4671e0 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:41.627347 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1136/2270] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:41 2022] POST /identity/v3/projects => generated 385 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:41.631339 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c7c68-0ee9-414d-9822-7c6dad2d0601 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:41.648787 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c7c68-0ee9-414d-9822-7c6dad2d0601 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:41.745191 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0d7b9-a76a-4741-9407-dfeab5b288f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:41.745739 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0d7b9-a76a-4741-9407-dfeab5b288f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:41.746171 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0d7b9-a76a-4741-9407-dfeab5b288f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:41.746449 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0d7b9-a76a-4741-9407-dfeab5b288f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:41.747486 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0d7b9-a76a-4741-9407-dfeab5b288f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:41.749177 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0d7b9-a76a-4741-9407-dfeab5b288f7 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:41.868919 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1135/2271] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:41 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:41.872368 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c5f24-6dd2-481b-8b91-b3745f4671e0 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:41.886299 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c5f24-6dd2-481b-8b91-b3745f4671e0 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:41.893363 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a983e-5202-4ec3-81f7-f2eb2ef279bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:41.895875 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a983e-5202-4ec3-81f7-f2eb2ef279bd admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:41.895875 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a983e-5202-4ec3-81f7-f2eb2ef279bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:41.895875 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a983e-5202-4ec3-81f7-f2eb2ef279bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:41.895875 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a983e-5202-4ec3-81f7-f2eb2ef279bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:41.897941 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a983e-5202-4ec3-81f7-f2eb2ef279bd admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:41.910991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1137/2272] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:41.915004 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0d7b9-a76a-4741-9407-dfeab5b288f7 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:41.929933 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0d7b9-a76a-4741-9407-dfeab5b288f7 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:41.936006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359d1c0-d5b5-48bc-a5e5-2ee87ab0ac75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:41.936006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359d1c0-d5b5-48bc-a5e5-2ee87ab0ac75 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:41.936006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359d1c0-d5b5-48bc-a5e5-2ee87ab0ac75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:41.936006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359d1c0-d5b5-48bc-a5e5-2ee87ab0ac75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:41.936658 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359d1c0-d5b5-48bc-a5e5-2ee87ab0ac75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:41.938330 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359d1c0-d5b5-48bc-a5e5-2ee87ab0ac75 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:41.949442 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1136/2273] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:41.954368 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a983e-5202-4ec3-81f7-f2eb2ef279bd admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:41.964689 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a983e-5202-4ec3-81f7-f2eb2ef279bd admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:41.970104 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e9317-aa79-4821-94e5-f9e5725010d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:41.971019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e9317-aa79-4821-94e5-f9e5725010d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:41.971307 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e9317-aa79-4821-94e5-f9e5725010d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:41.971592 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e9317-aa79-4821-94e5-f9e5725010d3 admin admin] PATH_INFO: `/v3/projects/12337c3097334e4280927a3a44188d6c/users/f25134b74f4649acb8e4c89bb6fb0eef/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:41.990917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e9317-aa79-4821-94e5-f9e5725010d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12337c3097334e4280927a3a44188d6c, user_id=f25134b74f4649acb8e4c89bb6fb0eef, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:41.995180 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e9317-aa79-4821-94e5-f9e5725010d3 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:42.068788 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1138/2274] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:41 2022] PUT /identity/v3/projects/12337c3097334e4280927a3a44188d6c/users/f25134b74f4649acb8e4c89bb6fb0eef/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:21:42.083415 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809c4f9-c401-45aa-be8b-4105ce9bff4b None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:42.084211 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809c4f9-c401-45aa-be8b-4105ce9bff4b None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:42.084578 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809c4f9-c401-45aa-be8b-4105ce9bff4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:42.135133 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-e809c4f9-c401-45aa-be8b-4105ce9bff4b None None] MFA Rules not processed for user `f25134b74f4649acb8e4c89bb6fb0eef`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:42.137471 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-e809c4f9-c401-45aa-be8b-4105ce9bff4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:42.263761 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1137/2275] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:21:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:42.268662 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e9317-aa79-4821-94e5-f9e5725010d3 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:42.373508 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e9317-aa79-4821-94e5-f9e5725010d3 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:42.380212 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab381798-63a7-4cea-92c8-c9ae24f0c2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:42.381407 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab381798-63a7-4cea-92c8-c9ae24f0c2a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:42.381921 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab381798-63a7-4cea-92c8-c9ae24f0c2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:42.382319 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab381798-63a7-4cea-92c8-c9ae24f0c2a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:42.383229 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab381798-63a7-4cea-92c8-c9ae24f0c2a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:42.386179 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab381798-63a7-4cea-92c8-c9ae24f0c2a8 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:42.393770 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:42.497106 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1139/2276] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:42 2022] POST /identity/v3/projects => generated 385 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:42.497966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809c4f9-c401-45aa-be8b-4105ce9bff4b None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:42.515499 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809c4f9-c401-45aa-be8b-4105ce9bff4b None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:42.563036 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:42.598697 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33c3c0-1eb3-42cc-9208-8016272cd3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:42.599659 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33c3c0-1eb3-42cc-9208-8016272cd3b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:42.600146 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33c3c0-1eb3-42cc-9208-8016272cd3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:42.600617 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33c3c0-1eb3-42cc-9208-8016272cd3b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:42.601755 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be33c3c0-1eb3-42cc-9208-8016272cd3b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:42.604326 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be33c3c0-1eb3-42cc-9208-8016272cd3b0 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:42.698576 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1138/2277] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:42 2022] POST /identity/v3/users => generated 299 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:21:42.700464 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab381798-63a7-4cea-92c8-c9ae24f0c2a8 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:42.714066 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab381798-63a7-4cea-92c8-c9ae24f0c2a8 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:42.719666 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3e3ee-d137-458e-a8a8-17bfe61527bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:42.720447 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3e3ee-d137-458e-a8a8-17bfe61527bb admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:42.720981 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3e3ee-d137-458e-a8a8-17bfe61527bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:42.721304 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3e3ee-d137-458e-a8a8-17bfe61527bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:42.722125 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3e3ee-d137-458e-a8a8-17bfe61527bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:42.723734 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3e3ee-d137-458e-a8a8-17bfe61527bb admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:42.740530 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1140/2278] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:42.744547 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33c3c0-1eb3-42cc-9208-8016272cd3b0 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:42.757209 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33c3c0-1eb3-42cc-9208-8016272cd3b0 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:42.762494 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961ccb7-c24e-4f2f-9aed-54f9f28fef93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:42.763393 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961ccb7-c24e-4f2f-9aed-54f9f28fef93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:42.763671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961ccb7-c24e-4f2f-9aed-54f9f28fef93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:42.763944 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961ccb7-c24e-4f2f-9aed-54f9f28fef93 admin admin] PATH_INFO: `/v3/projects/6192b18f31ab4f70b16fae21a2a0252c/users/d8fc98cf17d64dc8acb0e2bcafd46805/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:42.784044 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961ccb7-c24e-4f2f-9aed-54f9f28fef93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6192b18f31ab4f70b16fae21a2a0252c, user_id=d8fc98cf17d64dc8acb0e2bcafd46805, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:42.786935 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961ccb7-c24e-4f2f-9aed-54f9f28fef93 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:42.908250 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1139/2279] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:42 2022] PUT /identity/v3/projects/6192b18f31ab4f70b16fae21a2a0252c/users/d8fc98cf17d64dc8acb0e2bcafd46805/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:42.916941 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3e3ee-d137-458e-a8a8-17bfe61527bb admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:42.924366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3e3ee-d137-458e-a8a8-17bfe61527bb admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:43.039464 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3c27e-db9c-4ccd-868c-b95e56b79583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:43.040513 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3c27e-db9c-4ccd-868c-b95e56b79583 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:43.040805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3c27e-db9c-4ccd-868c-b95e56b79583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:43.041134 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3c27e-db9c-4ccd-868c-b95e56b79583 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:43.041887 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3c27e-db9c-4ccd-868c-b95e56b79583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:43.043905 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3c27e-db9c-4ccd-868c-b95e56b79583 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:43.056864 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1141/2280] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:21:43.060258 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961ccb7-c24e-4f2f-9aed-54f9f28fef93 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:43.072456 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961ccb7-c24e-4f2f-9aed-54f9f28fef93 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:43.077794 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2888d71-140d-4020-9be9-903c6199faaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:43.078947 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2888d71-140d-4020-9be9-903c6199faaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:43.079354 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2888d71-140d-4020-9be9-903c6199faaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:43.079855 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2888d71-140d-4020-9be9-903c6199faaf admin admin] PATH_INFO: `/v3/projects/6192b18f31ab4f70b16fae21a2a0252c/users/d8fc98cf17d64dc8acb0e2bcafd46805/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:43.082136 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2888d71-140d-4020-9be9-903c6199faaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6192b18f31ab4f70b16fae21a2a0252c, user_id=d8fc98cf17d64dc8acb0e2bcafd46805, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:43.085022 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2888d71-140d-4020-9be9-903c6199faaf admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:43.098338 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1140/2281] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:43 2022] PUT /identity/v3/projects/6192b18f31ab4f70b16fae21a2a0252c/users/d8fc98cf17d64dc8acb0e2bcafd46805/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:43.109371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c5127-6cf7-4ff6-8b39-b1d4e3d01438 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:43.109934 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c5127-6cf7-4ff6-8b39-b1d4e3d01438 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:43.109934 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c5127-6cf7-4ff6-8b39-b1d4e3d01438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:43.141513 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-ea0c5127-6cf7-4ff6-8b39-b1d4e3d01438 None None] MFA Rules not processed for user `d8fc98cf17d64dc8acb0e2bcafd46805`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:43.143042 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-ea0c5127-6cf7-4ff6-8b39-b1d4e3d01438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:43.240703 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1142/2282] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:21:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:43.261297 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2888d71-140d-4020-9be9-903c6199faaf admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:43.263077 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-a2888d71-140d-4020-9be9-903c6199faaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:43.334843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2888d71-140d-4020-9be9-903c6199faaf admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:43.339233 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf7fcd-4165-4930-9c09-162cd0884dec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:43.341992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf7fcd-4165-4930-9c09-162cd0884dec service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:43.341992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf7fcd-4165-4930-9c09-162cd0884dec service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:43.341992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf7fcd-4165-4930-9c09-162cd0884dec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:43.424428 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf7fcd-4165-4930-9c09-162cd0884dec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:43.427618 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf7fcd-4165-4930-9c09-162cd0884dec service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:43.441453 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1141/2283] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:46.728841 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c5127-6cf7-4ff6-8b39-b1d4e3d01438 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:46.739361 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c5127-6cf7-4ff6-8b39-b1d4e3d01438 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:46.745326 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae5e9d-0f2b-494a-9c40-8d26ad4d2060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:46.745993 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae5e9d-0f2b-494a-9c40-8d26ad4d2060 service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:46.746272 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae5e9d-0f2b-494a-9c40-8d26ad4d2060 service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:46.746543 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae5e9d-0f2b-494a-9c40-8d26ad4d2060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:46.836577 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:46.842464 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae5e9d-0f2b-494a-9c40-8d26ad4d2060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:46.843796 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae5e9d-0f2b-494a-9c40-8d26ad4d2060 service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:46.856764 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1143/2284] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:48.790546 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf7fcd-4165-4930-9c09-162cd0884dec service cinder] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:48.800969 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf7fcd-4165-4930-9c09-162cd0884dec service cinder] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:48.807059 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b93434-dd74-4f9a-a977-deb7126de973 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:48.807865 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b93434-dd74-4f9a-a977-deb7126de973 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:48.808217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b93434-dd74-4f9a-a977-deb7126de973 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:48.808577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b93434-dd74-4f9a-a977-deb7126de973 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:48.822103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b93434-dd74-4f9a-a977-deb7126de973 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:48.823708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b93434-dd74-4f9a-a977-deb7126de973 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:48.835943 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1142/2285] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:48 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:52.887125 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db3e4e-c83e-4e5b-bead-e2e711c09e02 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:52.887695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db3e4e-c83e-4e5b-bead-e2e711c09e02 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:52.887794 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db3e4e-c83e-4e5b-bead-e2e711c09e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:52.906369 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-e5db3e4e-c83e-4e5b-bead-e2e711c09e02 None None] MFA Rules not processed for user `7b4d3b1fe8064cc592d89e7bab91bace`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:52.907686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-e5db3e4e-c83e-4e5b-bead-e2e711c09e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:52.976566 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1144/2286] 10.222.0.46 () {58 vars in 967 bytes} [Wed Jun 22 10:21:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:52.989914 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b93434-dd74-4f9a-a977-deb7126de973 service cinder] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:52.991479 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-e7b93434-dd74-4f9a-a977-deb7126de973 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:53.029271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:53.065316 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b93434-dd74-4f9a-a977-deb7126de973 service cinder] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:53.070407 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ee5d4-3929-474e-aff4-c9502635ea19 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c724063ce51470ca09c5c5ab231fd9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:53.071054 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ee5d4-3929-474e-aff4-c9502635ea19 service swift] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:53.071335 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ee5d4-3929-474e-aff4-c9502635ea19 service swift] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:53.071614 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ee5d4-3929-474e-aff4-c9502635ea19 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:53.079858 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ee5d4-3929-474e-aff4-c9502635ea19 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:53.083857 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ee5d4-3929-474e-aff4-c9502635ea19 service swift] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:53.090019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1143/2287] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 22 10:21:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 10:21:54.761542 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db3e4e-c83e-4e5b-bead-e2e711c09e02 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:54.834868 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db3e4e-c83e-4e5b-bead-e2e711c09e02 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:54.839626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af9534-d0b5-435f-8482-046f1e3be4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:54.840563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af9534-d0b5-435f-8482-046f1e3be4fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:54.840891 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af9534-d0b5-435f-8482-046f1e3be4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:54.841174 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af9534-d0b5-435f-8482-046f1e3be4fc admin admin] PATH_INFO: `/v3/users/3293c8a3127d4d1385dfb9540ee2cd51` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:54.845884 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af9534-d0b5-435f-8482-046f1e3be4fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3293c8a3127d4d1385dfb9540ee2cd51)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:54.845884 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af9534-d0b5-435f-8482-046f1e3be4fc admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:55.089737 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-71af9534-d0b5-435f-8482-046f1e3be4fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3293c8a3127d4d1385dfb9540ee2cd51'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:55.090356 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-71af9534-d0b5-435f-8482-046f1e3be4fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3293c8a3127d4d1385dfb9540ee2cd51'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:55.205201 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-71af9534-d0b5-435f-8482-046f1e3be4fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3293c8a3127d4d1385dfb9540ee2cd51'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:55.218073 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-71af9534-d0b5-435f-8482-046f1e3be4fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3293c8a3127d4d1385dfb9540ee2cd51'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:55.226515 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-71af9534-d0b5-435f-8482-046f1e3be4fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3293c8a3127d4d1385dfb9540ee2cd51'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:55.232728 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1145/2288] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:54 2022] DELETE /identity/v3/users/3293c8a3127d4d1385dfb9540ee2cd51 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:55.237377 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6f0bf-b1df-484d-bc0c-55ae1d06aa43 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:55.237870 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6f0bf-b1df-484d-bc0c-55ae1d06aa43 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:55.237986 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6f0bf-b1df-484d-bc0c-55ae1d06aa43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:55.255529 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-def6f0bf-b1df-484d-bc0c-55ae1d06aa43 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:55.256730 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-def6f0bf-b1df-484d-bc0c-55ae1d06aa43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:55.316743 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1144/2289] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:55.327076 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af9534-d0b5-435f-8482-046f1e3be4fc admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:55.329231 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-71af9534-d0b5-435f-8482-046f1e3be4fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:55.350173 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:55.386881 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af9534-d0b5-435f-8482-046f1e3be4fc admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:55.393100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797b7fa-1f45-4b20-8403-b8f5881a3aca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:55.394087 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797b7fa-1f45-4b20-8403-b8f5881a3aca service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:55.394567 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797b7fa-1f45-4b20-8403-b8f5881a3aca service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:55.395025 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797b7fa-1f45-4b20-8403-b8f5881a3aca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:55.406608 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797b7fa-1f45-4b20-8403-b8f5881a3aca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:55.408035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797b7fa-1f45-4b20-8403-b8f5881a3aca service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:55.417867 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1146/2290] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:55.918338 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6f0bf-b1df-484d-bc0c-55ae1d06aa43 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:55.919830 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-def6f0bf-b1df-484d-bc0c-55ae1d06aa43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:55.931947 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6f0bf-b1df-484d-bc0c-55ae1d06aa43 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:55.936666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f18a28-1c39-485c-b290-b598c3b7869b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:55.937732 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f18a28-1c39-485c-b290-b598c3b7869b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:55.943732 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f18a28-1c39-485c-b290-b598c3b7869b admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:55.943732 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f18a28-1c39-485c-b290-b598c3b7869b admin admin] PATH_INFO: `/v3/projects/ff4fbd7758b44749b9c4b84c99a89bab` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:55.943732 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f18a28-1c39-485c-b290-b598c3b7869b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff4fbd7758b44749b9c4b84c99a89bab)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:55.943732 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f18a28-1c39-485c-b290-b598c3b7869b admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:56.073667 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-00f18a28-1c39-485c-b290-b598c3b7869b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff4fbd7758b44749b9c4b84c99a89bab', 'request_id': 'req-00f18a28-1c39-485c-b290-b598c3b7869b'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:56.081438 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-00f18a28-1c39-485c-b290-b598c3b7869b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff4fbd7758b44749b9c4b84c99a89bab', 'request_id': 'req-00f18a28-1c39-485c-b290-b598c3b7869b'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:56.156292 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-00f18a28-1c39-485c-b290-b598c3b7869b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff4fbd7758b44749b9c4b84c99a89bab', 'request_id': 'req-00f18a28-1c39-485c-b290-b598c3b7869b'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:56.169720 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-00f18a28-1c39-485c-b290-b598c3b7869b admin admin] The token cache is being invalidate because project ff4fbd7758b44749b9c4b84c99a89bab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:56.170116 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-00f18a28-1c39-485c-b290-b598c3b7869b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:56.170857 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-00f18a28-1c39-485c-b290-b598c3b7869b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:56.172533 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1145/2291] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:55 2022] DELETE /identity/v3/projects/ff4fbd7758b44749b9c4b84c99a89bab => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:56.176879 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797b7fa-1f45-4b20-8403-b8f5881a3aca service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:56.187187 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797b7fa-1f45-4b20-8403-b8f5881a3aca service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:56.247890 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4b6b6-d507-42de-a2af-808a298bc627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:56.248780 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4b6b6-d507-42de-a2af-808a298bc627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:56.249097 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4b6b6-d507-42de-a2af-808a298bc627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:56.249373 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4b6b6-d507-42de-a2af-808a298bc627 admin admin] PATH_INFO: `/v3/users/f25134b74f4649acb8e4c89bb6fb0eef` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:56.251137 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c4b6b6-d507-42de-a2af-808a298bc627 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f25134b74f4649acb8e4c89bb6fb0eef)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:56.253123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c4b6b6-d507-42de-a2af-808a298bc627 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:56.495317 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-77c4b6b6-d507-42de-a2af-808a298bc627 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f25134b74f4649acb8e4c89bb6fb0eef'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:56.495317 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-77c4b6b6-d507-42de-a2af-808a298bc627 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f25134b74f4649acb8e4c89bb6fb0eef'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:56.630546 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-77c4b6b6-d507-42de-a2af-808a298bc627 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f25134b74f4649acb8e4c89bb6fb0eef'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:56.647610 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-77c4b6b6-d507-42de-a2af-808a298bc627 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f25134b74f4649acb8e4c89bb6fb0eef'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:56.655113 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-77c4b6b6-d507-42de-a2af-808a298bc627 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f25134b74f4649acb8e4c89bb6fb0eef'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:56.667029 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1147/2292] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:56 2022] DELETE /identity/v3/users/f25134b74f4649acb8e4c89bb6fb0eef => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:21:56.942199 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f18a28-1c39-485c-b290-b598c3b7869b admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:56.943926 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-00f18a28-1c39-485c-b290-b598c3b7869b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:56.964790 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f18a28-1c39-485c-b290-b598c3b7869b admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:57.007313 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:57.026729 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce10160-ddb9-4336-abae-e0290a2cfc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:57.027894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce10160-ddb9-4336-abae-e0290a2cfc6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:57.028185 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce10160-ddb9-4336-abae-e0290a2cfc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:57.028461 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce10160-ddb9-4336-abae-e0290a2cfc6a admin admin] PATH_INFO: `/v3/users/c2e02737f0cc423d95db9c3324f7215e` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:57.029740 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce10160-ddb9-4336-abae-e0290a2cfc6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2e02737f0cc423d95db9c3324f7215e)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:57.035694 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce10160-ddb9-4336-abae-e0290a2cfc6a admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:57.210854 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4b6b6-d507-42de-a2af-808a298bc627 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:57.211311 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-77c4b6b6-d507-42de-a2af-808a298bc627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:57.224172 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4b6b6-d507-42de-a2af-808a298bc627 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:57.228930 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1ae80-62b2-4a84-ad03-d1605a535c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:57.229820 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1ae80-62b2-4a84-ad03-d1605a535c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:57.230104 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1ae80-62b2-4a84-ad03-d1605a535c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:57.230383 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1ae80-62b2-4a84-ad03-d1605a535c37 admin admin] PATH_INFO: `/v3/projects/12337c3097334e4280927a3a44188d6c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:57.231617 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1ae80-62b2-4a84-ad03-d1605a535c37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12337c3097334e4280927a3a44188d6c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:57.233597 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1ae80-62b2-4a84-ad03-d1605a535c37 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:57.260437 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-3ce10160-ddb9-4336-abae-e0290a2cfc6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2e02737f0cc423d95db9c3324f7215e'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:57.274265 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-3ce10160-ddb9-4336-abae-e0290a2cfc6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2e02737f0cc423d95db9c3324f7215e'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:57.344724 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:57.354001 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9be1ae80-62b2-4a84-ad03-d1605a535c37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12337c3097334e4280927a3a44188d6c', 'request_id': 'req-9be1ae80-62b2-4a84-ad03-d1605a535c37'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:57.359920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9be1ae80-62b2-4a84-ad03-d1605a535c37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12337c3097334e4280927a3a44188d6c', 'request_id': 'req-9be1ae80-62b2-4a84-ad03-d1605a535c37'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:57.382124 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-3ce10160-ddb9-4336-abae-e0290a2cfc6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2e02737f0cc423d95db9c3324f7215e'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:57.384195 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-3ce10160-ddb9-4336-abae-e0290a2cfc6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2e02737f0cc423d95db9c3324f7215e'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:57.392497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-3ce10160-ddb9-4336-abae-e0290a2cfc6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2e02737f0cc423d95db9c3324f7215e'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:57.398485 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1146/2293] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:56 2022] DELETE /identity/v3/users/c2e02737f0cc423d95db9c3324f7215e => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:57.456269 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9be1ae80-62b2-4a84-ad03-d1605a535c37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12337c3097334e4280927a3a44188d6c', 'request_id': 'req-9be1ae80-62b2-4a84-ad03-d1605a535c37'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:57.468251 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9be1ae80-62b2-4a84-ad03-d1605a535c37 admin admin] The token cache is being invalidate because project 12337c3097334e4280927a3a44188d6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:57.468547 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9be1ae80-62b2-4a84-ad03-d1605a535c37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:57.469367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9be1ae80-62b2-4a84-ad03-d1605a535c37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:57.471123 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1148/2294] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:57 2022] DELETE /identity/v3/projects/12337c3097334e4280927a3a44188d6c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:21:57.475063 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce10160-ddb9-4336-abae-e0290a2cfc6a admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:57.476490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-3ce10160-ddb9-4336-abae-e0290a2cfc6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:57.541942 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce10160-ddb9-4336-abae-e0290a2cfc6a admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:57.548098 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ba387-bac2-4bdb-9de6-fd3f529b1fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:57.549013 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ba387-bac2-4bdb-9de6-fd3f529b1fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:57.549292 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ba387-bac2-4bdb-9de6-fd3f529b1fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:57.549574 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ba387-bac2-4bdb-9de6-fd3f529b1fd4 admin admin] PATH_INFO: `/v3/users/d8fc98cf17d64dc8acb0e2bcafd46805` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:57.550789 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ba387-bac2-4bdb-9de6-fd3f529b1fd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8fc98cf17d64dc8acb0e2bcafd46805)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:57.552736 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ba387-bac2-4bdb-9de6-fd3f529b1fd4 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:57.697220 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1ae80-62b2-4a84-ad03-d1605a535c37 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:57.699936 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-9be1ae80-62b2-4a84-ad03-d1605a535c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:57.770614 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1ae80-62b2-4a84-ad03-d1605a535c37 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:57.775200 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-037ba387-bac2-4bdb-9de6-fd3f529b1fd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8fc98cf17d64dc8acb0e2bcafd46805'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:57.775427 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ae0eb-3568-4cf6-91a3-8c7b1f04ac3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:57.776230 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ae0eb-3568-4cf6-91a3-8c7b1f04ac3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:57.776525 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ae0eb-3568-4cf6-91a3-8c7b1f04ac3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:57.776804 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ae0eb-3568-4cf6-91a3-8c7b1f04ac3e admin admin] PATH_INFO: `/v3/projects/9e06f1a9b667414b8d663033c7053b76` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:57.778497 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ae0eb-3568-4cf6-91a3-8c7b1f04ac3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e06f1a9b667414b8d663033c7053b76)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:57.780810 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ae0eb-3568-4cf6-91a3-8c7b1f04ac3e admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:57.789121 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:57.797680 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-037ba387-bac2-4bdb-9de6-fd3f529b1fd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8fc98cf17d64dc8acb0e2bcafd46805'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:57.939503 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-037ba387-bac2-4bdb-9de6-fd3f529b1fd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8fc98cf17d64dc8acb0e2bcafd46805'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:57.940129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-037ba387-bac2-4bdb-9de6-fd3f529b1fd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8fc98cf17d64dc8acb0e2bcafd46805'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:57.947804 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-037ba387-bac2-4bdb-9de6-fd3f529b1fd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8fc98cf17d64dc8acb0e2bcafd46805'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:57.954983 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1147/2295] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:57 2022] DELETE /identity/v3/users/d8fc98cf17d64dc8acb0e2bcafd46805 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:21:57.963915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-350ae0eb-3568-4cf6-91a3-8c7b1f04ac3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e06f1a9b667414b8d663033c7053b76', 'request_id': 'req-350ae0eb-3568-4cf6-91a3-8c7b1f04ac3e'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:57.966165 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-350ae0eb-3568-4cf6-91a3-8c7b1f04ac3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e06f1a9b667414b8d663033c7053b76', 'request_id': 'req-350ae0eb-3568-4cf6-91a3-8c7b1f04ac3e'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:58.070375 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-350ae0eb-3568-4cf6-91a3-8c7b1f04ac3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e06f1a9b667414b8d663033c7053b76', 'request_id': 'req-350ae0eb-3568-4cf6-91a3-8c7b1f04ac3e'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:58.082626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-350ae0eb-3568-4cf6-91a3-8c7b1f04ac3e admin admin] The token cache is being invalidate because project 9e06f1a9b667414b8d663033c7053b76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:58.088595 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-350ae0eb-3568-4cf6-91a3-8c7b1f04ac3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:58.088595 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-350ae0eb-3568-4cf6-91a3-8c7b1f04ac3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:58.088595 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1149/2296] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:57 2022] DELETE /identity/v3/projects/9e06f1a9b667414b8d663033c7053b76 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:58.090931 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237139a-81f4-4403-bd37-c1259901207c None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:58.091227 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237139a-81f4-4403-bd37-c1259901207c None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:58.091548 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237139a-81f4-4403-bd37-c1259901207c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:58.109995 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-5237139a-81f4-4403-bd37-c1259901207c None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:58.111202 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-5237139a-81f4-4403-bd37-c1259901207c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:58.169977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1148/2297] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:21:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:58.178578 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3f86c-cfca-4344-9117-c3a6fddffe94 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:58.178874 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3f86c-cfca-4344-9117-c3a6fddffe94 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:58.179154 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3f86c-cfca-4344-9117-c3a6fddffe94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:58.199495 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-40d3f86c-cfca-4344-9117-c3a6fddffe94 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:58.201399 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-40d3f86c-cfca-4344-9117-c3a6fddffe94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:58.215172 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237139a-81f4-4403-bd37-c1259901207c None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:58.215573 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1150/2298] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:21:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:58.225479 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237139a-81f4-4403-bd37-c1259901207c None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:58.230519 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bcc867-deab-47f3-b0a0-fd5177201eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:58.231192 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bcc867-deab-47f3-b0a0-fd5177201eea admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:58.231524 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bcc867-deab-47f3-b0a0-fd5177201eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:58.231797 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bcc867-deab-47f3-b0a0-fd5177201eea admin admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:58.232540 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bcc867-deab-47f3-b0a0-fd5177201eea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:21:58.232928 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bcc867-deab-47f3-b0a0-fd5177201eea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:58.234496 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bcc867-deab-47f3-b0a0-fd5177201eea admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:58.249984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1149/2299] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:21:58.252175 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3f86c-cfca-4344-9117-c3a6fddffe94 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:58.262576 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3f86c-cfca-4344-9117-c3a6fddffe94 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:58.269615 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc4e3e-27f5-43ee-8188-61542ad6f6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:58.269615 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc4e3e-27f5-43ee-8188-61542ad6f6ef admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:58.269615 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc4e3e-27f5-43ee-8188-61542ad6f6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:58.269615 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc4e3e-27f5-43ee-8188-61542ad6f6ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:58.269988 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc4e3e-27f5-43ee-8188-61542ad6f6ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:58.272086 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc4e3e-27f5-43ee-8188-61542ad6f6ef admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:58.358210 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1151/2300] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:58 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:58.363354 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bcc867-deab-47f3-b0a0-fd5177201eea admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:58.373777 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bcc867-deab-47f3-b0a0-fd5177201eea admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:58.434645 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c85a16-7283-4ac5-be80-288923656b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:58.435593 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c85a16-7283-4ac5-be80-288923656b1f admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:58.435883 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c85a16-7283-4ac5-be80-288923656b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:58.436165 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c85a16-7283-4ac5-be80-288923656b1f admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:58.436887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c85a16-7283-4ac5-be80-288923656b1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:58.438887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c85a16-7283-4ac5-be80-288923656b1f admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:58.463525 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc4e3e-27f5-43ee-8188-61542ad6f6ef admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:58.465339 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-bcdc4e3e-27f5-43ee-8188-61542ad6f6ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:58.478542 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc4e3e-27f5-43ee-8188-61542ad6f6ef admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:58.483276 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb281f1-e390-4cf3-b76a-789c03286b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:58.484141 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb281f1-e390-4cf3-b76a-789c03286b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:58.484429 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb281f1-e390-4cf3-b76a-789c03286b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:58.484705 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb281f1-e390-4cf3-b76a-789c03286b0c admin admin] PATH_INFO: `/v3/projects/6192b18f31ab4f70b16fae21a2a0252c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:58.485964 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb281f1-e390-4cf3-b76a-789c03286b0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6192b18f31ab4f70b16fae21a2a0252c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:58.487875 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb281f1-e390-4cf3-b76a-789c03286b0c admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:58.510748 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:58.537205 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1150/2301] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:58 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:58.538282 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c85a16-7283-4ac5-be80-288923656b1f admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:58.549143 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c85a16-7283-4ac5-be80-288923656b1f admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:58.553987 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3167494-7c13-445a-86fe-ae7cdd4faa74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:58.554653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3167494-7c13-445a-86fe-ae7cdd4faa74 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:58.554953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3167494-7c13-445a-86fe-ae7cdd4faa74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:58.555231 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3167494-7c13-445a-86fe-ae7cdd4faa74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:58.555963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3167494-7c13-445a-86fe-ae7cdd4faa74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:58.557618 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3167494-7c13-445a-86fe-ae7cdd4faa74 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:58.567946 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1151/2302] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:21:58.571813 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3167494-7c13-445a-86fe-ae7cdd4faa74 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:58.582130 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3167494-7c13-445a-86fe-ae7cdd4faa74 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:58.595593 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-0fb281f1-e390-4cf3-b76a-789c03286b0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6192b18f31ab4f70b16fae21a2a0252c', 'request_id': 'req-0fb281f1-e390-4cf3-b76a-789c03286b0c'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:58.601488 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-0fb281f1-e390-4cf3-b76a-789c03286b0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6192b18f31ab4f70b16fae21a2a0252c', 'request_id': 'req-0fb281f1-e390-4cf3-b76a-789c03286b0c'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:58.629772 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:58.642501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7943eb-6397-4701-bd26-7cf6b51584e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:58.643182 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7943eb-6397-4701-bd26-7cf6b51584e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:58.643461 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7943eb-6397-4701-bd26-7cf6b51584e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:58.643740 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7943eb-6397-4701-bd26-7cf6b51584e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:58.644480 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7943eb-6397-4701-bd26-7cf6b51584e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:58.646168 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7943eb-6397-4701-bd26-7cf6b51584e8 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:58.656997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1152/2303] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:21:58.661423 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7943eb-6397-4701-bd26-7cf6b51584e8 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:58.671339 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7943eb-6397-4701-bd26-7cf6b51584e8 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:58.676796 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f68632-bbb9-4634-8660-abdd7a1824a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:58.677753 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f68632-bbb9-4634-8660-abdd7a1824a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:58.678062 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f68632-bbb9-4634-8660-abdd7a1824a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:58.678347 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f68632-bbb9-4634-8660-abdd7a1824a8 admin admin] PATH_INFO: `/v3/projects/7f19b0162e344cb58aa6fd590ada3594/users/84a54a395ca6445b940aedf8ae16a091/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:58.693606 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f68632-bbb9-4634-8660-abdd7a1824a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f19b0162e344cb58aa6fd590ada3594, user_id=84a54a395ca6445b940aedf8ae16a091, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:58.699301 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f68632-bbb9-4634-8660-abdd7a1824a8 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:58.733615 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-0fb281f1-e390-4cf3-b76a-789c03286b0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6192b18f31ab4f70b16fae21a2a0252c', 'request_id': 'req-0fb281f1-e390-4cf3-b76a-789c03286b0c'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:58.740993 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-0fb281f1-e390-4cf3-b76a-789c03286b0c admin admin] The token cache is being invalidate because project 6192b18f31ab4f70b16fae21a2a0252c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:58.741283 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-0fb281f1-e390-4cf3-b76a-789c03286b0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:58.742056 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-0fb281f1-e390-4cf3-b76a-789c03286b0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:58.743891 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1152/2304] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:58 2022] DELETE /identity/v3/projects/6192b18f31ab4f70b16fae21a2a0252c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:21:58.866713 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1153/2305] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:58 2022] PUT /identity/v3/projects/7f19b0162e344cb58aa6fd590ada3594/users/84a54a395ca6445b940aedf8ae16a091/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:21:58.878395 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b3981-90a5-4b71-a136-e085fd7071a4 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:58.878703 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b3981-90a5-4b71-a136-e085fd7071a4 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:58.878987 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b3981-90a5-4b71-a136-e085fd7071a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:58.909978 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-ee8b3981-90a5-4b71-a136-e085fd7071a4 None None] MFA Rules not processed for user `84a54a395ca6445b940aedf8ae16a091`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:58.911470 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-ee8b3981-90a5-4b71-a136-e085fd7071a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:58.977164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1153/2306] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:21:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:58.989021 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f68632-bbb9-4634-8660-abdd7a1824a8 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:58.990695 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-e7f68632-bbb9-4634-8660-abdd7a1824a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:59.047308 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f68632-bbb9-4634-8660-abdd7a1824a8 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:59.051062 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce702ab4-c609-4363-9b3d-16cdbe565fd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:59.051711 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce702ab4-c609-4363-9b3d-16cdbe565fd3 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:59.051991 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce702ab4-c609-4363-9b3d-16cdbe565fd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:59.052266 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce702ab4-c609-4363-9b3d-16cdbe565fd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:59.060700 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce702ab4-c609-4363-9b3d-16cdbe565fd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:59.062182 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce702ab4-c609-4363-9b3d-16cdbe565fd3 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:59.071033 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1154/2307] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:00.817905 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b3981-90a5-4b71-a136-e085fd7071a4 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:00.819335 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-ee8b3981-90a5-4b71-a136-e085fd7071a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:00.884322 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b3981-90a5-4b71-a136-e085fd7071a4 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:00.889038 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee0c39-c435-405c-bbce-cb373d5550bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:00.889915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee0c39-c435-405c-bbce-cb373d5550bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:00.890201 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee0c39-c435-405c-bbce-cb373d5550bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:00.890633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee0c39-c435-405c-bbce-cb373d5550bb admin admin] PATH_INFO: `/v3/users/70d76e402e784a8683493fb718f29d57` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:00.892364 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee0c39-c435-405c-bbce-cb373d5550bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=70d76e402e784a8683493fb718f29d57)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:00.894316 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee0c39-c435-405c-bbce-cb373d5550bb admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:01.156643 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:01.162916 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-6eee0c39-c435-405c-bbce-cb373d5550bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70d76e402e784a8683493fb718f29d57'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:01.163585 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-6eee0c39-c435-405c-bbce-cb373d5550bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70d76e402e784a8683493fb718f29d57'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:01.332179 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-6eee0c39-c435-405c-bbce-cb373d5550bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70d76e402e784a8683493fb718f29d57'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:01.347579 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-6eee0c39-c435-405c-bbce-cb373d5550bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70d76e402e784a8683493fb718f29d57'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:01.354548 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-6eee0c39-c435-405c-bbce-cb373d5550bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70d76e402e784a8683493fb718f29d57'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:01.360856 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1154/2308] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:22:00 2022] DELETE /identity/v3/users/70d76e402e784a8683493fb718f29d57 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:01.365706 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b531ae-7c4e-4933-a6fe-7ac64a7bfadd None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:01.366209 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b531ae-7c4e-4933-a6fe-7ac64a7bfadd None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:01.366326 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b531ae-7c4e-4933-a6fe-7ac64a7bfadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:01.383281 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-37b531ae-7c4e-4933-a6fe-7ac64a7bfadd None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:01.384515 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-37b531ae-7c4e-4933-a6fe-7ac64a7bfadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:01.443467 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1155/2309] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:01.453731 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee0c39-c435-405c-bbce-cb373d5550bb admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:01.455296 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-6eee0c39-c435-405c-bbce-cb373d5550bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:01.511717 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee0c39-c435-405c-bbce-cb373d5550bb admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:01.515275 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a6c7c-a350-48d4-8631-e9e7ffaf582e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:01.516466 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a6c7c-a350-48d4-8631-e9e7ffaf582e service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:01.516750 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a6c7c-a350-48d4-8631-e9e7ffaf582e service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:01.517050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a6c7c-a350-48d4-8631-e9e7ffaf582e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:01.526003 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a6c7c-a350-48d4-8631-e9e7ffaf582e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:01.527448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a6c7c-a350-48d4-8631-e9e7ffaf582e service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:01.537204 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1155/2310] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:02.180768 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b531ae-7c4e-4933-a6fe-7ac64a7bfadd None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:02.180768 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-37b531ae-7c4e-4933-a6fe-7ac64a7bfadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:02.191902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b531ae-7c4e-4933-a6fe-7ac64a7bfadd None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:02.196574 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b80451-9f49-48f3-88ac-bb8ba5785575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:02.197543 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b80451-9f49-48f3-88ac-bb8ba5785575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:02.197848 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b80451-9f49-48f3-88ac-bb8ba5785575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:02.198130 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b80451-9f49-48f3-88ac-bb8ba5785575 admin admin] PATH_INFO: `/v3/projects/54ed302299834aff9fa003fb708630a1` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:02.199418 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b80451-9f49-48f3-88ac-bb8ba5785575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54ed302299834aff9fa003fb708630a1)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:02.201422 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b80451-9f49-48f3-88ac-bb8ba5785575 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:02.387510 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-39b80451-9f49-48f3-88ac-bb8ba5785575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54ed302299834aff9fa003fb708630a1', 'request_id': 'req-39b80451-9f49-48f3-88ac-bb8ba5785575'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:02.393988 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-39b80451-9f49-48f3-88ac-bb8ba5785575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54ed302299834aff9fa003fb708630a1', 'request_id': 'req-39b80451-9f49-48f3-88ac-bb8ba5785575'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:02.396670 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:02.514137 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-39b80451-9f49-48f3-88ac-bb8ba5785575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54ed302299834aff9fa003fb708630a1', 'request_id': 'req-39b80451-9f49-48f3-88ac-bb8ba5785575'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:02.525303 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-39b80451-9f49-48f3-88ac-bb8ba5785575 admin admin] The token cache is being invalidate because project 54ed302299834aff9fa003fb708630a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:22:02.525596 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-39b80451-9f49-48f3-88ac-bb8ba5785575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:02.526309 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-39b80451-9f49-48f3-88ac-bb8ba5785575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:02.527809 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1156/2311] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:22:02 2022] DELETE /identity/v3/projects/54ed302299834aff9fa003fb708630a1 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:02.533484 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f850b3-2667-412c-96a0-310760f1e0e1 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:02.533973 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f850b3-2667-412c-96a0-310760f1e0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:02.534070 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f850b3-2667-412c-96a0-310760f1e0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:02.552201 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-20f850b3-2667-412c-96a0-310760f1e0e1 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:02.553424 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-20f850b3-2667-412c-96a0-310760f1e0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:02.612649 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1156/2312] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:02.620652 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad124af6-e049-4fc0-a001-b9a5ac8248a4 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:02.620989 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad124af6-e049-4fc0-a001-b9a5ac8248a4 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:02.621272 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad124af6-e049-4fc0-a001-b9a5ac8248a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:02.639702 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-ad124af6-e049-4fc0-a001-b9a5ac8248a4 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:02.641442 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-ad124af6-e049-4fc0-a001-b9a5ac8248a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:02.649868 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1157/2313] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:02.654586 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f850b3-2667-412c-96a0-310760f1e0e1 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:02.655626 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad124af6-e049-4fc0-a001-b9a5ac8248a4 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:02.657544 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-ad124af6-e049-4fc0-a001-b9a5ac8248a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:02.665120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f850b3-2667-412c-96a0-310760f1e0e1 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:02.669376 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad124af6-e049-4fc0-a001-b9a5ac8248a4 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:02.669959 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb94522-939e-4c8e-968d-8fd03d45ff8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:02.670631 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb94522-939e-4c8e-968d-8fd03d45ff8c admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:02.670913 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb94522-939e-4c8e-968d-8fd03d45ff8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:02.671189 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb94522-939e-4c8e-968d-8fd03d45ff8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:02.672051 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb94522-939e-4c8e-968d-8fd03d45ff8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:22:02.672258 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb94522-939e-4c8e-968d-8fd03d45ff8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:02.673929 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb94522-939e-4c8e-968d-8fd03d45ff8c admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:02.675058 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ac96c-36f1-48dc-9241-161da5f567b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:02.675931 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ac96c-36f1-48dc-9241-161da5f567b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:02.676215 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ac96c-36f1-48dc-9241-161da5f567b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:02.676491 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ac96c-36f1-48dc-9241-161da5f567b5 admin admin] PATH_INFO: `/v3/users/84a54a395ca6445b940aedf8ae16a091` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:02.677940 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ac96c-36f1-48dc-9241-161da5f567b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84a54a395ca6445b940aedf8ae16a091)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:02.682206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ac96c-36f1-48dc-9241-161da5f567b5 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:02.687603 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1157/2314] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:22:02.702280 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb94522-939e-4c8e-968d-8fd03d45ff8c admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:02.712762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb94522-939e-4c8e-968d-8fd03d45ff8c admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:02.717499 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df2175-4173-4038-ba85-026c2db07285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:02.718155 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df2175-4173-4038-ba85-026c2db07285 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:02.718440 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df2175-4173-4038-ba85-026c2db07285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:02.718719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df2175-4173-4038-ba85-026c2db07285 admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:02.720014 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df2175-4173-4038-ba85-026c2db07285 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:02.721957 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df2175-4173-4038-ba85-026c2db07285 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:02.861451 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1158/2315] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:02 2022] POST /identity/v3/projects => generated 375 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:22:02.865373 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df2175-4173-4038-ba85-026c2db07285 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:02.893073 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:02.927902 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df2175-4173-4038-ba85-026c2db07285 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:02.932657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef30fd-76d6-4a7f-b316-a8ebd29e02ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:02.933358 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef30fd-76d6-4a7f-b316-a8ebd29e02ff admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:02.933648 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef30fd-76d6-4a7f-b316-a8ebd29e02ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:02.933932 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef30fd-76d6-4a7f-b316-a8ebd29e02ff admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:02.934620 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef30fd-76d6-4a7f-b316-a8ebd29e02ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:02.936548 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef30fd-76d6-4a7f-b316-a8ebd29e02ff admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:03.065710 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-484ac96c-36f1-48dc-9241-161da5f567b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84a54a395ca6445b940aedf8ae16a091'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:03.077552 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-484ac96c-36f1-48dc-9241-161da5f567b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84a54a395ca6445b940aedf8ae16a091'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:03.100518 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1159/2316] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:02 2022] POST /identity/v3/users => generated 288 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:22:03.113972 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef30fd-76d6-4a7f-b316-a8ebd29e02ff admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:03.114130 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef30fd-76d6-4a7f-b316-a8ebd29e02ff admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:03.120108 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adadaa0-024e-4464-ab21-bfaba1c0adb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:03.120771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adadaa0-024e-4464-ab21-bfaba1c0adb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:03.121093 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adadaa0-024e-4464-ab21-bfaba1c0adb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:03.121400 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adadaa0-024e-4464-ab21-bfaba1c0adb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:03.122164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adadaa0-024e-4464-ab21-bfaba1c0adb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:03.123760 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adadaa0-024e-4464-ab21-bfaba1c0adb7 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:03.134561 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1160/2317] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:22:03.138351 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adadaa0-024e-4464-ab21-bfaba1c0adb7 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:03.148279 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adadaa0-024e-4464-ab21-bfaba1c0adb7 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:03.153619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d9d5b-7a36-4b11-87d8-45f116922bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:03.159723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d9d5b-7a36-4b11-87d8-45f116922bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:03.159723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d9d5b-7a36-4b11-87d8-45f116922bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:03.159723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d9d5b-7a36-4b11-87d8-45f116922bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:03.159723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d9d5b-7a36-4b11-87d8-45f116922bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:03.159723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d9d5b-7a36-4b11-87d8-45f116922bb6 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:03.169696 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1161/2318] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:22:03.174542 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d9d5b-7a36-4b11-87d8-45f116922bb6 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:03.184201 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d9d5b-7a36-4b11-87d8-45f116922bb6 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:03.189086 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ad238-28c6-484e-95c5-5e66f837a422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:03.189949 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ad238-28c6-484e-95c5-5e66f837a422 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:03.190231 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ad238-28c6-484e-95c5-5e66f837a422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:03.190508 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ad238-28c6-484e-95c5-5e66f837a422 admin admin] PATH_INFO: `/v3/projects/abd71b49f6d9403b8cea1fd9e7680ffb/users/401fdd54d8a143a892fd2d2407a78bc5/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:03.205145 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-484ac96c-36f1-48dc-9241-161da5f567b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84a54a395ca6445b940aedf8ae16a091'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:03.205776 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-484ac96c-36f1-48dc-9241-161da5f567b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84a54a395ca6445b940aedf8ae16a091'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:03.206153 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ad238-28c6-484e-95c5-5e66f837a422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abd71b49f6d9403b8cea1fd9e7680ffb, user_id=401fdd54d8a143a892fd2d2407a78bc5, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:03.222465 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ad238-28c6-484e-95c5-5e66f837a422 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:03.222634 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-484ac96c-36f1-48dc-9241-161da5f567b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84a54a395ca6445b940aedf8ae16a091'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:03.222634 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1158/2319] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:22:02 2022] DELETE /identity/v3/users/84a54a395ca6445b940aedf8ae16a091 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:03.225481 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca55a1-a3f2-4968-8f00-83a96ee9f935 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:03.225774 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca55a1-a3f2-4968-8f00-83a96ee9f935 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:03.226057 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca55a1-a3f2-4968-8f00-83a96ee9f935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:03.243832 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-7dca55a1-a3f2-4968-8f00-83a96ee9f935 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:03.245078 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-7dca55a1-a3f2-4968-8f00-83a96ee9f935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:03.306007 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1159/2320] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:22:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:22:03.316074 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca55a1-a3f2-4968-8f00-83a96ee9f935 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:03.317510 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-7dca55a1-a3f2-4968-8f00-83a96ee9f935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:03.329442 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1162/2321] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:03 2022] PUT /identity/v3/projects/abd71b49f6d9403b8cea1fd9e7680ffb/users/401fdd54d8a143a892fd2d2407a78bc5/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:22:03.335221 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa303c-bfeb-4792-8c17-4716e4e1fb38 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:03.335508 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa303c-bfeb-4792-8c17-4716e4e1fb38 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:03.335785 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa303c-bfeb-4792-8c17-4716e4e1fb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:03.354396 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-fdfa303c-bfeb-4792-8c17-4716e4e1fb38 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:03.355689 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-fdfa303c-bfeb-4792-8c17-4716e4e1fb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:03.380661 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca55a1-a3f2-4968-8f00-83a96ee9f935 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:03.384494 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:03.417556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1163/2322] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:22:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:22:03.427213 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa303c-bfeb-4792-8c17-4716e4e1fb38 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:03.432021 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84005f79-ab70-4086-9bdb-09dc0821ea77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:03.432715 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84005f79-ab70-4086-9bdb-09dc0821ea77 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:03.433049 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84005f79-ab70-4086-9bdb-09dc0821ea77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:03.433316 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84005f79-ab70-4086-9bdb-09dc0821ea77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:03.442822 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84005f79-ab70-4086-9bdb-09dc0821ea77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:03.444201 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84005f79-ab70-4086-9bdb-09dc0821ea77 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:03.454743 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1160/2323] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:22:03.483492 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa303c-bfeb-4792-8c17-4716e4e1fb38 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:03.487894 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca087a-b178-4c32-889b-36f2fb5ae6bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:03.488550 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca087a-b178-4c32-889b-36f2fb5ae6bf service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:03.488861 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca087a-b178-4c32-889b-36f2fb5ae6bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:03.489145 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca087a-b178-4c32-889b-36f2fb5ae6bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:03.498662 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca087a-b178-4c32-889b-36f2fb5ae6bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:03.500148 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca087a-b178-4c32-889b-36f2fb5ae6bf service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:03.510825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1164/2324] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:22:04.054398 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84005f79-ab70-4086-9bdb-09dc0821ea77 service neutron] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:04.055913 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-84005f79-ab70-4086-9bdb-09dc0821ea77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:04.069373 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84005f79-ab70-4086-9bdb-09dc0821ea77 service neutron] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:04.074570 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0123305-7e31-4210-9eab-f6e8358bb8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:04.075783 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0123305-7e31-4210-9eab-f6e8358bb8e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:04.076139 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0123305-7e31-4210-9eab-f6e8358bb8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:04.076497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0123305-7e31-4210-9eab-f6e8358bb8e0 admin admin] PATH_INFO: `/v3/projects/7f19b0162e344cb58aa6fd590ada3594` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:04.077942 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0123305-7e31-4210-9eab-f6e8358bb8e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f19b0162e344cb58aa6fd590ada3594)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:04.080656 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0123305-7e31-4210-9eab-f6e8358bb8e0 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:04.250627 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f0123305-7e31-4210-9eab-f6e8358bb8e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f19b0162e344cb58aa6fd590ada3594', 'request_id': 'req-f0123305-7e31-4210-9eab-f6e8358bb8e0'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:04.257421 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f0123305-7e31-4210-9eab-f6e8358bb8e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f19b0162e344cb58aa6fd590ada3594', 'request_id': 'req-f0123305-7e31-4210-9eab-f6e8358bb8e0'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:04.437462 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f0123305-7e31-4210-9eab-f6e8358bb8e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f19b0162e344cb58aa6fd590ada3594', 'request_id': 'req-f0123305-7e31-4210-9eab-f6e8358bb8e0'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:04.449374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f0123305-7e31-4210-9eab-f6e8358bb8e0 admin admin] The token cache is being invalidate because project 7f19b0162e344cb58aa6fd590ada3594 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:22:04.449657 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f0123305-7e31-4210-9eab-f6e8358bb8e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:04.450298 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f0123305-7e31-4210-9eab-f6e8358bb8e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:04.451926 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1161/2325] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:22:04 2022] DELETE /identity/v3/projects/7f19b0162e344cb58aa6fd590ada3594 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:04.456975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9154d4-c27e-40ee-bd23-13509aa2ef52 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:04.457754 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9154d4-c27e-40ee-bd23-13509aa2ef52 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:04.457926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9154d4-c27e-40ee-bd23-13509aa2ef52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:04.477362 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-4d9154d4-c27e-40ee-bd23-13509aa2ef52 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:04.487051 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-4d9154d4-c27e-40ee-bd23-13509aa2ef52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:04.487051 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:04.540448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1165/2326] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:22:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:04.549669 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127c693-f75a-4f61-a314-acdfa3ab2f03 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:04.549959 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127c693-f75a-4f61-a314-acdfa3ab2f03 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:04.550233 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4127c693-f75a-4f61-a314-acdfa3ab2f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:04.568682 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-4127c693-f75a-4f61-a314-acdfa3ab2f03 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:04.569846 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-4127c693-f75a-4f61-a314-acdfa3ab2f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:04.578004 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1162/2327] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:22:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:22:04.582380 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9154d4-c27e-40ee-bd23-13509aa2ef52 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:04.592472 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9154d4-c27e-40ee-bd23-13509aa2ef52 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:04.598023 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f6c3f-e135-43b6-8800-7211015851be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:04.598722 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f6c3f-e135-43b6-8800-7211015851be admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:04.599009 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f6c3f-e135-43b6-8800-7211015851be admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:04.599289 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f6c3f-e135-43b6-8800-7211015851be admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:04.600036 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f6c3f-e135-43b6-8800-7211015851be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:22:04.600346 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f6c3f-e135-43b6-8800-7211015851be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:04.601997 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f6c3f-e135-43b6-8800-7211015851be admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:04.619449 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1166/2328] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:22:04.620790 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4127c693-f75a-4f61-a314-acdfa3ab2f03 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:04.630685 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4127c693-f75a-4f61-a314-acdfa3ab2f03 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:04.635807 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae9f79-e743-4751-bf59-874274899933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:04.636474 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae9f79-e743-4751-bf59-874274899933 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:04.636758 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae9f79-e743-4751-bf59-874274899933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:04.647763 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae9f79-e743-4751-bf59-874274899933 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:04.647763 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae9f79-e743-4751-bf59-874274899933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:04.647763 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae9f79-e743-4751-bf59-874274899933 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:04.856091 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1163/2329] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:04 2022] POST /identity/v3/projects => generated 391 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:04.859986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f6c3f-e135-43b6-8800-7211015851be admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:04.870276 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f6c3f-e135-43b6-8800-7211015851be admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:04.930551 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7422d-46c9-4ec8-a6e5-844198f8c71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:04.931290 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7422d-46c9-4ec8-a6e5-844198f8c71a admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:04.931575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7422d-46c9-4ec8-a6e5-844198f8c71a admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:04.931848 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7422d-46c9-4ec8-a6e5-844198f8c71a admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:04.932544 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7422d-46c9-4ec8-a6e5-844198f8c71a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:04.934636 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7422d-46c9-4ec8-a6e5-844198f8c71a admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:05.140646 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1167/2330] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:04 2022] POST /identity/v3/users => generated 296 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:05.145260 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae9f79-e743-4751-bf59-874274899933 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:05.156028 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae9f79-e743-4751-bf59-874274899933 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:05.161383 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3deee-8037-45ff-af84-ace44d678d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:05.162042 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3deee-8037-45ff-af84-ace44d678d09 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:05.162327 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3deee-8037-45ff-af84-ace44d678d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:05.162604 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3deee-8037-45ff-af84-ace44d678d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:05.163338 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3deee-8037-45ff-af84-ace44d678d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:05.164984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3deee-8037-45ff-af84-ace44d678d09 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:05.175410 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1164/2331] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:05.183862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7422d-46c9-4ec8-a6e5-844198f8c71a admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:05.193980 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7422d-46c9-4ec8-a6e5-844198f8c71a admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:05.198738 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184a3df-b55c-4481-8d80-1b721ef608fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:05.199440 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184a3df-b55c-4481-8d80-1b721ef608fd admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:05.199732 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184a3df-b55c-4481-8d80-1b721ef608fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:05.200014 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184a3df-b55c-4481-8d80-1b721ef608fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:05.200747 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184a3df-b55c-4481-8d80-1b721ef608fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:05.202366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184a3df-b55c-4481-8d80-1b721ef608fd admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:05.213142 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1168/2332] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:05.229784 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3deee-8037-45ff-af84-ace44d678d09 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:05.239608 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3deee-8037-45ff-af84-ace44d678d09 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:05.244129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0cff48-ee67-4ab8-acea-578f593c21cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:05.245048 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cff48-ee67-4ab8-acea-578f593c21cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:05.245326 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cff48-ee67-4ab8-acea-578f593c21cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:05.245596 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cff48-ee67-4ab8-acea-578f593c21cc admin admin] PATH_INFO: `/v3/projects/dacaa230753544729c3099315ceaaa85/users/509a00b598994e9c86c016c22b54cef9/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:05.261173 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0cff48-ee67-4ab8-acea-578f593c21cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=dacaa230753544729c3099315ceaaa85, user_id=509a00b598994e9c86c016c22b54cef9, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:05.263805 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0cff48-ee67-4ab8-acea-578f593c21cc admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:05.422951 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1165/2333] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:05 2022] PUT /identity/v3/projects/dacaa230753544729c3099315ceaaa85/users/509a00b598994e9c86c016c22b54cef9/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:05.434559 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf97bf-6d95-4e75-9852-a676d8d32c73 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:05.434853 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf97bf-6d95-4e75-9852-a676d8d32c73 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:05.435136 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf97bf-6d95-4e75-9852-a676d8d32c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:05.469250 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-b4cf97bf-6d95-4e75-9852-a676d8d32c73 None None] MFA Rules not processed for user `509a00b598994e9c86c016c22b54cef9`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:05.470540 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-b4cf97bf-6d95-4e75-9852-a676d8d32c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:05.548175 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1169/2334] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:22:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:05.558316 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0cff48-ee67-4ab8-acea-578f593c21cc admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:05.560178 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-2c0cff48-ee67-4ab8-acea-578f593c21cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:05.594498 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:05.620621 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0cff48-ee67-4ab8-acea-578f593c21cc admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:05.624614 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458eabd9-9ee4-421b-98b8-5b014f79b820 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:05.625319 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458eabd9-9ee4-421b-98b8-5b014f79b820 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:05.626270 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458eabd9-9ee4-421b-98b8-5b014f79b820 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:05.626573 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458eabd9-9ee4-421b-98b8-5b014f79b820 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:05.635518 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458eabd9-9ee4-421b-98b8-5b014f79b820 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:05.637027 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458eabd9-9ee4-421b-98b8-5b014f79b820 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:05.646099 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1166/2335] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:10.059594 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6628c9-7bfd-4fce-b358-8dfa46130455 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:10.060108 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6628c9-7bfd-4fce-b358-8dfa46130455 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:10.060189 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6628c9-7bfd-4fce-b358-8dfa46130455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:10.075567 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:10.093374 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-4d6628c9-7bfd-4fce-b358-8dfa46130455 None None] MFA Rules not processed for user `401fdd54d8a143a892fd2d2407a78bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:10.094674 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-4d6628c9-7bfd-4fce-b358-8dfa46130455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:10.172690 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1170/2336] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:22:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:10.177322 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458eabd9-9ee4-421b-98b8-5b014f79b820 service cinder] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:10.178843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-458eabd9-9ee4-421b-98b8-5b014f79b820 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:10.251830 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458eabd9-9ee4-421b-98b8-5b014f79b820 service cinder] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:10.257631 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604db1c-f4e4-47fa-8403-0905cb197a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:10.258330 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604db1c-f4e4-47fa-8403-0905cb197a22 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:10.258617 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604db1c-f4e4-47fa-8403-0905cb197a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:10.259019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604db1c-f4e4-47fa-8403-0905cb197a22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:10.260042 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604db1c-f4e4-47fa-8403-0905cb197a22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:10.262570 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604db1c-f4e4-47fa-8403-0905cb197a22 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:10.354236 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1167/2337] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:10 2022] POST /identity/v3/projects => generated 379 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:10.358277 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6628c9-7bfd-4fce-b358-8dfa46130455 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:10.376661 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6628c9-7bfd-4fce-b358-8dfa46130455 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:10.438042 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b6b63-ca0f-4a9e-912a-9333672f5952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:10.438751 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b6b63-ca0f-4a9e-912a-9333672f5952 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:10.439039 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b6b63-ca0f-4a9e-912a-9333672f5952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:10.439317 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b6b63-ca0f-4a9e-912a-9333672f5952 admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:10.440019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b6b63-ca0f-4a9e-912a-9333672f5952 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:10.441980 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b6b63-ca0f-4a9e-912a-9333672f5952 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:10.537065 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1171/2338] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:10 2022] POST /identity/v3/users => generated 296 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:10.541402 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604db1c-f4e4-47fa-8403-0905cb197a22 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:10.552800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604db1c-f4e4-47fa-8403-0905cb197a22 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:10.557660 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752fd275-3261-4fac-8365-df56cf607b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:10.558341 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752fd275-3261-4fac-8365-df56cf607b0f admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:10.558629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752fd275-3261-4fac-8365-df56cf607b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:10.558917 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752fd275-3261-4fac-8365-df56cf607b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:10.559656 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752fd275-3261-4fac-8365-df56cf607b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:10.561786 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752fd275-3261-4fac-8365-df56cf607b0f admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:10.577893 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1168/2339] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:10.578875 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b6b63-ca0f-4a9e-912a-9333672f5952 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:10.589671 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b6b63-ca0f-4a9e-912a-9333672f5952 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:10.594665 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faae61c-2374-49d1-98d9-d12b56bc7f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:10.595575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faae61c-2374-49d1-98d9-d12b56bc7f54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:10.595862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faae61c-2374-49d1-98d9-d12b56bc7f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:10.596140 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faae61c-2374-49d1-98d9-d12b56bc7f54 admin admin] PATH_INFO: `/v3/projects/101f44497a69444c8eccb021149df611/users/dc1bb7cf8e6945f3bdb2166027f06948/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:10.610763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faae61c-2374-49d1-98d9-d12b56bc7f54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=101f44497a69444c8eccb021149df611, user_id=dc1bb7cf8e6945f3bdb2166027f06948, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:10.613548 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faae61c-2374-49d1-98d9-d12b56bc7f54 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:10.692693 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1172/2340] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:10 2022] PUT /identity/v3/projects/101f44497a69444c8eccb021149df611/users/dc1bb7cf8e6945f3bdb2166027f06948/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:22:10.696625 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752fd275-3261-4fac-8365-df56cf607b0f admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:10.707834 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752fd275-3261-4fac-8365-df56cf607b0f admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:10.771565 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfc6df-36d4-4723-9e3b-b90388f21d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:10.771565 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfc6df-36d4-4723-9e3b-b90388f21d11 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:10.771565 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfc6df-36d4-4723-9e3b-b90388f21d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:10.771565 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfc6df-36d4-4723-9e3b-b90388f21d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:10.772252 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfc6df-36d4-4723-9e3b-b90388f21d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:10.773948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfc6df-36d4-4723-9e3b-b90388f21d11 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:10.785305 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1169/2341] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:22:10.789469 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faae61c-2374-49d1-98d9-d12b56bc7f54 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:10.800859 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faae61c-2374-49d1-98d9-d12b56bc7f54 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:10.805660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c3baa-bea6-46f4-9bc6-e8daeaf30f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:10.806632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c3baa-bea6-46f4-9bc6-e8daeaf30f32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:10.806865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c3baa-bea6-46f4-9bc6-e8daeaf30f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:10.807146 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c3baa-bea6-46f4-9bc6-e8daeaf30f32 admin admin] PATH_INFO: `/v3/projects/101f44497a69444c8eccb021149df611/users/dc1bb7cf8e6945f3bdb2166027f06948/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:10.809214 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c3baa-bea6-46f4-9bc6-e8daeaf30f32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=101f44497a69444c8eccb021149df611, user_id=dc1bb7cf8e6945f3bdb2166027f06948, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:10.811871 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c3baa-bea6-46f4-9bc6-e8daeaf30f32 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:10.823368 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1173/2342] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:10 2022] PUT /identity/v3/projects/101f44497a69444c8eccb021149df611/users/dc1bb7cf8e6945f3bdb2166027f06948/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:16.950632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42180c99-5bd6-4f3c-9838-acbb90af77f5 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:16.951174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42180c99-5bd6-4f3c-9838-acbb90af77f5 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:16.951174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42180c99-5bd6-4f3c-9838-acbb90af77f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:16.986604 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-42180c99-5bd6-4f3c-9838-acbb90af77f5 None None] MFA Rules not processed for user `dc1bb7cf8e6945f3bdb2166027f06948`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:16.987828 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-42180c99-5bd6-4f3c-9838-acbb90af77f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:17.021582 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:17.063411 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1170/2343] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:22:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:17.078308 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c3baa-bea6-46f4-9bc6-e8daeaf30f32 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:17.082089 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-a19c3baa-bea6-46f4-9bc6-e8daeaf30f32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:17.140280 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:17.185100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c3baa-bea6-46f4-9bc6-e8daeaf30f32 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:17.191961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc765df-000e-478e-9171-422c56050629 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:17.192647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc765df-000e-478e-9171-422c56050629 service nova] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:17.193107 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc765df-000e-478e-9171-422c56050629 service nova] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:17.193394 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc765df-000e-478e-9171-422c56050629 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:17.254571 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc765df-000e-478e-9171-422c56050629 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:17.256183 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc765df-000e-478e-9171-422c56050629 service nova] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:17.266019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1174/2344] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:27.103493 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=15 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:27.262199 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=43 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:35.107697 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42180c99-5bd6-4f3c-9838-acbb90af77f5 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:35.169477 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42180c99-5bd6-4f3c-9838-acbb90af77f5 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:35.174043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739af9e1-a06e-421f-9b5c-6dc06fc37edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:35.174914 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739af9e1-a06e-421f-9b5c-6dc06fc37edf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:35.175201 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739af9e1-a06e-421f-9b5c-6dc06fc37edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:35.175478 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739af9e1-a06e-421f-9b5c-6dc06fc37edf admin admin] PATH_INFO: `/v3/users/509a00b598994e9c86c016c22b54cef9` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:35.176737 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739af9e1-a06e-421f-9b5c-6dc06fc37edf admin admin] RBAC: Authorizing `identity:delete_user(user_id=509a00b598994e9c86c016c22b54cef9)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:35.178713 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739af9e1-a06e-421f-9b5c-6dc06fc37edf admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:35.450191 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-739af9e1-a06e-421f-9b5c-6dc06fc37edf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '509a00b598994e9c86c016c22b54cef9'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:35.473630 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-739af9e1-a06e-421f-9b5c-6dc06fc37edf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '509a00b598994e9c86c016c22b54cef9'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:35.561471 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-739af9e1-a06e-421f-9b5c-6dc06fc37edf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '509a00b598994e9c86c016c22b54cef9'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:35.562085 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-739af9e1-a06e-421f-9b5c-6dc06fc37edf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '509a00b598994e9c86c016c22b54cef9'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:35.570251 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-739af9e1-a06e-421f-9b5c-6dc06fc37edf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '509a00b598994e9c86c016c22b54cef9'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:35.576233 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1171/2345] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:22:35 2022] DELETE /identity/v3/users/509a00b598994e9c86c016c22b54cef9 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:35.580793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c30ac-f06c-4933-9a27-c18a2806156b None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:35.581278 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c30ac-f06c-4933-9a27-c18a2806156b None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:35.581388 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c30ac-f06c-4933-9a27-c18a2806156b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:35.598199 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-bb3c30ac-f06c-4933-9a27-c18a2806156b None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:35.605388 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-bb3c30ac-f06c-4933-9a27-c18a2806156b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:35.658104 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1175/2346] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:35.668391 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739af9e1-a06e-421f-9b5c-6dc06fc37edf admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:35.669899 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-739af9e1-a06e-421f-9b5c-6dc06fc37edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:35.748583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739af9e1-a06e-421f-9b5c-6dc06fc37edf admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:35.753042 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facba4b-d934-4629-9203-84fd78f9a83f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:35.753720 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facba4b-d934-4629-9203-84fd78f9a83f service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:35.754002 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facba4b-d934-4629-9203-84fd78f9a83f service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:35.754276 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facba4b-d934-4629-9203-84fd78f9a83f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:35.765440 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facba4b-d934-4629-9203-84fd78f9a83f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:35.766902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facba4b-d934-4629-9203-84fd78f9a83f service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:35.777789 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1172/2347] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:36.340236 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c30ac-f06c-4933-9a27-c18a2806156b None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:36.340236 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-bb3c30ac-f06c-4933-9a27-c18a2806156b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:36.347643 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c30ac-f06c-4933-9a27-c18a2806156b None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:36.352469 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77734a-be29-4858-bc71-351193df26a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:36.353429 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77734a-be29-4858-bc71-351193df26a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:36.353648 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77734a-be29-4858-bc71-351193df26a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:36.353945 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77734a-be29-4858-bc71-351193df26a2 admin admin] PATH_INFO: `/v3/projects/dacaa230753544729c3099315ceaaa85` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:36.355131 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77734a-be29-4858-bc71-351193df26a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dacaa230753544729c3099315ceaaa85)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:36.357124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77734a-be29-4858-bc71-351193df26a2 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:36.589941 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-1f77734a-be29-4858-bc71-351193df26a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dacaa230753544729c3099315ceaaa85', 'request_id': 'req-1f77734a-be29-4858-bc71-351193df26a2'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:36.595618 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-1f77734a-be29-4858-bc71-351193df26a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dacaa230753544729c3099315ceaaa85', 'request_id': 'req-1f77734a-be29-4858-bc71-351193df26a2'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:36.691018 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-1f77734a-be29-4858-bc71-351193df26a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dacaa230753544729c3099315ceaaa85', 'request_id': 'req-1f77734a-be29-4858-bc71-351193df26a2'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:36.702859 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-1f77734a-be29-4858-bc71-351193df26a2 admin admin] The token cache is being invalidate because project dacaa230753544729c3099315ceaaa85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:22:36.703159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-1f77734a-be29-4858-bc71-351193df26a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:36.703840 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-1f77734a-be29-4858-bc71-351193df26a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:36.705431 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1176/2348] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:22:36 2022] DELETE /identity/v3/projects/dacaa230753544729c3099315ceaaa85 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:36.710583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d04ab1-99fc-443e-8a91-a5f53d8cb01e None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:36.711067 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d04ab1-99fc-443e-8a91-a5f53d8cb01e None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:36.711179 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d04ab1-99fc-443e-8a91-a5f53d8cb01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:36.731934 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-30d04ab1-99fc-443e-8a91-a5f53d8cb01e None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:36.733159 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-30d04ab1-99fc-443e-8a91-a5f53d8cb01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:36.750865 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:36.793885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1173/2349] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:22:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:36.801755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2017b-f296-4eec-9f3f-f638732a73e4 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:36.802044 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2017b-f296-4eec-9f3f-f638732a73e4 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:36.802324 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2017b-f296-4eec-9f3f-f638732a73e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:36.820667 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-36e2017b-f296-4eec-9f3f-f638732a73e4 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:36.821895 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-36e2017b-f296-4eec-9f3f-f638732a73e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:36.830124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1177/2350] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:22:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:36.834801 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d04ab1-99fc-443e-8a91-a5f53d8cb01e None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:36.844511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d04ab1-99fc-443e-8a91-a5f53d8cb01e None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:36.849285 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85cd8dd-a500-43c1-9935-56bb110dd7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:36.850022 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cd8dd-a500-43c1-9935-56bb110dd7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:36.850308 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cd8dd-a500-43c1-9935-56bb110dd7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:36.850587 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cd8dd-a500-43c1-9935-56bb110dd7b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:36.851314 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85cd8dd-a500-43c1-9935-56bb110dd7b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:22:36.851623 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85cd8dd-a500-43c1-9935-56bb110dd7b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:36.853366 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85cd8dd-a500-43c1-9935-56bb110dd7b1 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:36.865799 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1174/2351] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:22:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:22:36.870165 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2017b-f296-4eec-9f3f-f638732a73e4 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:36.880024 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2017b-f296-4eec-9f3f-f638732a73e4 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:36.884925 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca1634-dfcf-46bf-94b0-d7fec67fe16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:36.885612 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca1634-dfcf-46bf-94b0-d7fec67fe16a admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:36.885902 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca1634-dfcf-46bf-94b0-d7fec67fe16a admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:36.886180 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca1634-dfcf-46bf-94b0-d7fec67fe16a admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:36.886890 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca1634-dfcf-46bf-94b0-d7fec67fe16a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:36.888811 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca1634-dfcf-46bf-94b0-d7fec67fe16a admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:37.004505 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1178/2352] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:36 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:37.010031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85cd8dd-a500-43c1-9935-56bb110dd7b1 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:37.020209 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85cd8dd-a500-43c1-9935-56bb110dd7b1 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:37.080037 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74f946-8f9c-47c4-80ea-e8366ea143d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:37.080801 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74f946-8f9c-47c4-80ea-e8366ea143d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:37.081057 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74f946-8f9c-47c4-80ea-e8366ea143d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:37.081333 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74f946-8f9c-47c4-80ea-e8366ea143d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:37.082020 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74f946-8f9c-47c4-80ea-e8366ea143d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:37.083943 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74f946-8f9c-47c4-80ea-e8366ea143d6 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:37.165349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1175/2353] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:37 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:37.167341 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca1634-dfcf-46bf-94b0-d7fec67fe16a admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:37.179142 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca1634-dfcf-46bf-94b0-d7fec67fe16a admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:37.184221 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976f44e-7c81-4a4c-8943-4a5a08ec5021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:37.184687 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976f44e-7c81-4a4c-8943-4a5a08ec5021 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:37.184997 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976f44e-7c81-4a4c-8943-4a5a08ec5021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:37.185248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976f44e-7c81-4a4c-8943-4a5a08ec5021 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:37.185997 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976f44e-7c81-4a4c-8943-4a5a08ec5021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:37.187594 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976f44e-7c81-4a4c-8943-4a5a08ec5021 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:37.199679 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1179/2354] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:37.202450 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74f946-8f9c-47c4-80ea-e8366ea143d6 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:37.212559 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74f946-8f9c-47c4-80ea-e8366ea143d6 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:37.217198 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e2caf-49ec-47b9-bf86-dc9ebb4ab5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:37.217853 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e2caf-49ec-47b9-bf86-dc9ebb4ab5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:37.218133 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e2caf-49ec-47b9-bf86-dc9ebb4ab5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:37.218406 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e2caf-49ec-47b9-bf86-dc9ebb4ab5d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:37.219135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e2caf-49ec-47b9-bf86-dc9ebb4ab5d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:37.220716 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e2caf-49ec-47b9-bf86-dc9ebb4ab5d2 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:37.231620 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1176/2355] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:37.235932 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976f44e-7c81-4a4c-8943-4a5a08ec5021 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:37.246321 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976f44e-7c81-4a4c-8943-4a5a08ec5021 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:37.250933 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ebd2b-7945-47ca-b232-c8db81789e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:37.251892 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ebd2b-7945-47ca-b232-c8db81789e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:37.252185 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ebd2b-7945-47ca-b232-c8db81789e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:37.252469 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ebd2b-7945-47ca-b232-c8db81789e1e admin admin] PATH_INFO: `/v3/projects/9dfa249b41a8422fae46988649977e6e/users/f778bbdc67024183aca4711b9d87105e/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:37.266910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ebd2b-7945-47ca-b232-c8db81789e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dfa249b41a8422fae46988649977e6e, user_id=f778bbdc67024183aca4711b9d87105e, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:37.269596 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ebd2b-7945-47ca-b232-c8db81789e1e admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:37.363751 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1180/2356] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:37 2022] PUT /identity/v3/projects/9dfa249b41a8422fae46988649977e6e/users/f778bbdc67024183aca4711b9d87105e/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:37.369828 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a4223-9d20-43f5-ad71-95dac397080c None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:37.370117 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a4223-9d20-43f5-ad71-95dac397080c None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:37.370451 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a4223-9d20-43f5-ad71-95dac397080c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:37.388342 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-298a4223-9d20-43f5-ad71-95dac397080c None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:37.389604 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-298a4223-9d20-43f5-ad71-95dac397080c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:37.449746 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1177/2357] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:37.459418 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ebd2b-7945-47ca-b232-c8db81789e1e admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:37.461201 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-878ebd2b-7945-47ca-b232-c8db81789e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:37.483244 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:37.518854 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ebd2b-7945-47ca-b232-c8db81789e1e admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:37.523048 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416fa71-6f52-44f2-b187-3a5ea0a12aeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:37.523698 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416fa71-6f52-44f2-b187-3a5ea0a12aeb service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:37.523985 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416fa71-6f52-44f2-b187-3a5ea0a12aeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:37.524265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416fa71-6f52-44f2-b187-3a5ea0a12aeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:37.533749 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416fa71-6f52-44f2-b187-3a5ea0a12aeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:37.535203 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416fa71-6f52-44f2-b187-3a5ea0a12aeb service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:37.545266 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1181/2358] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:43.634594 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fd086-390c-4ef9-b375-1aeccca54717 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:43.635091 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fd086-390c-4ef9-b375-1aeccca54717 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:43.635205 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fd086-390c-4ef9-b375-1aeccca54717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:43.666179 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-d62fd086-390c-4ef9-b375-1aeccca54717 None None] MFA Rules not processed for user `f778bbdc67024183aca4711b9d87105e`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:43.667415 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-d62fd086-390c-4ef9-b375-1aeccca54717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:43.684762 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:43.741919 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1178/2359] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:22:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:43.746606 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416fa71-6f52-44f2-b187-3a5ea0a12aeb service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:43.757357 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416fa71-6f52-44f2-b187-3a5ea0a12aeb service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:43.762301 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac66cf-90f2-4f4f-9304-62224efdcf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:43.763044 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac66cf-90f2-4f4f-9304-62224efdcf53 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:43.763456 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac66cf-90f2-4f4f-9304-62224efdcf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:43.763749 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac66cf-90f2-4f4f-9304-62224efdcf53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:43.764632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac66cf-90f2-4f4f-9304-62224efdcf53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:43.768044 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac66cf-90f2-4f4f-9304-62224efdcf53 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:43.894087 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1182/2360] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:43 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:43.898097 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fd086-390c-4ef9-b375-1aeccca54717 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:43.909365 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fd086-390c-4ef9-b375-1aeccca54717 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:43.975431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0948a-af95-4e24-9768-fe2f5435fb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:43.975431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0948a-af95-4e24-9768-fe2f5435fb5e admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:43.975431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0948a-af95-4e24-9768-fe2f5435fb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:43.975431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0948a-af95-4e24-9768-fe2f5435fb5e admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:43.975856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0948a-af95-4e24-9768-fe2f5435fb5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:43.976507 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0948a-af95-4e24-9768-fe2f5435fb5e admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:44.114850 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1179/2361] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:43 2022] POST /identity/v3/users => generated 299 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:44.119319 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac66cf-90f2-4f4f-9304-62224efdcf53 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:44.130324 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac66cf-90f2-4f4f-9304-62224efdcf53 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:44.135056 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298fec3-9ae1-4e14-b497-89ab51e2974e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:44.135744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298fec3-9ae1-4e14-b497-89ab51e2974e admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:44.136027 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298fec3-9ae1-4e14-b497-89ab51e2974e admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:44.136610 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298fec3-9ae1-4e14-b497-89ab51e2974e admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:44.137364 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298fec3-9ae1-4e14-b497-89ab51e2974e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:44.139076 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298fec3-9ae1-4e14-b497-89ab51e2974e admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:44.154411 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1183/2362] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:44.158955 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0948a-af95-4e24-9768-fe2f5435fb5e admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:44.169993 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0948a-af95-4e24-9768-fe2f5435fb5e admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:44.176155 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4636cfa-2e20-4e0b-b35c-14f19ec3a41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:44.177279 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4636cfa-2e20-4e0b-b35c-14f19ec3a41d admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:44.177643 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4636cfa-2e20-4e0b-b35c-14f19ec3a41d admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:44.177917 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4636cfa-2e20-4e0b-b35c-14f19ec3a41d admin admin] PATH_INFO: `/v3/projects/f1f9fdbb6bd3491d9e2fe17990f3406b/users/aab59e18ced64af8b188935751873719/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:44.201800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4636cfa-2e20-4e0b-b35c-14f19ec3a41d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1f9fdbb6bd3491d9e2fe17990f3406b, user_id=aab59e18ced64af8b188935751873719, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:44.201800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4636cfa-2e20-4e0b-b35c-14f19ec3a41d admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:44.277663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1180/2363] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:44 2022] PUT /identity/v3/projects/f1f9fdbb6bd3491d9e2fe17990f3406b/users/aab59e18ced64af8b188935751873719/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:44.281998 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298fec3-9ae1-4e14-b497-89ab51e2974e admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:44.292131 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298fec3-9ae1-4e14-b497-89ab51e2974e admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:44.352162 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123f14e-2b33-48ee-bc31-badee569acda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:44.361050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123f14e-2b33-48ee-bc31-badee569acda admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:44.361050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123f14e-2b33-48ee-bc31-badee569acda admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:44.361050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123f14e-2b33-48ee-bc31-badee569acda admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:44.361050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123f14e-2b33-48ee-bc31-badee569acda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:44.361050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123f14e-2b33-48ee-bc31-badee569acda admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:44.366619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1184/2364] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:22:44.370790 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4636cfa-2e20-4e0b-b35c-14f19ec3a41d admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:44.382728 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4636cfa-2e20-4e0b-b35c-14f19ec3a41d admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:44.387624 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77b3bd-f8d9-4807-a57a-a86ac7fa1806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:44.388652 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77b3bd-f8d9-4807-a57a-a86ac7fa1806 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:44.388992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77b3bd-f8d9-4807-a57a-a86ac7fa1806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:44.395261 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77b3bd-f8d9-4807-a57a-a86ac7fa1806 admin admin] PATH_INFO: `/v3/projects/f1f9fdbb6bd3491d9e2fe17990f3406b/users/aab59e18ced64af8b188935751873719/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:44.395261 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77b3bd-f8d9-4807-a57a-a86ac7fa1806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1f9fdbb6bd3491d9e2fe17990f3406b, user_id=aab59e18ced64af8b188935751873719, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:44.395261 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77b3bd-f8d9-4807-a57a-a86ac7fa1806 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:44.405868 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1181/2365] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:44 2022] PUT /identity/v3/projects/f1f9fdbb6bd3491d9e2fe17990f3406b/users/aab59e18ced64af8b188935751873719/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:51.148491 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5715a-6d76-402d-9ff2-312aa995f213 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:51.151851 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5715a-6d76-402d-9ff2-312aa995f213 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:51.151851 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5715a-6d76-402d-9ff2-312aa995f213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:51.190105 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-4bb5715a-6d76-402d-9ff2-312aa995f213 None None] MFA Rules not processed for user `401fdd54d8a143a892fd2d2407a78bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:51.191365 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-4bb5715a-6d76-402d-9ff2-312aa995f213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:51.335198 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1185/2366] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:22:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:51.405716 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab57a1-74b0-48c6-ac56-9ed729f9b922 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:51.406137 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab57a1-74b0-48c6-ac56-9ed729f9b922 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:51.406320 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab57a1-74b0-48c6-ac56-9ed729f9b922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:51.456210 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-caab57a1-74b0-48c6-ac56-9ed729f9b922 None None] MFA Rules not processed for user `aab59e18ced64af8b188935751873719`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:51.458094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-caab57a1-74b0-48c6-ac56-9ed729f9b922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:51.582683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:51.614941 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1182/2367] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:22:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:51.624688 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5715a-6d76-402d-9ff2-312aa995f213 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:51.637356 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-4bb5715a-6d76-402d-9ff2-312aa995f213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:51.693605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:51.744768 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5715a-6d76-402d-9ff2-312aa995f213 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:51.750614 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e0845-4776-4890-b74b-b6066b9eebcd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4fbf9b051940bd82547a700796d118', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:51.751386 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e0845-4776-4890-b74b-b6066b9eebcd service glance] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:51.751739 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e0845-4776-4890-b74b-b6066b9eebcd service glance] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:51.752210 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e0845-4776-4890-b74b-b6066b9eebcd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:51.860848 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e0845-4776-4890-b74b-b6066b9eebcd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:51.865974 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e0845-4776-4890-b74b-b6066b9eebcd service glance] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:51.902008 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1186/2368] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:52.038820 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99cb44-89d0-4103-851b-e19b27bcc047 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:52.039258 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99cb44-89d0-4103-851b-e19b27bcc047 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:52.039679 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99cb44-89d0-4103-851b-e19b27bcc047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:52.067461 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-9b99cb44-89d0-4103-851b-e19b27bcc047 None None] MFA Rules not processed for user `7b4d3b1fe8064cc592d89e7bab91bace`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:52.069203 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-9b99cb44-89d0-4103-851b-e19b27bcc047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:52.156525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1183/2369] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Jun 22 10:22:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:52.180533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e0845-4776-4890-b74b-b6066b9eebcd service glance] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:52.182878 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-4f6e0845-4776-4890-b74b-b6066b9eebcd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:52.228064 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dfaba-28e3-47fe-90f2-e90a824f7251 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:52.229234 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dfaba-28e3-47fe-90f2-e90a824f7251 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:52.229634 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153dfaba-28e3-47fe-90f2-e90a824f7251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:52.260273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-153dfaba-28e3-47fe-90f2-e90a824f7251 None None] MFA Rules not processed for user `7b4d3b1fe8064cc592d89e7bab91bace`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:52.262372 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-153dfaba-28e3-47fe-90f2-e90a824f7251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:52.276539 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1184/2370] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Jun 22 10:22:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:22:52.303083 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e0845-4776-4890-b74b-b6066b9eebcd service glance] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:52.303513 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153dfaba-28e3-47fe-90f2-e90a824f7251 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:52.303722 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7af45-0701-4669-8ec8-2eac930609b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c724063ce51470ca09c5c5ab231fd9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:52.303722 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7af45-0701-4669-8ec8-2eac930609b4 service swift] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:52.303722 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7af45-0701-4669-8ec8-2eac930609b4 service swift] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:52.303722 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7af45-0701-4669-8ec8-2eac930609b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:52.315897 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d7af45-0701-4669-8ec8-2eac930609b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:52.317650 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d7af45-0701-4669-8ec8-2eac930609b4 service swift] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:52.320499 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153dfaba-28e3-47fe-90f2-e90a824f7251 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:52.327349 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1187/2371] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 22 10:22:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:22:52.328877 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5bfa49-c43a-406d-9f6b-2bfd9dd1dcef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c724063ce51470ca09c5c5ab231fd9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:52.329860 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5bfa49-c43a-406d-9f6b-2bfd9dd1dcef service swift] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:52.329860 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5bfa49-c43a-406d-9f6b-2bfd9dd1dcef service swift] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:52.330089 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5bfa49-c43a-406d-9f6b-2bfd9dd1dcef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:52.339635 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5bfa49-c43a-406d-9f6b-2bfd9dd1dcef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:52.341313 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5bfa49-c43a-406d-9f6b-2bfd9dd1dcef service swift] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:52.351388 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1185/2372] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 22 10:22:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 10:23:02.323675 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=75 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:02.348036 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=36 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:10.779316 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c98b2a-cae1-4d9b-8b6b-2ab537dc968a None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:10.779907 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c98b2a-cae1-4d9b-8b6b-2ab537dc968a None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:10.780193 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c98b2a-cae1-4d9b-8b6b-2ab537dc968a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:10.799170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-14c98b2a-cae1-4d9b-8b6b-2ab537dc968a None None] MFA Rules not processed for user `f778bbdc67024183aca4711b9d87105e`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:10.800412 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-14c98b2a-cae1-4d9b-8b6b-2ab537dc968a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:10.810831 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1188/2373] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:23:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:17.690704 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb0b85-fa57-4ad4-9c7f-dd66338d442a None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:17.691265 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb0b85-fa57-4ad4-9c7f-dd66338d442a None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:17.691265 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb0b85-fa57-4ad4-9c7f-dd66338d442a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:17.712004 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-eadb0b85-fa57-4ad4-9c7f-dd66338d442a None None] MFA Rules not processed for user `7b4d3b1fe8064cc592d89e7bab91bace`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:17.713340 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-eadb0b85-fa57-4ad4-9c7f-dd66338d442a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:17.731786 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1186/2374] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Jun 22 10:23:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:17.745588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c98b2a-cae1-4d9b-8b6b-2ab537dc968a None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:17.758721 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c98b2a-cae1-4d9b-8b6b-2ab537dc968a None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:17.764226 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d47cc4-2949-4a75-9607-3bf8c4e74d87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c724063ce51470ca09c5c5ab231fd9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:17.764935 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d47cc4-2949-4a75-9607-3bf8c4e74d87 service swift] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:17.765581 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d47cc4-2949-4a75-9607-3bf8c4e74d87 service swift] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:17.765581 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d47cc4-2949-4a75-9607-3bf8c4e74d87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:17.775607 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d47cc4-2949-4a75-9607-3bf8c4e74d87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:17.777988 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d47cc4-2949-4a75-9607-3bf8c4e74d87 service swift] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:17.790071 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba043922-a2b4-4c5f-bcd1-43f00ba804fd None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:17.790637 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba043922-a2b4-4c5f-bcd1-43f00ba804fd None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:17.790925 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba043922-a2b4-4c5f-bcd1-43f00ba804fd None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:17.792869 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1187/2375] 10.222.0.46 () {54 vars in 921 bytes} [Wed Jun 22 10:23:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:23:17.797001 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1189/2376] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 22 10:23:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:23:17.798751 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c033d2d-e498-41f1-8ed1-b80bd619e5c4 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:17.799652 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c033d2d-e498-41f1-8ed1-b80bd619e5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:17.799916 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c033d2d-e498-41f1-8ed1-b80bd619e5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:17.846351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-0c033d2d-e498-41f1-8ed1-b80bd619e5c4 None None] MFA Rules not processed for user `4ed9a00723ab4af2b633ab7614d178a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:17.847628 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-0c033d2d-e498-41f1-8ed1-b80bd619e5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:17.923623 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1188/2377] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Jun 22 10:23:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:17.936423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d47cc4-2949-4a75-9607-3bf8c4e74d87 service swift] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:17.948147 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d47cc4-2949-4a75-9607-3bf8c4e74d87 service swift] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:17.952169 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d2dde-788b-43f8-802e-294bca50cb7c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4fbf9b051940bd82547a700796d118', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:17.952859 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d2dde-788b-43f8-802e-294bca50cb7c service glance] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:17.953136 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d2dde-788b-43f8-802e-294bca50cb7c service glance] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:17.953418 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d2dde-788b-43f8-802e-294bca50cb7c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:17.965207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d2dde-788b-43f8-802e-294bca50cb7c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:17.966645 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d2dde-788b-43f8-802e-294bca50cb7c service glance] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:17.978578 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1190/2378] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:23:18.275971 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28046b7a-b6cd-44a0-bd10-0776637ff63d None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:18.276411 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28046b7a-b6cd-44a0-bd10-0776637ff63d None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:18.276546 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28046b7a-b6cd-44a0-bd10-0776637ff63d None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:18.278389 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1189/2379] 10.222.0.46 () {54 vars in 921 bytes} [Wed Jun 22 10:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:23:18.278876 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d2dde-788b-43f8-802e-294bca50cb7c service glance] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:18.284547 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033d414-face-4e27-913a-dfbb992dd8f0 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:18.284873 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033d414-face-4e27-913a-dfbb992dd8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:18.285137 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033d414-face-4e27-913a-dfbb992dd8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:18.329825 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-d033d414-face-4e27-913a-dfbb992dd8f0 None None] MFA Rules not processed for user `0bddc02875304e8c92ac367c8095efee`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:18.334536 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-d033d414-face-4e27-913a-dfbb992dd8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:18.399595 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d2dde-788b-43f8-802e-294bca50cb7c service glance] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:18.408859 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e18f7c-49f7-4880-9fdf-d80230999eea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:18.409524 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e18f7c-49f7-4880-9fdf-d80230999eea service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:18.409804 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e18f7c-49f7-4880-9fdf-d80230999eea service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:18.410077 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e18f7c-49f7-4880-9fdf-d80230999eea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:18.420174 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-46e18f7c-49f7-4880-9fdf-d80230999eea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:18.476375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1190/2380] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Jun 22 10:23:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:23:18.540270 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033d414-face-4e27-913a-dfbb992dd8f0 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:18.553918 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033d414-face-4e27-913a-dfbb992dd8f0 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:18.572215 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bb34c-c09c-41ed-a055-3949297b4d59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:18.573490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bb34c-c09c-41ed-a055-3949297b4d59 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:18.573921 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bb34c-c09c-41ed-a055-3949297b4d59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:18.574209 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bb34c-c09c-41ed-a055-3949297b4d59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:18.586754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36bb34c-c09c-41ed-a055-3949297b4d59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:18.596102 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36bb34c-c09c-41ed-a055-3949297b4d59 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:18.603467 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e18f7c-49f7-4880-9fdf-d80230999eea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:18.605010 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e18f7c-49f7-4880-9fdf-d80230999eea service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:18.615526 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1191/2381] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:18.626454 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1191/2382] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:23:18.849201 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bf834-cc39-4141-b5a7-6c12bca012a2 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:18.849816 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bf834-cc39-4141-b5a7-6c12bca012a2 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:18.849816 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bf834-cc39-4141-b5a7-6c12bca012a2 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:18.851269 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1192/2383] 10.222.0.46 () {54 vars in 921 bytes} [Wed Jun 22 10:23:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:23:18.857886 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63dbb0-b2c1-419d-8cef-fbbb984f540a None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:18.858403 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63dbb0-b2c1-419d-8cef-fbbb984f540a None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:18.858517 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63dbb0-b2c1-419d-8cef-fbbb984f540a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:18.880230 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-1b63dbb0-b2c1-419d-8cef-fbbb984f540a None None] MFA Rules not processed for user `4ed9a00723ab4af2b633ab7614d178a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:18.885812 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-1b63dbb0-b2c1-419d-8cef-fbbb984f540a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:18.902598 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1192/2384] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Jun 22 10:23:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:18.959673 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75bf834-cc39-4141-b5a7-6c12bca012a2 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:18.977958 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75bf834-cc39-4141-b5a7-6c12bca012a2 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:18.980102 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63dbb0-b2c1-419d-8cef-fbbb984f540a None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:18.984402 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-1b63dbb0-b2c1-419d-8cef-fbbb984f540a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:18.990364 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f72b7b-105e-47f8-a0fc-6158e1a00112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:18.991292 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f72b7b-105e-47f8-a0fc-6158e1a00112 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:18.991776 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f72b7b-105e-47f8-a0fc-6158e1a00112 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:18.993082 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f72b7b-105e-47f8-a0fc-6158e1a00112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:18.999802 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63dbb0-b2c1-419d-8cef-fbbb984f540a None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:19.010215 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f72b7b-105e-47f8-a0fc-6158e1a00112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:19.012981 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f72b7b-105e-47f8-a0fc-6158e1a00112 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:19.017568 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726c88e-f070-4a9f-80f4-653261c5ae07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:19.018294 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726c88e-f070-4a9f-80f4-653261c5ae07 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:19.018644 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726c88e-f070-4a9f-80f4-653261c5ae07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:19.018968 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726c88e-f070-4a9f-80f4-653261c5ae07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:19.021954 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-a726c88e-f070-4a9f-80f4-653261c5ae07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:19.039164 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1193/2385] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:19.055535 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726c88e-f070-4a9f-80f4-653261c5ae07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:19.057082 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726c88e-f070-4a9f-80f4-653261c5ae07 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:19.087522 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1193/2386] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:20.461645 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f72b7b-105e-47f8-a0fc-6158e1a00112 service neutron] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:20.473357 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f72b7b-105e-47f8-a0fc-6158e1a00112 service neutron] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:20.481795 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbad1f8-efe3-46a4-95cc-00397a6bba20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:20.481795 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbad1f8-efe3-46a4-95cc-00397a6bba20 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:20.489582 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbad1f8-efe3-46a4-95cc-00397a6bba20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:20.489972 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbad1f8-efe3-46a4-95cc-00397a6bba20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:20.492075 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-2bbad1f8-efe3-46a4-95cc-00397a6bba20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:20.516582 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbad1f8-efe3-46a4-95cc-00397a6bba20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:20.519027 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbad1f8-efe3-46a4-95cc-00397a6bba20 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:20.532455 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1194/2387] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:29.064734 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=74 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:30.526394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=81 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:37.838493 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726c88e-f070-4a9f-80f4-653261c5ae07 service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:37.840149 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-a726c88e-f070-4a9f-80f4-653261c5ae07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:37.857684 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726c88e-f070-4a9f-80f4-653261c5ae07 service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:37.862225 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd6dcf-ca39-4eaf-9447-0588195edff7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4fbf9b051940bd82547a700796d118', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:37.862225 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd6dcf-ca39-4eaf-9447-0588195edff7 service glance] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:37.862500 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd6dcf-ca39-4eaf-9447-0588195edff7 service glance] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:37.862807 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd6dcf-ca39-4eaf-9447-0588195edff7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:37.865295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-cafd6dcf-ca39-4eaf-9447-0588195edff7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:37.934124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd6dcf-ca39-4eaf-9447-0588195edff7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:37.935481 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd6dcf-ca39-4eaf-9447-0588195edff7 service glance] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:37.944721 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1194/2388] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:38.095301 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa76b75-1ec2-4e38-aada-8b86a96e0ee8 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:38.095782 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa76b75-1ec2-4e38-aada-8b86a96e0ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:38.095900 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa76b75-1ec2-4e38-aada-8b86a96e0ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:38.119328 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-efa76b75-1ec2-4e38-aada-8b86a96e0ee8 None None] MFA Rules not processed for user `7b4d3b1fe8064cc592d89e7bab91bace`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:38.120554 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-efa76b75-1ec2-4e38-aada-8b86a96e0ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:38.127858 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1195/2389] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Jun 22 10:23:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:38.139714 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd6dcf-ca39-4eaf-9447-0588195edff7 service glance] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:38.151373 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd6dcf-ca39-4eaf-9447-0588195edff7 service glance] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:38.156302 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4e044-d083-4ba4-abec-cefe1867fa91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c724063ce51470ca09c5c5ab231fd9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:38.156999 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4e044-d083-4ba4-abec-cefe1867fa91 service swift] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:38.157285 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4e044-d083-4ba4-abec-cefe1867fa91 service swift] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:38.157571 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4e044-d083-4ba4-abec-cefe1867fa91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:38.166618 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4e044-d083-4ba4-abec-cefe1867fa91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:38.168180 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4e044-d083-4ba4-abec-cefe1867fa91 service swift] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:38.176485 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1195/2390] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 22 10:23:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:23:47.490423 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa76b75-1ec2-4e38-aada-8b86a96e0ee8 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:47.491772 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-efa76b75-1ec2-4e38-aada-8b86a96e0ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:47.508103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa76b75-1ec2-4e38-aada-8b86a96e0ee8 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:47.513808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714c44e-098e-4968-b8ab-ef63c5a133b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:47.514491 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714c44e-098e-4968-b8ab-ef63c5a133b8 service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:47.514762 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714c44e-098e-4968-b8ab-ef63c5a133b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:47.515044 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714c44e-098e-4968-b8ab-ef63c5a133b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:47.517091 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-8714c44e-098e-4968-b8ab-ef63c5a133b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:47.577596 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8714c44e-098e-4968-b8ab-ef63c5a133b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:47.580472 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8714c44e-098e-4968-b8ab-ef63c5a133b8 service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:47.601778 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1196/2391] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:48.173121 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=34 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:53.848376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4e044-d083-4ba4-abec-cefe1867fa91 service swift] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:53.858710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4e044-d083-4ba4-abec-cefe1867fa91 service swift] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:53.862756 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59ff20-09f1-43f0-9dea-f476f36f60d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:53.863417 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59ff20-09f1-43f0-9dea-f476f36f60d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:53.863705 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59ff20-09f1-43f0-9dea-f476f36f60d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:53.863985 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59ff20-09f1-43f0-9dea-f476f36f60d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:53.870389 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-4f59ff20-09f1-43f0-9dea-f476f36f60d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:53.881242 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f59ff20-09f1-43f0-9dea-f476f36f60d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:53.882907 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f59ff20-09f1-43f0-9dea-f476f36f60d1 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:53.892015 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1196/2392] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:57.589810 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=31 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:03.894037 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=6 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:05.920340 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6f188-328a-442f-9be2-17ac24878604 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:05.920802 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6f188-328a-442f-9be2-17ac24878604 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:05.920923 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6f188-328a-442f-9be2-17ac24878604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:05.938557 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-43c6f188-328a-442f-9be2-17ac24878604 None None] MFA Rules not processed for user `7b4d3b1fe8064cc592d89e7bab91bace`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:24:05.939768 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-43c6f188-328a-442f-9be2-17ac24878604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:05.947345 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1197/2393] 10.222.0.46 () {58 vars in 967 bytes} [Wed Jun 22 10:24:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:24:05.969388 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59ff20-09f1-43f0-9dea-f476f36f60d1 service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:05.983279 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59ff20-09f1-43f0-9dea-f476f36f60d1 service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:05.988249 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc467de-1303-458b-b3d7-e5045444040e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c724063ce51470ca09c5c5ab231fd9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:05.988915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc467de-1303-458b-b3d7-e5045444040e service swift] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:05.989202 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc467de-1303-458b-b3d7-e5045444040e service swift] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:05.989479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc467de-1303-458b-b3d7-e5045444040e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:05.998789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc467de-1303-458b-b3d7-e5045444040e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:06.000358 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc467de-1303-458b-b3d7-e5045444040e service swift] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:06.009219 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1197/2394] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 22 10:24:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:24:11.242311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6f188-328a-442f-9be2-17ac24878604 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:11.252529 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6f188-328a-442f-9be2-17ac24878604 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:11.256321 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243d655-f8c6-4b97-aac1-f3fb5f52553b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:11.256997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243d655-f8c6-4b97-aac1-f3fb5f52553b service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:11.257281 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243d655-f8c6-4b97-aac1-f3fb5f52553b service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:11.257561 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243d655-f8c6-4b97-aac1-f3fb5f52553b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:11.266750 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243d655-f8c6-4b97-aac1-f3fb5f52553b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:11.268186 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243d655-f8c6-4b97-aac1-f3fb5f52553b service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:11.278227 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1198/2395] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:24:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:24:16.005371 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=6 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:16.698865 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc467de-1303-458b-b3d7-e5045444040e service swift] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:16.699678 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-edc467de-1303-458b-b3d7-e5045444040e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:16.739809 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc467de-1303-458b-b3d7-e5045444040e service swift] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:16.739809 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e305fec-8e14-41f6-8666-963046a15eac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:16.739809 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e305fec-8e14-41f6-8666-963046a15eac service nova] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:16.739809 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e305fec-8e14-41f6-8666-963046a15eac service nova] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:16.740106 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e305fec-8e14-41f6-8666-963046a15eac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:16.740106 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-8e305fec-8e14-41f6-8666-963046a15eac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:16.753741 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e305fec-8e14-41f6-8666-963046a15eac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:16.755483 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e305fec-8e14-41f6-8666-963046a15eac service nova] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:16.770018 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1198/2396] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:24:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:24:19.354095 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243d655-f8c6-4b97-aac1-f3fb5f52553b service neutron] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:19.367150 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243d655-f8c6-4b97-aac1-f3fb5f52553b service neutron] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:19.372716 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f980c1-29c5-4cf5-b424-096a576fa189 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:19.373415 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f980c1-29c5-4cf5-b424-096a576fa189 service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:19.373699 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f980c1-29c5-4cf5-b424-096a576fa189 service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:19.373974 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f980c1-29c5-4cf5-b424-096a576fa189 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:19.375775 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-20f980c1-29c5-4cf5-b424-096a576fa189 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:19.435613 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f980c1-29c5-4cf5-b424-096a576fa189 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:19.437305 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f980c1-29c5-4cf5-b424-096a576fa189 service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:19.446602 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1199/2397] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:24:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:24:26.763993 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=6 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:29.442243 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=37 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:30.643050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266edcf-6a01-41a3-8bf7-9a95a9ef8932 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:30.643604 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266edcf-6a01-41a3-8bf7-9a95a9ef8932 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:30.643604 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266edcf-6a01-41a3-8bf7-9a95a9ef8932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:30.666150 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-3266edcf-6a01-41a3-8bf7-9a95a9ef8932 None None] MFA Rules not processed for user `425bf40bd45642a1aafeb65bdb9650af`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:24:30.667472 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-3266edcf-6a01-41a3-8bf7-9a95a9ef8932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:30.674481 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1199/2398] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:24:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:24:40.659784 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:20.995632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f980c1-29c5-4cf5-b424-096a576fa189 service nova] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:25:21.009070 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f980c1-29c5-4cf5-b424-096a576fa189 service nova] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:25:21.015415 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c6475-2999-4558-b43c-d7d635ad545d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:25:21.016067 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c6475-2999-4558-b43c-d7d635ad545d service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:21.016352 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c6475-2999-4558-b43c-d7d635ad545d service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:21.016631 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c6475-2999-4558-b43c-d7d635ad545d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:21.018468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-a58c6475-2999-4558-b43c-d7d635ad545d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:21.031328 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c6475-2999-4558-b43c-d7d635ad545d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:25:21.032966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c6475-2999-4558-b43c-d7d635ad545d service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:25:21.045031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1200/2399] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:25:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:25:26.482641 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c2992-634b-4255-a9ce-075a425b769b None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:26.483172 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c2992-634b-4255-a9ce-075a425b769b None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:26.483274 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c2992-634b-4255-a9ce-075a425b769b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:26.501467 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-027c2992-634b-4255-a9ce-075a425b769b None None] MFA Rules not processed for user `cef533d7373946dcb340fbf496070e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:25:26.502659 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-027c2992-634b-4255-a9ce-075a425b769b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:26.510287 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1200/2400] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:25:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:25:26.820499 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c6475-2999-4558-b43c-d7d635ad545d service nova] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:25:26.829828 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c6475-2999-4558-b43c-d7d635ad545d service nova] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:25:26.833602 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593c0a4-7584-42c0-bbfe-67e169d2de85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:25:26.834246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593c0a4-7584-42c0-bbfe-67e169d2de85 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:26.834524 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593c0a4-7584-42c0-bbfe-67e169d2de85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:26.834808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593c0a4-7584-42c0-bbfe-67e169d2de85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:26.836611 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-4593c0a4-7584-42c0-bbfe-67e169d2de85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:26.846529 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4593c0a4-7584-42c0-bbfe-67e169d2de85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:25:26.847964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4593c0a4-7584-42c0-bbfe-67e169d2de85 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:25:26.856604 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1201/2401] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:25:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:25:27.311195 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c2992-634b-4255-a9ce-075a425b769b None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:25:27.312788 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-027c2992-634b-4255-a9ce-075a425b769b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:27.386136 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c2992-634b-4255-a9ce-075a425b769b None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:25:27.391716 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5579cd-5463-434a-8ff3-ab52712d0e4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '675892a676054b4f86f9ac12d95f4f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:25:27.392369 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5579cd-5463-434a-8ff3-ab52712d0e4b service placement] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:27.392652 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5579cd-5463-434a-8ff3-ab52712d0e4b service placement] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:27.392962 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5579cd-5463-434a-8ff3-ab52712d0e4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:27.394795 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-3c5579cd-5463-434a-8ff3-ab52712d0e4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:27.407304 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5579cd-5463-434a-8ff3-ab52712d0e4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:25:27.408932 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5579cd-5463-434a-8ff3-ab52712d0e4b service placement] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:25:27.419092 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1201/2402] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:25:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:25:36.852449 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=12 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:37.414901 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=35 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:37.971287 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593c0a4-7584-42c0-bbfe-67e169d2de85 service neutron] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:25:37.984304 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593c0a4-7584-42c0-bbfe-67e169d2de85 service neutron] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:25:37.989943 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da3ae6-815b-4764-8281-38084fc9407c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:25:37.995135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da3ae6-815b-4764-8281-38084fc9407c service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:37.995135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da3ae6-815b-4764-8281-38084fc9407c service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:37.995135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da3ae6-815b-4764-8281-38084fc9407c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:37.995135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-38da3ae6-815b-4764-8281-38084fc9407c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:38.005268 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da3ae6-815b-4764-8281-38084fc9407c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:25:38.006867 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da3ae6-815b-4764-8281-38084fc9407c service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:25:38.018222 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1202/2403] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:25:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:25:48.013665 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=6 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:59.438667 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c5239-1022-43db-8fc3-a2306a11ab4a None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:59.439190 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c5239-1022-43db-8fc3-a2306a11ab4a None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:59.439190 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c5239-1022-43db-8fc3-a2306a11ab4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:59.457494 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-ef9c5239-1022-43db-8fc3-a2306a11ab4a None None] MFA Rules not processed for user `16265c4e556943369aa0cb3e961795bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:25:59.458772 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-ef9c5239-1022-43db-8fc3-a2306a11ab4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:59.465915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1202/2404] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:25:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:26:05.962998 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d92b0-9ba3-4044-a135-0cac031ed317 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:05.963552 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d92b0-9ba3-4044-a135-0cac031ed317 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:05.963552 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d92b0-9ba3-4044-a135-0cac031ed317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:05.981890 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-f82d92b0-9ba3-4044-a135-0cac031ed317 None None] MFA Rules not processed for user `401fdd54d8a143a892fd2d2407a78bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:26:05.983115 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-f82d92b0-9ba3-4044-a135-0cac031ed317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:05.990333 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1203/2405] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:26:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:26:09.451830 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:12.249763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c5239-1022-43db-8fc3-a2306a11ab4a None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:12.269496 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c5239-1022-43db-8fc3-a2306a11ab4a None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:12.273591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc66a9-ce47-4e80-b314-bef92ab24711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:12.275013 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc66a9-ce47-4e80-b314-bef92ab24711 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:12.278602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc66a9-ce47-4e80-b314-bef92ab24711 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:12.278602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc66a9-ce47-4e80-b314-bef92ab24711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:12.278602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-dacc66a9-ce47-4e80-b314-bef92ab24711 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:12.368975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc66a9-ce47-4e80-b314-bef92ab24711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:12.370579 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc66a9-ce47-4e80-b314-bef92ab24711 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:12.384672 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1203/2406] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:26:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:26:15.976352 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:17.803823 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d92b0-9ba3-4044-a135-0cac031ed317 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:17.820059 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d92b0-9ba3-4044-a135-0cac031ed317 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:17.826428 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f2ad1-d5ca-420b-8a13-761af1cccae0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '675892a676054b4f86f9ac12d95f4f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:17.827193 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f2ad1-d5ca-420b-8a13-761af1cccae0 service placement] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:17.828922 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f2ad1-d5ca-420b-8a13-761af1cccae0 service placement] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:17.829200 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f2ad1-d5ca-420b-8a13-761af1cccae0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:17.831182 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-e44f2ad1-d5ca-420b-8a13-761af1cccae0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:17.844219 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f2ad1-d5ca-420b-8a13-761af1cccae0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:17.845887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f2ad1-d5ca-420b-8a13-761af1cccae0 service placement] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:17.859947 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1204/2407] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:26:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:26:17.954762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc66a9-ce47-4e80-b314-bef92ab24711 service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:17.956908 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-dacc66a9-ce47-4e80-b314-bef92ab24711 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:17.971593 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc66a9-ce47-4e80-b314-bef92ab24711 service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:17.985230 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b3e29-0756-4115-94e4-93ef3515616c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:17.985230 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b3e29-0756-4115-94e4-93ef3515616c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:17.985230 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b3e29-0756-4115-94e4-93ef3515616c admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:17.985230 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b3e29-0756-4115-94e4-93ef3515616c admin admin] PATH_INFO: `/v3/users/425bf40bd45642a1aafeb65bdb9650af` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:17.986032 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b3e29-0756-4115-94e4-93ef3515616c admin admin] RBAC: Authorizing `identity:delete_user(user_id=425bf40bd45642a1aafeb65bdb9650af)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:17.986032 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b3e29-0756-4115-94e4-93ef3515616c admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:18.319167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-2a4b3e29-0756-4115-94e4-93ef3515616c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '425bf40bd45642a1aafeb65bdb9650af'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:26:18.319825 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-2a4b3e29-0756-4115-94e4-93ef3515616c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '425bf40bd45642a1aafeb65bdb9650af'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:26:18.429076 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-2a4b3e29-0756-4115-94e4-93ef3515616c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '425bf40bd45642a1aafeb65bdb9650af'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:26:18.442055 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-2a4b3e29-0756-4115-94e4-93ef3515616c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '425bf40bd45642a1aafeb65bdb9650af'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:26:18.448807 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-2a4b3e29-0756-4115-94e4-93ef3515616c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '425bf40bd45642a1aafeb65bdb9650af'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:26:18.454840 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1204/2408] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:26:17 2022] DELETE /identity/v3/users/425bf40bd45642a1aafeb65bdb9650af => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:26:18.733678 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f2ad1-d5ca-420b-8a13-761af1cccae0 service placement] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:18.747303 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f2ad1-d5ca-420b-8a13-761af1cccae0 service placement] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:18.817492 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305229d-5db5-44bc-a225-3347a87b42f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:18.818384 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305229d-5db5-44bc-a225-3347a87b42f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:18.818667 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305229d-5db5-44bc-a225-3347a87b42f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:18.818943 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305229d-5db5-44bc-a225-3347a87b42f6 admin admin] PATH_INFO: `/v3/projects/30df978aece349c4baf14cc311f7b498` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:18.820142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305229d-5db5-44bc-a225-3347a87b42f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30df978aece349c4baf14cc311f7b498)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:18.822096 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305229d-5db5-44bc-a225-3347a87b42f6 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:19.016485 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-4305229d-5db5-44bc-a225-3347a87b42f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30df978aece349c4baf14cc311f7b498', 'request_id': 'req-4305229d-5db5-44bc-a225-3347a87b42f6'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:26:19.023769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-4305229d-5db5-44bc-a225-3347a87b42f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30df978aece349c4baf14cc311f7b498', 'request_id': 'req-4305229d-5db5-44bc-a225-3347a87b42f6'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:26:19.133512 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-4305229d-5db5-44bc-a225-3347a87b42f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30df978aece349c4baf14cc311f7b498', 'request_id': 'req-4305229d-5db5-44bc-a225-3347a87b42f6'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:26:19.145223 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-4305229d-5db5-44bc-a225-3347a87b42f6 admin admin] The token cache is being invalidate because project 30df978aece349c4baf14cc311f7b498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:26:19.145511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-4305229d-5db5-44bc-a225-3347a87b42f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:26:19.146272 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-4305229d-5db5-44bc-a225-3347a87b42f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:26:19.147847 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1205/2409] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:26:18 2022] DELETE /identity/v3/projects/30df978aece349c4baf14cc311f7b498 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:26:19.152861 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895c02d-c7e0-420e-9011-adf97d1ecf6f None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:19.153325 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895c02d-c7e0-420e-9011-adf97d1ecf6f None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:19.153434 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895c02d-c7e0-420e-9011-adf97d1ecf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:19.172507 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-b895c02d-c7e0-420e-9011-adf97d1ecf6f None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:26:19.173849 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-b895c02d-c7e0-420e-9011-adf97d1ecf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:19.239447 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1205/2410] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:26:19.247665 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ebb79-5945-4196-a6e5-984241a75a6e None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:19.247972 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ebb79-5945-4196-a6e5-984241a75a6e None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:19.248250 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ebb79-5945-4196-a6e5-984241a75a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:19.267581 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-366ebb79-5945-4196-a6e5-984241a75a6e None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:26:19.268872 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-366ebb79-5945-4196-a6e5-984241a75a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:19.277085 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1206/2411] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:26:19.281460 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895c02d-c7e0-420e-9011-adf97d1ecf6f None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:19.291621 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895c02d-c7e0-420e-9011-adf97d1ecf6f None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:19.296905 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1de1b8-5bd3-4153-ba5e-c11a79f4b64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:19.297578 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1de1b8-5bd3-4153-ba5e-c11a79f4b64c admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:19.297903 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1de1b8-5bd3-4153-ba5e-c11a79f4b64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:19.298182 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1de1b8-5bd3-4153-ba5e-c11a79f4b64c admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:19.298921 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1de1b8-5bd3-4153-ba5e-c11a79f4b64c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:26:19.299233 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1de1b8-5bd3-4153-ba5e-c11a79f4b64c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:19.300862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1de1b8-5bd3-4153-ba5e-c11a79f4b64c admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:19.302533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:19.317128 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1206/2412] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:26:19.320229 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ebb79-5945-4196-a6e5-984241a75a6e None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:19.329926 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ebb79-5945-4196-a6e5-984241a75a6e None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:19.334772 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91de25-2238-4aad-a6c1-df4fe8a219f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:19.335433 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91de25-2238-4aad-a6c1-df4fe8a219f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:19.335718 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91de25-2238-4aad-a6c1-df4fe8a219f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:19.335997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91de25-2238-4aad-a6c1-df4fe8a219f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:19.336719 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91de25-2238-4aad-a6c1-df4fe8a219f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:19.338667 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91de25-2238-4aad-a6c1-df4fe8a219f0 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:19.495149 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1207/2413] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:26:19 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:26:19.499848 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1de1b8-5bd3-4153-ba5e-c11a79f4b64c admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:19.509941 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1de1b8-5bd3-4153-ba5e-c11a79f4b64c admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:19.566349 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7c7fc-c97a-40f6-a5b1-9f2b40f61b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:19.567019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7c7fc-c97a-40f6-a5b1-9f2b40f61b0f admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:19.567307 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7c7fc-c97a-40f6-a5b1-9f2b40f61b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:19.567588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7c7fc-c97a-40f6-a5b1-9f2b40f61b0f admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:19.568290 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7c7fc-c97a-40f6-a5b1-9f2b40f61b0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:19.570239 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7c7fc-c97a-40f6-a5b1-9f2b40f61b0f admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:19.694376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1207/2414] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:26:19 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:26:19.701865 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91de25-2238-4aad-a6c1-df4fe8a219f0 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:19.708556 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91de25-2238-4aad-a6c1-df4fe8a219f0 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:19.713155 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb39f57-5efa-4636-8104-2789776ada2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:19.713814 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb39f57-5efa-4636-8104-2789776ada2b admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:19.714099 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb39f57-5efa-4636-8104-2789776ada2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:19.714374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb39f57-5efa-4636-8104-2789776ada2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:19.715108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb39f57-5efa-4636-8104-2789776ada2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:19.717260 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb39f57-5efa-4636-8104-2789776ada2b admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:19.727280 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1208/2415] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:26:19.731648 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7c7fc-c97a-40f6-a5b1-9f2b40f61b0f admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:19.741763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7c7fc-c97a-40f6-a5b1-9f2b40f61b0f admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:19.746399 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e713c-8731-486b-a551-4940ca068b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:19.747061 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e713c-8731-486b-a551-4940ca068b9c admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:19.747341 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e713c-8731-486b-a551-4940ca068b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:19.747617 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e713c-8731-486b-a551-4940ca068b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:19.748339 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e713c-8731-486b-a551-4940ca068b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:19.749967 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e713c-8731-486b-a551-4940ca068b9c admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:19.759934 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1208/2416] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:26:19.764113 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb39f57-5efa-4636-8104-2789776ada2b admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:19.775265 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb39f57-5efa-4636-8104-2789776ada2b admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:19.780456 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a2973-7abd-4df4-8414-1468b4b2a3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:19.781468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a2973-7abd-4df4-8414-1468b4b2a3f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:19.781752 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a2973-7abd-4df4-8414-1468b4b2a3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:19.782028 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a2973-7abd-4df4-8414-1468b4b2a3f2 admin admin] PATH_INFO: `/v3/projects/347c4ccbcb464091b8254475babf2874/users/082ece6ea4244242a6ba99152572c80f/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:19.797999 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a2973-7abd-4df4-8414-1468b4b2a3f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=347c4ccbcb464091b8254475babf2874, user_id=082ece6ea4244242a6ba99152572c80f, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:19.800673 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a2973-7abd-4df4-8414-1468b4b2a3f2 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:19.940056 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1209/2417] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:26:19 2022] PUT /identity/v3/projects/347c4ccbcb464091b8254475babf2874/users/082ece6ea4244242a6ba99152572c80f/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:26:19.945661 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242d842-679a-41dc-9bf0-21737e46c039 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:19.946099 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242d842-679a-41dc-9bf0-21737e46c039 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:19.946485 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242d842-679a-41dc-9bf0-21737e46c039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:19.965225 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-b242d842-679a-41dc-9bf0-21737e46c039 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:26:19.966930 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-b242d842-679a-41dc-9bf0-21737e46c039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:20.025896 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1209/2418] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:26:20.036021 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a2973-7abd-4df4-8414-1468b4b2a3f2 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:20.038050 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-156a2973-7abd-4df4-8414-1468b4b2a3f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:20.044536 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:20.094183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a2973-7abd-4df4-8414-1468b4b2a3f2 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:20.097897 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6287169-2d1e-4b0d-84c2-44288c022ece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:20.098543 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6287169-2d1e-4b0d-84c2-44288c022ece service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:20.098828 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6287169-2d1e-4b0d-84c2-44288c022ece service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:20.099108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6287169-2d1e-4b0d-84c2-44288c022ece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:20.107953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6287169-2d1e-4b0d-84c2-44288c022ece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:20.109434 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6287169-2d1e-4b0d-84c2-44288c022ece service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:20.119152 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1210/2419] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:26:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:26:25.840758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb54853-3436-4b28-a4a5-5fb77f0d34fc None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:25.841331 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb54853-3436-4b28-a4a5-5fb77f0d34fc None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:25.841331 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb54853-3436-4b28-a4a5-5fb77f0d34fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:25.869969 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-cfb54853-3436-4b28-a4a5-5fb77f0d34fc None None] MFA Rules not processed for user `082ece6ea4244242a6ba99152572c80f`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:26:25.871121 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-cfb54853-3436-4b28-a4a5-5fb77f0d34fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:25.945829 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1210/2420] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:26:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:26:25.960650 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6287169-2d1e-4b0d-84c2-44288c022ece service neutron] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:25.962122 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-c6287169-2d1e-4b0d-84c2-44288c022ece service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:26.058558 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6287169-2d1e-4b0d-84c2-44288c022ece service neutron] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:26.064811 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb92a5e-f736-4b0a-985f-22e3512e2244 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:26.065965 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb92a5e-f736-4b0a-985f-22e3512e2244 service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:26.065965 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb92a5e-f736-4b0a-985f-22e3512e2244 service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:26.066211 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb92a5e-f736-4b0a-985f-22e3512e2244 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:26.074467 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb92a5e-f736-4b0a-985f-22e3512e2244 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:26.076109 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb92a5e-f736-4b0a-985f-22e3512e2244 service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:26.085773 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1211/2421] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:26:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:26:29.439596 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c9142-11f0-4a46-b985-d976f35de427 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:29.439596 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c9142-11f0-4a46-b985-d976f35de427 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:29.439596 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c9142-11f0-4a46-b985-d976f35de427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:29.440931 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:29.453093 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-477c9142-11f0-4a46-b985-d976f35de427 None None] MFA Rules not processed for user `082ece6ea4244242a6ba99152572c80f`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:26:29.454326 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-477c9142-11f0-4a46-b985-d976f35de427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:29.461576 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1211/2422] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:26:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:26:29.794639 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb92a5e-f736-4b0a-985f-22e3512e2244 service nova] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:29.796165 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-8fb92a5e-f736-4b0a-985f-22e3512e2244 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:29.809530 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb92a5e-f736-4b0a-985f-22e3512e2244 service nova] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:29.813559 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6186b0-da5a-4fe7-ac92-fcc5bf72d8a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:29.817208 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6186b0-da5a-4fe7-ac92-fcc5bf72d8a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:29.817208 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6186b0-da5a-4fe7-ac92-fcc5bf72d8a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:29.817208 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6186b0-da5a-4fe7-ac92-fcc5bf72d8a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:29.817208 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-5b6186b0-da5a-4fe7-ac92-fcc5bf72d8a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:29.827496 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6186b0-da5a-4fe7-ac92-fcc5bf72d8a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:29.829014 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6186b0-da5a-4fe7-ac92-fcc5bf72d8a0 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:29.838363 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1212/2423] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:26:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:26:31.123687 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c9142-11f0-4a46-b985-d976f35de427 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:31.125229 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-477c9142-11f0-4a46-b985-d976f35de427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:31.195149 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c9142-11f0-4a46-b985-d976f35de427 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:31.200660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207a43d-a643-4d36-a06f-b700e47fd06f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '675892a676054b4f86f9ac12d95f4f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:31.201398 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207a43d-a643-4d36-a06f-b700e47fd06f service placement] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:31.201678 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207a43d-a643-4d36-a06f-b700e47fd06f service placement] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:31.201948 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207a43d-a643-4d36-a06f-b700e47fd06f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:31.203789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-1207a43d-a643-4d36-a06f-b700e47fd06f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:31.215761 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207a43d-a643-4d36-a06f-b700e47fd06f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:31.217407 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207a43d-a643-4d36-a06f-b700e47fd06f service placement] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:31.228019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1212/2424] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:26:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:26:39.834634 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=64 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:41.223394 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=34 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:57.971705 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5a9cf-bb68-4096-9d8d-7eecba8fccb1 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:57.972270 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5a9cf-bb68-4096-9d8d-7eecba8fccb1 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:57.972270 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5a9cf-bb68-4096-9d8d-7eecba8fccb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:57.989908 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-76a5a9cf-bb68-4096-9d8d-7eecba8fccb1 None None] MFA Rules not processed for user `7b4d3b1fe8064cc592d89e7bab91bace`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:26:57.991122 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-76a5a9cf-bb68-4096-9d8d-7eecba8fccb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:58.045756 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1213/2425] 10.222.0.46 () {58 vars in 967 bytes} [Wed Jun 22 10:26:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:26:58.228747 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207a43d-a643-4d36-a06f-b700e47fd06f service placement] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:58.230211 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-1207a43d-a643-4d36-a06f-b700e47fd06f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:58.301423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207a43d-a643-4d36-a06f-b700e47fd06f service placement] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:58.306578 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1441e-1476-48f8-8c7e-e4d9d6ce01ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c724063ce51470ca09c5c5ab231fd9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:58.307233 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1441e-1476-48f8-8c7e-e4d9d6ce01ca service swift] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:58.307520 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1441e-1476-48f8-8c7e-e4d9d6ce01ca service swift] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:58.307802 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1441e-1476-48f8-8c7e-e4d9d6ce01ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:58.316364 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1441e-1476-48f8-8c7e-e4d9d6ce01ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:58.317975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1441e-1476-48f8-8c7e-e4d9d6ce01ca service swift] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:58.325956 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1213/2426] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 22 10:26:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:27:07.721331 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a5a9cf-bb68-4096-9d8d-7eecba8fccb1 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:27:07.734151 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a5a9cf-bb68-4096-9d8d-7eecba8fccb1 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:27:07.739165 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88c495-ea5b-4493-8d41-ba926b157e20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '675892a676054b4f86f9ac12d95f4f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:27:07.739982 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88c495-ea5b-4493-8d41-ba926b157e20 service placement] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:07.740269 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88c495-ea5b-4493-8d41-ba926b157e20 service placement] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:07.740542 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88c495-ea5b-4493-8d41-ba926b157e20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:07.742364 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-4b88c495-ea5b-4493-8d41-ba926b157e20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:27:07.758260 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88c495-ea5b-4493-8d41-ba926b157e20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:27:07.758260 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88c495-ea5b-4493-8d41-ba926b157e20 service placement] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:27:07.776130 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1214/2427] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:27:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:27:07.894857 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1441e-1476-48f8-8c7e-e4d9d6ce01ca service swift] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:27:07.896480 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-42e1441e-1476-48f8-8c7e-e4d9d6ce01ca service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:27:07.913048 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1441e-1476-48f8-8c7e-e4d9d6ce01ca service swift] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:27:07.917848 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb3fe1-5894-4b0a-96ce-d650be24d026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:27:07.918810 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb3fe1-5894-4b0a-96ce-d650be24d026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:07.919091 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb3fe1-5894-4b0a-96ce-d650be24d026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:07.919369 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb3fe1-5894-4b0a-96ce-d650be24d026 admin admin] PATH_INFO: `/v3/users/f778bbdc67024183aca4711b9d87105e` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:07.921115 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb3fe1-5894-4b0a-96ce-d650be24d026 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f778bbdc67024183aca4711b9d87105e)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:27:07.923046 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb3fe1-5894-4b0a-96ce-d650be24d026 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:27:08.185191 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-d2cb3fe1-5894-4b0a-96ce-d650be24d026 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f778bbdc67024183aca4711b9d87105e'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:08.185853 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-d2cb3fe1-5894-4b0a-96ce-d650be24d026 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f778bbdc67024183aca4711b9d87105e'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:08.316535 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-d2cb3fe1-5894-4b0a-96ce-d650be24d026 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f778bbdc67024183aca4711b9d87105e'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:08.329329 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-d2cb3fe1-5894-4b0a-96ce-d650be24d026 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f778bbdc67024183aca4711b9d87105e'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:08.336142 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-d2cb3fe1-5894-4b0a-96ce-d650be24d026 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f778bbdc67024183aca4711b9d87105e'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:08.343019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1214/2428] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:27:07 2022] DELETE /identity/v3/users/f778bbdc67024183aca4711b9d87105e => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:27:08.615454 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88c495-ea5b-4493-8d41-ba926b157e20 service placement] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:27:08.626600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88c495-ea5b-4493-8d41-ba926b157e20 service placement] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:27:08.682528 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e42f12-ee3f-4ac9-97d0-166b0fb53cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:27:08.683393 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e42f12-ee3f-4ac9-97d0-166b0fb53cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:08.683677 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e42f12-ee3f-4ac9-97d0-166b0fb53cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:08.683955 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e42f12-ee3f-4ac9-97d0-166b0fb53cc2 admin admin] PATH_INFO: `/v3/projects/9dfa249b41a8422fae46988649977e6e` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:08.685220 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e42f12-ee3f-4ac9-97d0-166b0fb53cc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dfa249b41a8422fae46988649977e6e)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:27:08.687656 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e42f12-ee3f-4ac9-97d0-166b0fb53cc2 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:27:08.838660 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-14e42f12-ee3f-4ac9-97d0-166b0fb53cc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dfa249b41a8422fae46988649977e6e', 'request_id': 'req-14e42f12-ee3f-4ac9-97d0-166b0fb53cc2'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:08.846284 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-14e42f12-ee3f-4ac9-97d0-166b0fb53cc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dfa249b41a8422fae46988649977e6e', 'request_id': 'req-14e42f12-ee3f-4ac9-97d0-166b0fb53cc2'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:08.936954 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-14e42f12-ee3f-4ac9-97d0-166b0fb53cc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dfa249b41a8422fae46988649977e6e', 'request_id': 'req-14e42f12-ee3f-4ac9-97d0-166b0fb53cc2'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:08.950212 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-14e42f12-ee3f-4ac9-97d0-166b0fb53cc2 admin admin] The token cache is being invalidate because project 9dfa249b41a8422fae46988649977e6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:27:08.950559 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-14e42f12-ee3f-4ac9-97d0-166b0fb53cc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:08.951385 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-14e42f12-ee3f-4ac9-97d0-166b0fb53cc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:08.953582 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1215/2429] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:27:08 2022] DELETE /identity/v3/projects/9dfa249b41a8422fae46988649977e6e => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:27:08.957723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb3fe1-5894-4b0a-96ce-d650be24d026 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:27:08.959177 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-d2cb3fe1-5894-4b0a-96ce-d650be24d026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:27:08.973197 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb3fe1-5894-4b0a-96ce-d650be24d026 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:27:09.037152 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9226c0-93b4-40eb-a454-7dd2e70670af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:27:09.038176 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9226c0-93b4-40eb-a454-7dd2e70670af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:09.038505 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9226c0-93b4-40eb-a454-7dd2e70670af admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:09.038829 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9226c0-93b4-40eb-a454-7dd2e70670af admin admin] PATH_INFO: `/v3/users/aab59e18ced64af8b188935751873719` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:09.040249 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9226c0-93b4-40eb-a454-7dd2e70670af admin admin] RBAC: Authorizing `identity:delete_user(user_id=aab59e18ced64af8b188935751873719)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:27:09.042560 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9226c0-93b4-40eb-a454-7dd2e70670af admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:27:09.045817 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:09.294388 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-7e9226c0-93b4-40eb-a454-7dd2e70670af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aab59e18ced64af8b188935751873719'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:09.295096 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-7e9226c0-93b4-40eb-a454-7dd2e70670af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aab59e18ced64af8b188935751873719'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:09.391159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-7e9226c0-93b4-40eb-a454-7dd2e70670af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aab59e18ced64af8b188935751873719'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:09.406077 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-7e9226c0-93b4-40eb-a454-7dd2e70670af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aab59e18ced64af8b188935751873719'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:09.413279 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-7e9226c0-93b4-40eb-a454-7dd2e70670af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aab59e18ced64af8b188935751873719'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:09.419339 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1215/2430] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:27:08 2022] DELETE /identity/v3/users/aab59e18ced64af8b188935751873719 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:27:09.701732 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e42f12-ee3f-4ac9-97d0-166b0fb53cc2 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:27:09.703381 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-14e42f12-ee3f-4ac9-97d0-166b0fb53cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:27:09.716613 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e42f12-ee3f-4ac9-97d0-166b0fb53cc2 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:27:09.735790 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:09.774602 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f560eb-ecb9-478f-8bb7-94fa532b423e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:27:09.775495 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f560eb-ecb9-478f-8bb7-94fa532b423e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:09.775781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f560eb-ecb9-478f-8bb7-94fa532b423e admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:09.776058 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f560eb-ecb9-478f-8bb7-94fa532b423e admin admin] PATH_INFO: `/v3/projects/f1f9fdbb6bd3491d9e2fe17990f3406b` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:09.777299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f560eb-ecb9-478f-8bb7-94fa532b423e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1f9fdbb6bd3491d9e2fe17990f3406b)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:27:09.779339 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f560eb-ecb9-478f-8bb7-94fa532b423e admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:27:09.913198 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-48f560eb-ecb9-478f-8bb7-94fa532b423e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1f9fdbb6bd3491d9e2fe17990f3406b', 'request_id': 'req-48f560eb-ecb9-478f-8bb7-94fa532b423e'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:09.920076 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-48f560eb-ecb9-478f-8bb7-94fa532b423e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1f9fdbb6bd3491d9e2fe17990f3406b', 'request_id': 'req-48f560eb-ecb9-478f-8bb7-94fa532b423e'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:10.088236 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-48f560eb-ecb9-478f-8bb7-94fa532b423e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1f9fdbb6bd3491d9e2fe17990f3406b', 'request_id': 'req-48f560eb-ecb9-478f-8bb7-94fa532b423e'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:10.099769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-48f560eb-ecb9-478f-8bb7-94fa532b423e admin admin] The token cache is being invalidate because project f1f9fdbb6bd3491d9e2fe17990f3406b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:27:10.100192 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-48f560eb-ecb9-478f-8bb7-94fa532b423e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:10.100710 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-48f560eb-ecb9-478f-8bb7-94fa532b423e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:10.102318 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1216/2431] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:27:09 2022] DELETE /identity/v3/projects/f1f9fdbb6bd3491d9e2fe17990f3406b => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:27:19.415737 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=25,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:20.096370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=41,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:24.415529 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac7e27-e8bd-4a79-982a-9c74c37885b1 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:24.416046 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac7e27-e8bd-4a79-982a-9c74c37885b1 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:24.416151 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac7e27-e8bd-4a79-982a-9c74c37885b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:24.435395 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-7dac7e27-e8bd-4a79-982a-9c74c37885b1 None None] MFA Rules not processed for user `7b4d3b1fe8064cc592d89e7bab91bace`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:27:24.436617 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-7dac7e27-e8bd-4a79-982a-9c74c37885b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:27:24.492633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1216/2432] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Jun 22 10:27:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:27:24.505304 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f560eb-ecb9-478f-8bb7-94fa532b423e admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:27:24.506734 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-48f560eb-ecb9-478f-8bb7-94fa532b423e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:27:24.581056 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f560eb-ecb9-478f-8bb7-94fa532b423e admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:27:24.586103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22a491-7a13-48b9-a884-9d5b1b49a185 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c724063ce51470ca09c5c5ab231fd9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:27:24.586750 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22a491-7a13-48b9-a884-9d5b1b49a185 service swift] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:24.587035 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22a491-7a13-48b9-a884-9d5b1b49a185 service swift] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:24.587315 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22a491-7a13-48b9-a884-9d5b1b49a185 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:24.595943 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22a491-7a13-48b9-a884-9d5b1b49a185 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:27:24.597574 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22a491-7a13-48b9-a884-9d5b1b49a185 service swift] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:27:24.605643 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1217/2433] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 22 10:27:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:27:34.485589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=25 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:34.602464 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=32 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:43.416879 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742bcde-039b-465d-88c5-892333f4cc54 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:43.417443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742bcde-039b-465d-88c5-892333f4cc54 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:43.417550 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742bcde-039b-465d-88c5-892333f4cc54 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:43.456523 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1217/2434] 10.222.0.46 () {54 vars in 921 bytes} [Wed Jun 22 10:27:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:27:43.457078 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04553878-3151-4ad2-ac5b-1e05893d6375 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:43.457078 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04553878-3151-4ad2-ac5b-1e05893d6375 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:43.457078 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04553878-3151-4ad2-ac5b-1e05893d6375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:43.457078 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-04553878-3151-4ad2-ac5b-1e05893d6375 None None] MFA Rules not processed for user `4ed9a00723ab4af2b633ab7614d178a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:27:43.457078 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-04553878-3151-4ad2-ac5b-1e05893d6375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:27:43.514169 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1218/2435] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Jun 22 10:27:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:27:43.525555 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742bcde-039b-465d-88c5-892333f4cc54 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:27:43.527245 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-8742bcde-039b-465d-88c5-892333f4cc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:27:43.583762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742bcde-039b-465d-88c5-892333f4cc54 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:27:43.587257 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c071900-903f-40d3-b6af-0dc2f55ac051 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4fbf9b051940bd82547a700796d118', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:27:43.587891 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c071900-903f-40d3-b6af-0dc2f55ac051 service glance] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:43.588170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c071900-903f-40d3-b6af-0dc2f55ac051 service glance] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:43.588440 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c071900-903f-40d3-b6af-0dc2f55ac051 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:43.598897 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c071900-903f-40d3-b6af-0dc2f55ac051 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:27:43.600315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c071900-903f-40d3-b6af-0dc2f55ac051 service glance] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:27:43.611264 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1218/2436] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:27:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:27:43.884253 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a796cd-fa46-4c06-8cbe-e9017394c437 None None] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:43.884619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a796cd-fa46-4c06-8cbe-e9017394c437 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:43.884808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a796cd-fa46-4c06-8cbe-e9017394c437 None None] PATH_INFO: `/` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:43.886378 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1219/2437] 10.222.0.46 () {54 vars in 921 bytes} [Wed Jun 22 10:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:27:43.891836 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ef0c4-30fd-4e0a-927a-4d22e31ec855 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:43.892129 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ef0c4-30fd-4e0a-927a-4d22e31ec855 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:43.892412 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ef0c4-30fd-4e0a-927a-4d22e31ec855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:43.911395 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-484ef0c4-30fd-4e0a-927a-4d22e31ec855 None None] MFA Rules not processed for user `0bddc02875304e8c92ac367c8095efee`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:27:43.912601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-484ef0c4-30fd-4e0a-927a-4d22e31ec855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:27:43.964838 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1219/2438] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Jun 22 10:27:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:27:43.977240 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a796cd-fa46-4c06-8cbe-e9017394c437 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:27:43.978900 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-b9a796cd-fa46-4c06-8cbe-e9017394c437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:27:43.992043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a796cd-fa46-4c06-8cbe-e9017394c437 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:27:43.995707 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074aff09-ab96-428d-b932-d5e0d8584dda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:27:43.996346 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074aff09-ab96-428d-b932-d5e0d8584dda service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:43.996622 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074aff09-ab96-428d-b932-d5e0d8584dda service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:43.997447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074aff09-ab96-428d-b932-d5e0d8584dda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:44.005130 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074aff09-ab96-428d-b932-d5e0d8584dda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:27:44.006564 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074aff09-ab96-428d-b932-d5e0d8584dda service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:27:44.015323 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1220/2439] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:27:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:27:44.102476 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc12be3-abcd-4a6f-9b8d-a73b655fead2 None None] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:44.102762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc12be3-abcd-4a6f-9b8d-a73b655fead2 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:44.103090 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc12be3-abcd-4a6f-9b8d-a73b655fead2 None None] PATH_INFO: `/` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:44.104485 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1220/2440] 10.222.0.46 () {54 vars in 921 bytes} [Wed Jun 22 10:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:27:44.109964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb377b-5deb-483b-a4a8-9bc360472969 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:44.110244 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb377b-5deb-483b-a4a8-9bc360472969 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:44.110514 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb377b-5deb-483b-a4a8-9bc360472969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:44.129045 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-47fb377b-5deb-483b-a4a8-9bc360472969 None None] MFA Rules not processed for user `4ed9a00723ab4af2b633ab7614d178a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:27:44.130240 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-47fb377b-5deb-483b-a4a8-9bc360472969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:27:44.140177 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1221/2441] 10.222.0.46 () {58 vars in 1018 bytes} [Wed Jun 22 10:27:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:27:44.150812 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc12be3-abcd-4a6f-9b8d-a73b655fead2 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:27:44.161968 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc12be3-abcd-4a6f-9b8d-a73b655fead2 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:27:44.165586 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b83489-b73c-44de-9538-ae699de2d786 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:27:44.166227 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b83489-b73c-44de-9538-ae699de2d786 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:44.166513 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b83489-b73c-44de-9538-ae699de2d786 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:44.166795 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b83489-b73c-44de-9538-ae699de2d786 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:44.177241 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b83489-b73c-44de-9538-ae699de2d786 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:27:44.178647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b83489-b73c-44de-9538-ae699de2d786 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:27:44.189846 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1221/2442] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:27:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:27:46.482627 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4880da3-2166-47c8-8e9f-c08a9542861b None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:46.483127 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4880da3-2166-47c8-8e9f-c08a9542861b None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:46.483224 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4880da3-2166-47c8-8e9f-c08a9542861b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:46.500695 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-c4880da3-2166-47c8-8e9f-c08a9542861b None None] MFA Rules not processed for user `7b4d3b1fe8064cc592d89e7bab91bace`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:27:46.501926 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-c4880da3-2166-47c8-8e9f-c08a9542861b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:27:46.509152 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1222/2443] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Jun 22 10:27:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:27:46.521703 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b83489-b73c-44de-9538-ae699de2d786 service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:27:46.532707 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b83489-b73c-44de-9538-ae699de2d786 service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:27:46.537999 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee66e6-7629-4287-8649-e135afd91067 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c724063ce51470ca09c5c5ab231fd9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:27:46.538630 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee66e6-7629-4287-8649-e135afd91067 service swift] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:46.538911 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee66e6-7629-4287-8649-e135afd91067 service swift] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:46.539185 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee66e6-7629-4287-8649-e135afd91067 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:46.547608 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee66e6-7629-4287-8649-e135afd91067 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:27:46.549329 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee66e6-7629-4287-8649-e135afd91067 service swift] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:27:46.557763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1222/2444] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 22 10:27:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:27:56.495785 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=43 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:56.554328 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=61 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:07.430060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd612dc2-e745-4d49-b0cd-51eb2b85347e None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:07.430552 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd612dc2-e745-4d49-b0cd-51eb2b85347e None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:07.430666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd612dc2-e745-4d49-b0cd-51eb2b85347e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:07.448872 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-dd612dc2-e745-4d49-b0cd-51eb2b85347e None None] MFA Rules not processed for user `7b4d3b1fe8064cc592d89e7bab91bace`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:28:07.450076 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-dd612dc2-e745-4d49-b0cd-51eb2b85347e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:07.457918 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1223/2445] 10.222.0.46 () {58 vars in 967 bytes} [Wed Jun 22 10:28:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:28:07.479292 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee66e6-7629-4287-8649-e135afd91067 service swift] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:07.490625 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee66e6-7629-4287-8649-e135afd91067 service swift] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:07.495629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb611d-a282-43bf-abe5-191a916a46a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c724063ce51470ca09c5c5ab231fd9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:07.496273 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb611d-a282-43bf-abe5-191a916a46a6 service swift] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:07.496559 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb611d-a282-43bf-abe5-191a916a46a6 service swift] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:07.496854 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb611d-a282-43bf-abe5-191a916a46a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:07.505459 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb611d-a282-43bf-abe5-191a916a46a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:07.507034 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb611d-a282-43bf-abe5-191a916a46a6 service swift] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:07.515006 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1223/2446] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 22 10:28:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 10:28:17.443647 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:17.511740 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=6 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:18.696558 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd612dc2-e745-4d49-b0cd-51eb2b85347e None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:18.697974 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-dd612dc2-e745-4d49-b0cd-51eb2b85347e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:18.754725 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd612dc2-e745-4d49-b0cd-51eb2b85347e None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:18.758351 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67c017-185d-4f31-a5cf-d17b694321f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:18.759019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67c017-185d-4f31-a5cf-d17b694321f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:18.759302 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67c017-185d-4f31-a5cf-d17b694321f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:18.759577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67c017-185d-4f31-a5cf-d17b694321f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:18.761374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-5b67c017-185d-4f31-a5cf-d17b694321f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:18.775443 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67c017-185d-4f31-a5cf-d17b694321f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:18.776950 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67c017-185d-4f31-a5cf-d17b694321f4 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:18.788756 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1224/2447] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:28:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:28:23.049370 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb611d-a282-43bf-abe5-191a916a46a6 service swift] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:23.050822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-5dbb611d-a282-43bf-abe5-191a916a46a6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:23.062821 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb611d-a282-43bf-abe5-191a916a46a6 service swift] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:23.066997 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13135e-5f37-4fae-b4e5-94c7115c3ff0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:23.067645 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13135e-5f37-4fae-b4e5-94c7115c3ff0 service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:23.067930 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13135e-5f37-4fae-b4e5-94c7115c3ff0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:23.068209 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13135e-5f37-4fae-b4e5-94c7115c3ff0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:23.069997 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-ac13135e-5f37-4fae-b4e5-94c7115c3ff0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:23.084157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac13135e-5f37-4fae-b4e5-94c7115c3ff0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:23.085618 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac13135e-5f37-4fae-b4e5-94c7115c3ff0 service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:23.096798 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1224/2448] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:28:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:28:28.783832 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=26 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:31.700346 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9d2c3-490e-43a8-9c02-08a90ba151e0 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:31.700948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9d2c3-490e-43a8-9c02-08a90ba151e0 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:31.700948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9d2c3-490e-43a8-9c02-08a90ba151e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:31.719046 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-25a9d2c3-490e-43a8-9c02-08a90ba151e0 None None] MFA Rules not processed for user `082ece6ea4244242a6ba99152572c80f`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:28:31.723678 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-25a9d2c3-490e-43a8-9c02-08a90ba151e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:31.781016 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1225/2449] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:28:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:28:32.800268 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13135e-5f37-4fae-b4e5-94c7115c3ff0 service cinder] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:32.808841 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13135e-5f37-4fae-b4e5-94c7115c3ff0 service cinder] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:32.812403 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb02fe-527b-4ef0-8cc4-742ddeef297d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:32.813128 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb02fe-527b-4ef0-8cc4-742ddeef297d service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:32.813487 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb02fe-527b-4ef0-8cc4-742ddeef297d service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:32.820248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb02fe-527b-4ef0-8cc4-742ddeef297d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:32.820248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-68fb02fe-527b-4ef0-8cc4-742ddeef297d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:32.877745 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb02fe-527b-4ef0-8cc4-742ddeef297d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:32.879213 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb02fe-527b-4ef0-8cc4-742ddeef297d service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:32.888279 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1225/2450] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:28:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:28:41.768932 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=25 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:42.884019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=34 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:45.951398 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314d71f-98f6-4511-a119-82354d78e632 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:45.951855 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314d71f-98f6-4511-a119-82354d78e632 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:45.951959 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314d71f-98f6-4511-a119-82354d78e632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:45.969665 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-e314d71f-98f6-4511-a119-82354d78e632 None None] MFA Rules not processed for user `401fdd54d8a143a892fd2d2407a78bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:28:45.970964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-e314d71f-98f6-4511-a119-82354d78e632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:45.977963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1226/2451] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:28:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:28:48.077283 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb02fe-527b-4ef0-8cc4-742ddeef297d service cinder] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:48.087432 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb02fe-527b-4ef0-8cc4-742ddeef297d service cinder] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:48.091065 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b5afe-085b-4787-b77c-dee2b8362b9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:48.091703 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b5afe-085b-4787-b77c-dee2b8362b9a service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:48.091987 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b5afe-085b-4787-b77c-dee2b8362b9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:48.092266 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b5afe-085b-4787-b77c-dee2b8362b9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:48.094156 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-4a2b5afe-085b-4787-b77c-dee2b8362b9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:48.161008 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b5afe-085b-4787-b77c-dee2b8362b9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:48.162448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b5afe-085b-4787-b77c-dee2b8362b9a service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:48.172713 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1226/2452] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:28:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:28:53.027342 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314d71f-98f6-4511-a119-82354d78e632 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:53.028946 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-e314d71f-98f6-4511-a119-82354d78e632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:53.047611 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314d71f-98f6-4511-a119-82354d78e632 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:53.052540 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b014b48-fb88-4b26-a396-939cf319292f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:53.053499 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b014b48-fb88-4b26-a396-939cf319292f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:53.053783 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b014b48-fb88-4b26-a396-939cf319292f admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:53.054207 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b014b48-fb88-4b26-a396-939cf319292f admin admin] PATH_INFO: `/v3/users/16265c4e556943369aa0cb3e961795bb` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:53.069451 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b014b48-fb88-4b26-a396-939cf319292f admin admin] RBAC: Authorizing `identity:delete_user(user_id=16265c4e556943369aa0cb3e961795bb)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:53.071418 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b014b48-fb88-4b26-a396-939cf319292f admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:53.382929 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-3b014b48-fb88-4b26-a396-939cf319292f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16265c4e556943369aa0cb3e961795bb'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:53.395471 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-3b014b48-fb88-4b26-a396-939cf319292f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16265c4e556943369aa0cb3e961795bb'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:53.493688 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-3b014b48-fb88-4b26-a396-939cf319292f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16265c4e556943369aa0cb3e961795bb'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:53.494268 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-3b014b48-fb88-4b26-a396-939cf319292f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16265c4e556943369aa0cb3e961795bb'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:53.502536 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-3b014b48-fb88-4b26-a396-939cf319292f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16265c4e556943369aa0cb3e961795bb'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:53.508590 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1227/2453] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:28:53 2022] DELETE /identity/v3/users/16265c4e556943369aa0cb3e961795bb => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:28:54.163675 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b5afe-085b-4787-b77c-dee2b8362b9a service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:54.175358 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b5afe-085b-4787-b77c-dee2b8362b9a service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:54.273492 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8d635-13ec-4589-9e47-6c01888c211b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:54.274548 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8d635-13ec-4589-9e47-6c01888c211b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:54.274835 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8d635-13ec-4589-9e47-6c01888c211b admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:54.275114 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8d635-13ec-4589-9e47-6c01888c211b admin admin] PATH_INFO: `/v3/projects/43383a4476d847f797dfb43fbfc66e42` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:54.290468 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8d635-13ec-4589-9e47-6c01888c211b admin admin] RBAC: Authorizing `identity:delete_project(project_id=43383a4476d847f797dfb43fbfc66e42)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:54.292594 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8d635-13ec-4589-9e47-6c01888c211b admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:54.420010 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-3fb8d635-13ec-4589-9e47-6c01888c211b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43383a4476d847f797dfb43fbfc66e42', 'request_id': 'req-3fb8d635-13ec-4589-9e47-6c01888c211b'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:54.427521 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-3fb8d635-13ec-4589-9e47-6c01888c211b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43383a4476d847f797dfb43fbfc66e42', 'request_id': 'req-3fb8d635-13ec-4589-9e47-6c01888c211b'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:54.474179 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b014b48-fb88-4b26-a396-939cf319292f admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:54.475719 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-3b014b48-fb88-4b26-a396-939cf319292f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:54.534514 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-3fb8d635-13ec-4589-9e47-6c01888c211b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43383a4476d847f797dfb43fbfc66e42', 'request_id': 'req-3fb8d635-13ec-4589-9e47-6c01888c211b'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:54.542889 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b014b48-fb88-4b26-a396-939cf319292f admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:54.548762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-3fb8d635-13ec-4589-9e47-6c01888c211b admin admin] The token cache is being invalidate because project 43383a4476d847f797dfb43fbfc66e42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:28:54.549152 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-3fb8d635-13ec-4589-9e47-6c01888c211b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:54.549778 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-3fb8d635-13ec-4589-9e47-6c01888c211b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:54.551802 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1227/2454] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:28:54 2022] DELETE /identity/v3/projects/43383a4476d847f797dfb43fbfc66e42 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:28:54.557876 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22eedd2-5f86-4d0f-b347-958982478f29 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:54.558592 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22eedd2-5f86-4d0f-b347-958982478f29 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:54.559192 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22eedd2-5f86-4d0f-b347-958982478f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:54.583923 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-d22eedd2-5f86-4d0f-b347-958982478f29 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:28:54.585875 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-d22eedd2-5f86-4d0f-b347-958982478f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:54.599238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:54.606145 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fecc8-5638-46db-8d30-dfc2c35e7958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:54.606896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fecc8-5638-46db-8d30-dfc2c35e7958 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:54.607349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fecc8-5638-46db-8d30-dfc2c35e7958 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:54.607704 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fecc8-5638-46db-8d30-dfc2c35e7958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:54.609598 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-077fecc8-5638-46db-8d30-dfc2c35e7958 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:54.620177 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fecc8-5638-46db-8d30-dfc2c35e7958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:54.621834 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fecc8-5638-46db-8d30-dfc2c35e7958 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:54.632493 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1228/2455] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:28:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:28:54.662362 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1228/2456] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:28:54.667160 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251e165-a4d0-4d83-b08a-41b9f7bcc115 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:54.667160 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251e165-a4d0-4d83-b08a-41b9f7bcc115 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:54.667437 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251e165-a4d0-4d83-b08a-41b9f7bcc115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:54.691528 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-4251e165-a4d0-4d83-b08a-41b9f7bcc115 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:28:54.692767 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-4251e165-a4d0-4d83-b08a-41b9f7bcc115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:54.704781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1229/2457] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:28:54.706538 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22eedd2-5f86-4d0f-b347-958982478f29 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:54.716991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22eedd2-5f86-4d0f-b347-958982478f29 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:54.722255 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627bfca-f784-4e17-9649-466f7e412cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:54.722997 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627bfca-f784-4e17-9649-466f7e412cbd admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:54.723284 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627bfca-f784-4e17-9649-466f7e412cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:54.724256 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627bfca-f784-4e17-9649-466f7e412cbd admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:54.724521 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627bfca-f784-4e17-9649-466f7e412cbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:28:54.724907 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627bfca-f784-4e17-9649-466f7e412cbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:54.726803 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627bfca-f784-4e17-9649-466f7e412cbd admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:54.745051 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1229/2458] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:28:54.748972 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251e165-a4d0-4d83-b08a-41b9f7bcc115 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:54.759741 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251e165-a4d0-4d83-b08a-41b9f7bcc115 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:54.764638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4533d58-9167-4134-8624-6facb1b47795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:54.768870 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4533d58-9167-4134-8624-6facb1b47795 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:54.768870 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4533d58-9167-4134-8624-6facb1b47795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:54.768870 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4533d58-9167-4134-8624-6facb1b47795 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:54.768870 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4533d58-9167-4134-8624-6facb1b47795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:54.769456 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4533d58-9167-4134-8624-6facb1b47795 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:54.772614 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:54.912869 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1230/2459] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:28:54 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:28:54.917429 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627bfca-f784-4e17-9649-466f7e412cbd admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:54.929608 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627bfca-f784-4e17-9649-466f7e412cbd admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:54.992394 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a62a0-7240-4624-b465-7bdb2bebb4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:54.993073 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a62a0-7240-4624-b465-7bdb2bebb4e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:54.993364 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a62a0-7240-4624-b465-7bdb2bebb4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:54.993645 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a62a0-7240-4624-b465-7bdb2bebb4e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:54.994353 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a62a0-7240-4624-b465-7bdb2bebb4e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:54.996340 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228a62a0-7240-4624-b465-7bdb2bebb4e9 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:55.122697 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1230/2460] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:28:54 2022] POST /identity/v3/users => generated 288 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:28:55.127926 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4533d58-9167-4134-8624-6facb1b47795 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:55.140389 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4533d58-9167-4134-8624-6facb1b47795 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:55.146178 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187551ea-c275-4dbc-b676-abf8d610f451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:55.146989 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187551ea-c275-4dbc-b676-abf8d610f451 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:55.147340 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187551ea-c275-4dbc-b676-abf8d610f451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:55.147690 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187551ea-c275-4dbc-b676-abf8d610f451 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:55.148512 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187551ea-c275-4dbc-b676-abf8d610f451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:55.150583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187551ea-c275-4dbc-b676-abf8d610f451 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:55.164531 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1231/2461] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:28:55.168638 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a62a0-7240-4624-b465-7bdb2bebb4e9 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:55.181893 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a62a0-7240-4624-b465-7bdb2bebb4e9 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:55.188611 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86554089-c468-41fe-819c-bba697dda2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:55.189946 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86554089-c468-41fe-819c-bba697dda2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:55.189946 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86554089-c468-41fe-819c-bba697dda2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:55.201167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86554089-c468-41fe-819c-bba697dda2e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:55.201167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86554089-c468-41fe-819c-bba697dda2e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:55.201167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86554089-c468-41fe-819c-bba697dda2e4 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:55.210272 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1231/2462] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:28:55.213056 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187551ea-c275-4dbc-b676-abf8d610f451 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:55.226467 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187551ea-c275-4dbc-b676-abf8d610f451 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:55.232450 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaab0c7-75a0-4181-a262-92227e55d997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:55.233384 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaab0c7-75a0-4181-a262-92227e55d997 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:55.233665 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaab0c7-75a0-4181-a262-92227e55d997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:55.233941 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaab0c7-75a0-4181-a262-92227e55d997 admin admin] PATH_INFO: `/v3/projects/ccd78f6dc7614809ae7c3beeed092cdb/users/ed921b8887e44345ac543d4f97e74281/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:55.252108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaab0c7-75a0-4181-a262-92227e55d997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd78f6dc7614809ae7c3beeed092cdb, user_id=ed921b8887e44345ac543d4f97e74281, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:55.257548 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaab0c7-75a0-4181-a262-92227e55d997 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:55.476901 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1232/2463] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:28:55 2022] PUT /identity/v3/projects/ccd78f6dc7614809ae7c3beeed092cdb/users/ed921b8887e44345ac543d4f97e74281/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:28:55.487704 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb52a3-e02b-461d-b23e-d82cdf179835 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:55.488082 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb52a3-e02b-461d-b23e-d82cdf179835 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:55.488393 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb52a3-e02b-461d-b23e-d82cdf179835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:55.515718 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-50fb52a3-e02b-461d-b23e-d82cdf179835 None None] MFA Rules not processed for user `ed921b8887e44345ac543d4f97e74281`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:28:55.517675 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-50fb52a3-e02b-461d-b23e-d82cdf179835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:55.586661 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1232/2464] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:28:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:28:55.598849 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaab0c7-75a0-4181-a262-92227e55d997 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:55.600788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-faaab0c7-75a0-4181-a262-92227e55d997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:55.673955 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaab0c7-75a0-4181-a262-92227e55d997 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:55.679641 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6aff07-5ef1-4b57-8cc9-f3fff4ab46ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:55.680292 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6aff07-5ef1-4b57-8cc9-f3fff4ab46ab service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:55.680576 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6aff07-5ef1-4b57-8cc9-f3fff4ab46ab service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:55.680872 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6aff07-5ef1-4b57-8cc9-f3fff4ab46ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:55.689100 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6aff07-5ef1-4b57-8cc9-f3fff4ab46ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:55.690696 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6aff07-5ef1-4b57-8cc9-f3fff4ab46ab service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:55.699405 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1233/2465] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:28:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:28:55.947862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb52a3-e02b-461d-b23e-d82cdf179835 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:55.960866 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:56.010963 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb52a3-e02b-461d-b23e-d82cdf179835 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:56.015440 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556043da-7efe-4ace-bbc2-b5427c5da3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:56.016308 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556043da-7efe-4ace-bbc2-b5427c5da3de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:56.016588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556043da-7efe-4ace-bbc2-b5427c5da3de admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:56.016885 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556043da-7efe-4ace-bbc2-b5427c5da3de admin admin] PATH_INFO: `/v3/users/ed921b8887e44345ac543d4f97e74281` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:56.018896 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556043da-7efe-4ace-bbc2-b5427c5da3de admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed921b8887e44345ac543d4f97e74281)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:56.021267 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556043da-7efe-4ace-bbc2-b5427c5da3de admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:56.289823 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-556043da-7efe-4ace-bbc2-b5427c5da3de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed921b8887e44345ac543d4f97e74281'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:56.290515 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-556043da-7efe-4ace-bbc2-b5427c5da3de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed921b8887e44345ac543d4f97e74281'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:56.430404 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-556043da-7efe-4ace-bbc2-b5427c5da3de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed921b8887e44345ac543d4f97e74281'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:56.443480 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-556043da-7efe-4ace-bbc2-b5427c5da3de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed921b8887e44345ac543d4f97e74281'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:56.450223 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-556043da-7efe-4ace-bbc2-b5427c5da3de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed921b8887e44345ac543d4f97e74281'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:56.456152 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1233/2466] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:28:55 2022] DELETE /identity/v3/users/ed921b8887e44345ac543d4f97e74281 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:28:56.460763 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad5fb2-a659-41b0-ba02-210a902ca8f2 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:56.461098 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad5fb2-a659-41b0-ba02-210a902ca8f2 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:56.461383 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad5fb2-a659-41b0-ba02-210a902ca8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:56.482850 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-c5ad5fb2-a659-41b0-ba02-210a902ca8f2 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:28:56.484087 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-c5ad5fb2-a659-41b0-ba02-210a902ca8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:56.550183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1234/2467] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:28:56.560085 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556043da-7efe-4ace-bbc2-b5427c5da3de admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:56.561669 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-556043da-7efe-4ace-bbc2-b5427c5da3de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:56.627182 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556043da-7efe-4ace-bbc2-b5427c5da3de admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:56.631337 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c624c0-062c-443a-969c-05ae14f07f71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:56.632096 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c624c0-062c-443a-969c-05ae14f07f71 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:56.632382 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c624c0-062c-443a-969c-05ae14f07f71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:56.632657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c624c0-062c-443a-969c-05ae14f07f71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:56.642774 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c624c0-062c-443a-969c-05ae14f07f71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:56.644207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c624c0-062c-443a-969c-05ae14f07f71 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:56.654069 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1234/2468] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:28:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:28:57.318388 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad5fb2-a659-41b0-ba02-210a902ca8f2 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:57.319826 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-c5ad5fb2-a659-41b0-ba02-210a902ca8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:57.336309 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad5fb2-a659-41b0-ba02-210a902ca8f2 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:57.342245 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7007058-ac53-468f-875c-e1a4d41549bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:57.343120 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7007058-ac53-468f-875c-e1a4d41549bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:57.343401 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7007058-ac53-468f-875c-e1a4d41549bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:57.343686 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7007058-ac53-468f-875c-e1a4d41549bd admin admin] PATH_INFO: `/v3/projects/ccd78f6dc7614809ae7c3beeed092cdb` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:57.344923 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7007058-ac53-468f-875c-e1a4d41549bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccd78f6dc7614809ae7c3beeed092cdb)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:57.347086 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7007058-ac53-468f-875c-e1a4d41549bd admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:57.505680 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:57.518718 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f7007058-ac53-468f-875c-e1a4d41549bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccd78f6dc7614809ae7c3beeed092cdb', 'request_id': 'req-f7007058-ac53-468f-875c-e1a4d41549bd'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:57.525105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f7007058-ac53-468f-875c-e1a4d41549bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccd78f6dc7614809ae7c3beeed092cdb', 'request_id': 'req-f7007058-ac53-468f-875c-e1a4d41549bd'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:57.642299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f7007058-ac53-468f-875c-e1a4d41549bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccd78f6dc7614809ae7c3beeed092cdb', 'request_id': 'req-f7007058-ac53-468f-875c-e1a4d41549bd'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:57.654266 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f7007058-ac53-468f-875c-e1a4d41549bd admin admin] The token cache is being invalidate because project ccd78f6dc7614809ae7c3beeed092cdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:28:57.654574 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f7007058-ac53-468f-875c-e1a4d41549bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:57.655743 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f7007058-ac53-468f-875c-e1a4d41549bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:57.657466 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1235/2469] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:28:57 2022] DELETE /identity/v3/projects/ccd78f6dc7614809ae7c3beeed092cdb => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:28:57.663063 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fb5b0-1c43-4761-9f70-ca72fddd1a9e None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:57.663535 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fb5b0-1c43-4761-9f70-ca72fddd1a9e None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:57.663738 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fb5b0-1c43-4761-9f70-ca72fddd1a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:57.685793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-c37fb5b0-1c43-4761-9f70-ca72fddd1a9e None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:28:57.687032 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-c37fb5b0-1c43-4761-9f70-ca72fddd1a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:57.719159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:57.749364 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1235/2470] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:28:57.757385 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c25ab-7afd-435a-917c-34cbe0fd5dd5 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:57.757794 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c25ab-7afd-435a-917c-34cbe0fd5dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:57.758075 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c25ab-7afd-435a-917c-34cbe0fd5dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:57.777227 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-740c25ab-7afd-435a-917c-34cbe0fd5dd5 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:28:57.778550 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-740c25ab-7afd-435a-917c-34cbe0fd5dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:57.787774 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1236/2471] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:28:57.792329 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37fb5b0-1c43-4761-9f70-ca72fddd1a9e None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:57.802283 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37fb5b0-1c43-4761-9f70-ca72fddd1a9e None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:57.807309 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c802fe-8bc6-4615-a83b-c7b53b4af856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:57.807912 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c802fe-8bc6-4615-a83b-c7b53b4af856 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:57.808198 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c802fe-8bc6-4615-a83b-c7b53b4af856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:57.808491 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c802fe-8bc6-4615-a83b-c7b53b4af856 admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:57.809259 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c802fe-8bc6-4615-a83b-c7b53b4af856 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:28:57.809572 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c802fe-8bc6-4615-a83b-c7b53b4af856 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:57.811184 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c802fe-8bc6-4615-a83b-c7b53b4af856 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:57.824355 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1236/2472] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:28:57.828498 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c25ab-7afd-435a-917c-34cbe0fd5dd5 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:57.842742 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c25ab-7afd-435a-917c-34cbe0fd5dd5 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:57.848026 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5f7c6-8875-4268-ae1d-8e4e886f78b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:57.848683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5f7c6-8875-4268-ae1d-8e4e886f78b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:57.849015 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5f7c6-8875-4268-ae1d-8e4e886f78b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:57.849287 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5f7c6-8875-4268-ae1d-8e4e886f78b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:57.849995 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5f7c6-8875-4268-ae1d-8e4e886f78b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:57.851974 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5f7c6-8875-4268-ae1d-8e4e886f78b1 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:57.946438 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1237/2473] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:28:57 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:28:57.950982 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c802fe-8bc6-4615-a83b-c7b53b4af856 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:57.961837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c802fe-8bc6-4615-a83b-c7b53b4af856 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:58.018473 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13b048-c23e-4636-b6ae-5f993954548c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:58.019235 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13b048-c23e-4636-b6ae-5f993954548c admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:58.019525 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13b048-c23e-4636-b6ae-5f993954548c admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:58.019807 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13b048-c23e-4636-b6ae-5f993954548c admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:58.020532 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13b048-c23e-4636-b6ae-5f993954548c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:58.022497 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13b048-c23e-4636-b6ae-5f993954548c admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:58.163593 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1237/2474] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:28:57 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:28:58.166988 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5f7c6-8875-4268-ae1d-8e4e886f78b1 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:58.177162 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5f7c6-8875-4268-ae1d-8e4e886f78b1 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:58.181719 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbefa15-9187-4882-a19a-861fbaf296d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:58.182379 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbefa15-9187-4882-a19a-861fbaf296d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:58.182663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbefa15-9187-4882-a19a-861fbaf296d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:58.182938 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbefa15-9187-4882-a19a-861fbaf296d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:58.183662 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbefa15-9187-4882-a19a-861fbaf296d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:58.185318 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbefa15-9187-4882-a19a-861fbaf296d8 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:58.196239 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1238/2475] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:28:58.205471 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13b048-c23e-4636-b6ae-5f993954548c admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:58.215598 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13b048-c23e-4636-b6ae-5f993954548c admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:58.220302 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505641ed-bd6b-4939-aba5-2083e116f3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:58.221003 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505641ed-bd6b-4939-aba5-2083e116f3fe admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:58.221290 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505641ed-bd6b-4939-aba5-2083e116f3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:58.221564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505641ed-bd6b-4939-aba5-2083e116f3fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:58.222347 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505641ed-bd6b-4939-aba5-2083e116f3fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:58.223963 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505641ed-bd6b-4939-aba5-2083e116f3fe admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:58.233960 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1238/2476] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:28:58.238099 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbefa15-9187-4882-a19a-861fbaf296d8 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:58.248027 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbefa15-9187-4882-a19a-861fbaf296d8 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:58.253174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb3bdb-cf05-45ab-baa3-bfdb3317d5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:58.254045 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb3bdb-cf05-45ab-baa3-bfdb3317d5ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:58.254329 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb3bdb-cf05-45ab-baa3-bfdb3317d5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:58.254603 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb3bdb-cf05-45ab-baa3-bfdb3317d5ea admin admin] PATH_INFO: `/v3/projects/4bd065ea683545f4b1c006192c20f802/users/bcf5fd8e8cb04431b1a04c624a511e2b/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:58.270178 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb3bdb-cf05-45ab-baa3-bfdb3317d5ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bd065ea683545f4b1c006192c20f802, user_id=bcf5fd8e8cb04431b1a04c624a511e2b, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:58.272896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb3bdb-cf05-45ab-baa3-bfdb3317d5ea admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:58.397581 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1239/2477] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:28:58 2022] PUT /identity/v3/projects/4bd065ea683545f4b1c006192c20f802/users/bcf5fd8e8cb04431b1a04c624a511e2b/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:28:58.409569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca996122-7ef8-43f4-8d51-bf635844b64a None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:58.409859 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca996122-7ef8-43f4-8d51-bf635844b64a None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:58.410144 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca996122-7ef8-43f4-8d51-bf635844b64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:58.437132 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-ca996122-7ef8-43f4-8d51-bf635844b64a None None] MFA Rules not processed for user `bcf5fd8e8cb04431b1a04c624a511e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:28:58.438269 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-ca996122-7ef8-43f4-8d51-bf635844b64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:58.502096 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1239/2478] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:28:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:28:58.509153 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb3bdb-cf05-45ab-baa3-bfdb3317d5ea admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:58.579825 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb3bdb-cf05-45ab-baa3-bfdb3317d5ea admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:58.584478 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9bf5c-9c65-4d35-b69b-ad2fd5e6aa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:58.585167 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9bf5c-9c65-4d35-b69b-ad2fd5e6aa68 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:58.585453 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9bf5c-9c65-4d35-b69b-ad2fd5e6aa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:58.585740 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9bf5c-9c65-4d35-b69b-ad2fd5e6aa68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:58.586434 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9bf5c-9c65-4d35-b69b-ad2fd5e6aa68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:58.588354 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9bf5c-9c65-4d35-b69b-ad2fd5e6aa68 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:58.769848 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1240/2479] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:28:58 2022] POST /identity/v3/projects => generated 385 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:28:58.773798 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca996122-7ef8-43f4-8d51-bf635844b64a None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:58.785224 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca996122-7ef8-43f4-8d51-bf635844b64a None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:58.812967 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:58.847040 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c44b1-ad01-446e-b550-30f3ec8752c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:58.847732 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c44b1-ad01-446e-b550-30f3ec8752c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:58.848057 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c44b1-ad01-446e-b550-30f3ec8752c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:58.848423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c44b1-ad01-446e-b550-30f3ec8752c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:58.849187 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c44b1-ad01-446e-b550-30f3ec8752c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:58.852084 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c44b1-ad01-446e-b550-30f3ec8752c0 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:59.015005 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1240/2480] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:28:58 2022] POST /identity/v3/users => generated 299 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:28:59.019685 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9bf5c-9c65-4d35-b69b-ad2fd5e6aa68 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:59.030298 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9bf5c-9c65-4d35-b69b-ad2fd5e6aa68 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:59.035556 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372acff-8746-4bcc-b772-851e087c32b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:59.036216 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372acff-8746-4bcc-b772-851e087c32b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:59.036502 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372acff-8746-4bcc-b772-851e087c32b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:59.036787 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372acff-8746-4bcc-b772-851e087c32b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:59.037546 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372acff-8746-4bcc-b772-851e087c32b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:59.039159 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372acff-8746-4bcc-b772-851e087c32b9 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:59.049661 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1241/2481] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:28:59.053813 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c44b1-ad01-446e-b550-30f3ec8752c0 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:59.064177 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c44b1-ad01-446e-b550-30f3ec8752c0 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:59.068672 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083240de-20a2-4937-bddd-3ffb2996ef02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:59.069616 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083240de-20a2-4937-bddd-3ffb2996ef02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:59.069893 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083240de-20a2-4937-bddd-3ffb2996ef02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:59.070228 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083240de-20a2-4937-bddd-3ffb2996ef02 admin admin] PATH_INFO: `/v3/projects/0b5e8f3b28f940e4b07dd4fa01c66d6e/users/0f9122f9b7d94d0e9f907d7f4a3cca16/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:59.085395 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083240de-20a2-4937-bddd-3ffb2996ef02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b5e8f3b28f940e4b07dd4fa01c66d6e, user_id=0f9122f9b7d94d0e9f907d7f4a3cca16, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:59.088140 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083240de-20a2-4937-bddd-3ffb2996ef02 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:59.213639 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1241/2482] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:28:59 2022] PUT /identity/v3/projects/0b5e8f3b28f940e4b07dd4fa01c66d6e/users/0f9122f9b7d94d0e9f907d7f4a3cca16/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:28:59.217847 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372acff-8746-4bcc-b772-851e087c32b9 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:59.228007 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372acff-8746-4bcc-b772-851e087c32b9 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:59.254832 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:59.285285 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7b625-52c8-4e26-86d8-04542167034d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:59.285877 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7b625-52c8-4e26-86d8-04542167034d admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:59.286164 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7b625-52c8-4e26-86d8-04542167034d admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:59.286444 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7b625-52c8-4e26-86d8-04542167034d admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:59.287177 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7b625-52c8-4e26-86d8-04542167034d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:59.288791 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7b625-52c8-4e26-86d8-04542167034d admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:59.299145 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1242/2483] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:28:59.303471 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083240de-20a2-4937-bddd-3ffb2996ef02 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:59.313711 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083240de-20a2-4937-bddd-3ffb2996ef02 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:59.319071 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347a3f1-2250-4fd8-8b02-272866da33c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:59.319956 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347a3f1-2250-4fd8-8b02-272866da33c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:59.320245 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347a3f1-2250-4fd8-8b02-272866da33c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:59.320520 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347a3f1-2250-4fd8-8b02-272866da33c5 admin admin] PATH_INFO: `/v3/projects/0b5e8f3b28f940e4b07dd4fa01c66d6e/users/0f9122f9b7d94d0e9f907d7f4a3cca16/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:59.322539 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347a3f1-2250-4fd8-8b02-272866da33c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b5e8f3b28f940e4b07dd4fa01c66d6e, user_id=0f9122f9b7d94d0e9f907d7f4a3cca16, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:59.325296 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347a3f1-2250-4fd8-8b02-272866da33c5 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:59.335829 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1242/2484] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:28:59 2022] PUT /identity/v3/projects/0b5e8f3b28f940e4b07dd4fa01c66d6e/users/0f9122f9b7d94d0e9f907d7f4a3cca16/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:28:59.346126 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e84bd-3a68-446c-a59e-9cf1e7d4ca31 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:59.346561 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e84bd-3a68-446c-a59e-9cf1e7d4ca31 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:59.346850 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e84bd-3a68-446c-a59e-9cf1e7d4ca31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:59.375785 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-736e84bd-3a68-446c-a59e-9cf1e7d4ca31 None None] MFA Rules not processed for user `0f9122f9b7d94d0e9f907d7f4a3cca16`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:28:59.377635 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-736e84bd-3a68-446c-a59e-9cf1e7d4ca31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:59.445444 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1243/2485] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:28:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:28:59.456723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347a3f1-2250-4fd8-8b02-272866da33c5 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:59.458445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-3347a3f1-2250-4fd8-8b02-272866da33c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:59.514663 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347a3f1-2250-4fd8-8b02-272866da33c5 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:59.518324 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65f0eb-c435-4c09-a4ab-255e39866aed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:59.518966 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65f0eb-c435-4c09-a4ab-255e39866aed service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:59.519249 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65f0eb-c435-4c09-a4ab-255e39866aed service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:59.519531 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65f0eb-c435-4c09-a4ab-255e39866aed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:59.528561 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65f0eb-c435-4c09-a4ab-255e39866aed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:59.530112 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65f0eb-c435-4c09-a4ab-255e39866aed service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:59.540401 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1243/2486] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:28:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:28:59.568780 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e84bd-3a68-446c-a59e-9cf1e7d4ca31 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:59.629434 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e84bd-3a68-446c-a59e-9cf1e7d4ca31 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:59.634112 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976490a-38be-420d-9822-b02b20030685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:59.634969 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976490a-38be-420d-9822-b02b20030685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:59.635271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976490a-38be-420d-9822-b02b20030685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:59.635538 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976490a-38be-420d-9822-b02b20030685 admin admin] PATH_INFO: `/v3/users/bcf5fd8e8cb04431b1a04c624a511e2b` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:59.636722 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976490a-38be-420d-9822-b02b20030685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcf5fd8e8cb04431b1a04c624a511e2b)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:59.638659 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976490a-38be-420d-9822-b02b20030685 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:59.810053 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-4976490a-38be-420d-9822-b02b20030685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcf5fd8e8cb04431b1a04c624a511e2b'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:59.814283 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:59.823536 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-4976490a-38be-420d-9822-b02b20030685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcf5fd8e8cb04431b1a04c624a511e2b'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:59.876018 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-4976490a-38be-420d-9822-b02b20030685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcf5fd8e8cb04431b1a04c624a511e2b'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:59.876713 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-4976490a-38be-420d-9822-b02b20030685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcf5fd8e8cb04431b1a04c624a511e2b'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:59.884148 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-4976490a-38be-420d-9822-b02b20030685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcf5fd8e8cb04431b1a04c624a511e2b'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:59.890122 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1244/2487] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:28:59 2022] DELETE /identity/v3/users/bcf5fd8e8cb04431b1a04c624a511e2b => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:28:59.894742 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2193c5-338f-4e01-9b6a-11658bef7115 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:59.895275 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2193c5-338f-4e01-9b6a-11658bef7115 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:59.895381 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2193c5-338f-4e01-9b6a-11658bef7115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:59.915731 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-ba2193c5-338f-4e01-9b6a-11658bef7115 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:28:59.916973 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-ba2193c5-338f-4e01-9b6a-11658bef7115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:59.978035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1244/2488] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:28:59.987772 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976490a-38be-420d-9822-b02b20030685 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:59.989252 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-4976490a-38be-420d-9822-b02b20030685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:00.050149 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976490a-38be-420d-9822-b02b20030685 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:00.053980 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2683395-1c7e-4a6e-b7e6-fa1ac6e7223a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:00.054646 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2683395-1c7e-4a6e-b7e6-fa1ac6e7223a service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:00.054928 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2683395-1c7e-4a6e-b7e6-fa1ac6e7223a service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:00.055206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2683395-1c7e-4a6e-b7e6-fa1ac6e7223a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:00.065598 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2683395-1c7e-4a6e-b7e6-fa1ac6e7223a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:00.067019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2683395-1c7e-4a6e-b7e6-fa1ac6e7223a service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:00.077200 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1245/2489] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:28:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:29:00.462276 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2193c5-338f-4e01-9b6a-11658bef7115 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:00.464309 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-ba2193c5-338f-4e01-9b6a-11658bef7115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:00.484551 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2193c5-338f-4e01-9b6a-11658bef7115 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:00.492116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782bf2f-7871-4faa-8606-c42c03f136bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:00.494088 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782bf2f-7871-4faa-8606-c42c03f136bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:00.494949 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782bf2f-7871-4faa-8606-c42c03f136bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:00.495163 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782bf2f-7871-4faa-8606-c42c03f136bf admin admin] PATH_INFO: `/v3/projects/4bd065ea683545f4b1c006192c20f802` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:00.498365 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782bf2f-7871-4faa-8606-c42c03f136bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bd065ea683545f4b1c006192c20f802)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:00.500707 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782bf2f-7871-4faa-8606-c42c03f136bf admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:00.525397 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:00.619012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-6782bf2f-7871-4faa-8606-c42c03f136bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bd065ea683545f4b1c006192c20f802', 'request_id': 'req-6782bf2f-7871-4faa-8606-c42c03f136bf'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:00.624383 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-6782bf2f-7871-4faa-8606-c42c03f136bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bd065ea683545f4b1c006192c20f802', 'request_id': 'req-6782bf2f-7871-4faa-8606-c42c03f136bf'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:00.743994 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-6782bf2f-7871-4faa-8606-c42c03f136bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bd065ea683545f4b1c006192c20f802', 'request_id': 'req-6782bf2f-7871-4faa-8606-c42c03f136bf'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:00.756500 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-6782bf2f-7871-4faa-8606-c42c03f136bf admin admin] The token cache is being invalidate because project 4bd065ea683545f4b1c006192c20f802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:29:00.765279 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-6782bf2f-7871-4faa-8606-c42c03f136bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:00.765279 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-6782bf2f-7871-4faa-8606-c42c03f136bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:00.765279 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1245/2490] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:29:00 2022] DELETE /identity/v3/projects/4bd065ea683545f4b1c006192c20f802 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:00.765584 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2683395-1c7e-4a6e-b7e6-fa1ac6e7223a service neutron] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:00.773441 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2683395-1c7e-4a6e-b7e6-fa1ac6e7223a service neutron] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:00.832095 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a6c50-1199-4f61-88ff-6a7ef6b6d834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:00.833113 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a6c50-1199-4f61-88ff-6a7ef6b6d834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:00.833398 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a6c50-1199-4f61-88ff-6a7ef6b6d834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:00.833669 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a6c50-1199-4f61-88ff-6a7ef6b6d834 admin admin] PATH_INFO: `/v3/users/0f9122f9b7d94d0e9f907d7f4a3cca16` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:00.834862 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a6c50-1199-4f61-88ff-6a7ef6b6d834 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f9122f9b7d94d0e9f907d7f4a3cca16)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:00.836775 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a6c50-1199-4f61-88ff-6a7ef6b6d834 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:01.051263 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-355a6c50-1199-4f61-88ff-6a7ef6b6d834 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f9122f9b7d94d0e9f907d7f4a3cca16'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:01.063081 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-355a6c50-1199-4f61-88ff-6a7ef6b6d834 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f9122f9b7d94d0e9f907d7f4a3cca16'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:01.127149 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-355a6c50-1199-4f61-88ff-6a7ef6b6d834 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f9122f9b7d94d0e9f907d7f4a3cca16'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:01.127807 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-355a6c50-1199-4f61-88ff-6a7ef6b6d834 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f9122f9b7d94d0e9f907d7f4a3cca16'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:01.130556 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:01.136108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-355a6c50-1199-4f61-88ff-6a7ef6b6d834 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f9122f9b7d94d0e9f907d7f4a3cca16'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:01.142799 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1246/2491] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:29:00 2022] DELETE /identity/v3/users/0f9122f9b7d94d0e9f907d7f4a3cca16 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:01.591667 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782bf2f-7871-4faa-8606-c42c03f136bf admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:01.593172 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-6782bf2f-7871-4faa-8606-c42c03f136bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:01.606559 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782bf2f-7871-4faa-8606-c42c03f136bf admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:01.665007 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f54797-aae5-4e06-9c47-6552d2c8b6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:01.665870 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f54797-aae5-4e06-9c47-6552d2c8b6f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:01.666153 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f54797-aae5-4e06-9c47-6552d2c8b6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:01.666430 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f54797-aae5-4e06-9c47-6552d2c8b6f3 admin admin] PATH_INFO: `/v3/projects/0b5e8f3b28f940e4b07dd4fa01c66d6e` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:01.667619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f54797-aae5-4e06-9c47-6552d2c8b6f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b5e8f3b28f940e4b07dd4fa01c66d6e)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:01.669584 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f54797-aae5-4e06-9c47-6552d2c8b6f3 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:01.761981 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-65f54797-aae5-4e06-9c47-6552d2c8b6f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b5e8f3b28f940e4b07dd4fa01c66d6e', 'request_id': 'req-65f54797-aae5-4e06-9c47-6552d2c8b6f3'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:01.767728 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-65f54797-aae5-4e06-9c47-6552d2c8b6f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b5e8f3b28f940e4b07dd4fa01c66d6e', 'request_id': 'req-65f54797-aae5-4e06-9c47-6552d2c8b6f3'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:01.823558 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-65f54797-aae5-4e06-9c47-6552d2c8b6f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b5e8f3b28f940e4b07dd4fa01c66d6e', 'request_id': 'req-65f54797-aae5-4e06-9c47-6552d2c8b6f3'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:01.838159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-65f54797-aae5-4e06-9c47-6552d2c8b6f3 admin admin] The token cache is being invalidate because project 0b5e8f3b28f940e4b07dd4fa01c66d6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:29:01.838159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-65f54797-aae5-4e06-9c47-6552d2c8b6f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:01.838159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-65f54797-aae5-4e06-9c47-6552d2c8b6f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:01.838159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1246/2492] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:29:01 2022] DELETE /identity/v3/projects/0b5e8f3b28f940e4b07dd4fa01c66d6e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:01.842329 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a86c2-f3ac-4c07-9711-239753b11243 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:01.842791 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a86c2-f3ac-4c07-9711-239753b11243 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:01.842886 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a86c2-f3ac-4c07-9711-239753b11243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:01.861894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-ac0a86c2-f3ac-4c07-9711-239753b11243 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:01.863146 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-ac0a86c2-f3ac-4c07-9711-239753b11243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:01.920713 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1247/2493] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:01.929135 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981dcec-b5e2-4b1a-b55b-32590aeda558 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:01.929420 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981dcec-b5e2-4b1a-b55b-32590aeda558 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:01.929695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981dcec-b5e2-4b1a-b55b-32590aeda558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:01.948230 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-c981dcec-b5e2-4b1a-b55b-32590aeda558 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:01.949513 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-c981dcec-b5e2-4b1a-b55b-32590aeda558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:01.957715 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1247/2494] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:01.961840 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a86c2-f3ac-4c07-9711-239753b11243 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:01.971968 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a86c2-f3ac-4c07-9711-239753b11243 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:01.979255 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd8d23-b72e-4e07-9c34-39f3dd1e0f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:01.979255 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd8d23-b72e-4e07-9c34-39f3dd1e0f42 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:01.979255 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd8d23-b72e-4e07-9c34-39f3dd1e0f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:01.979255 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd8d23-b72e-4e07-9c34-39f3dd1e0f42 admin admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:01.979698 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd8d23-b72e-4e07-9c34-39f3dd1e0f42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:29:01.979698 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd8d23-b72e-4e07-9c34-39f3dd1e0f42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:01.980521 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd8d23-b72e-4e07-9c34-39f3dd1e0f42 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:01.992778 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1248/2495] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:29:01.997109 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981dcec-b5e2-4b1a-b55b-32590aeda558 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:02.006287 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981dcec-b5e2-4b1a-b55b-32590aeda558 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:02.010997 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee4176-c484-4344-9bea-a9078e7362ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:02.011650 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee4176-c484-4344-9bea-a9078e7362ac admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:02.011935 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee4176-c484-4344-9bea-a9078e7362ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:02.012235 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee4176-c484-4344-9bea-a9078e7362ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:02.012947 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee4176-c484-4344-9bea-a9078e7362ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:02.014867 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee4176-c484-4344-9bea-a9078e7362ac admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:02.192615 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1248/2496] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:29:01 2022] POST /identity/v3/projects => generated 387 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:29:02.196682 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd8d23-b72e-4e07-9c34-39f3dd1e0f42 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:02.207906 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd8d23-b72e-4e07-9c34-39f3dd1e0f42 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:02.263823 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7fbe3-1cff-4937-b0c4-c93a8eb4a35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:02.264478 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7fbe3-1cff-4937-b0c4-c93a8eb4a35a admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:02.264769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7fbe3-1cff-4937-b0c4-c93a8eb4a35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:02.265078 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7fbe3-1cff-4937-b0c4-c93a8eb4a35a admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:02.265780 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7fbe3-1cff-4937-b0c4-c93a8eb4a35a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:02.268273 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7fbe3-1cff-4937-b0c4-c93a8eb4a35a admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:02.356305 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1249/2497] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:29:02 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:29:02.360326 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee4176-c484-4344-9bea-a9078e7362ac admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:02.371225 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee4176-c484-4344-9bea-a9078e7362ac admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:02.375878 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bd53b-7a5d-4e5d-b908-16b3ba1db3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:02.376550 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bd53b-7a5d-4e5d-b908-16b3ba1db3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:02.377218 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bd53b-7a5d-4e5d-b908-16b3ba1db3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:02.377218 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bd53b-7a5d-4e5d-b908-16b3ba1db3a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:02.377218 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94bd53b-7a5d-4e5d-b908-16b3ba1db3a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:02.377218 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94bd53b-7a5d-4e5d-b908-16b3ba1db3a1 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:02.377218 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:02.392696 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1249/2498] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:29:02.396853 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7fbe3-1cff-4937-b0c4-c93a8eb4a35a admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:02.411568 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7fbe3-1cff-4937-b0c4-c93a8eb4a35a admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:02.416525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2fa65-a236-4ab3-a730-858d05577e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:02.417237 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2fa65-a236-4ab3-a730-858d05577e17 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:02.417570 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2fa65-a236-4ab3-a730-858d05577e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:02.417804 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2fa65-a236-4ab3-a730-858d05577e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:02.418549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2fa65-a236-4ab3-a730-858d05577e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:02.420174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2fa65-a236-4ab3-a730-858d05577e17 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:02.433386 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1250/2499] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:29:02.437525 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bd53b-7a5d-4e5d-b908-16b3ba1db3a1 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:02.453451 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bd53b-7a5d-4e5d-b908-16b3ba1db3a1 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:02.455288 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e85660-4d7e-48dc-8976-5b0c3777accf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:02.456180 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e85660-4d7e-48dc-8976-5b0c3777accf admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:02.456462 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e85660-4d7e-48dc-8976-5b0c3777accf admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:02.456738 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e85660-4d7e-48dc-8976-5b0c3777accf admin admin] PATH_INFO: `/v3/projects/d3062cb06f4a4baa9ef7819c79eff918/users/97841676bff44c529f59da537765ad54/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:02.472936 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e85660-4d7e-48dc-8976-5b0c3777accf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3062cb06f4a4baa9ef7819c79eff918, user_id=97841676bff44c529f59da537765ad54, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:02.475704 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e85660-4d7e-48dc-8976-5b0c3777accf admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:02.540496 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1250/2500] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:29:02 2022] PUT /identity/v3/projects/d3062cb06f4a4baa9ef7819c79eff918/users/97841676bff44c529f59da537765ad54/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:29:02.551655 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9ad1c-6996-4a0e-9b80-1760b383506d None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:02.551945 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9ad1c-6996-4a0e-9b80-1760b383506d None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:02.552228 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9ad1c-6996-4a0e-9b80-1760b383506d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:02.580393 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-30e9ad1c-6996-4a0e-9b80-1760b383506d None None] MFA Rules not processed for user `97841676bff44c529f59da537765ad54`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:02.581647 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-30e9ad1c-6996-4a0e-9b80-1760b383506d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:02.629929 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:02.649729 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1251/2501] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:29:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:02.654816 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e85660-4d7e-48dc-8976-5b0c3777accf admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:02.718804 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e85660-4d7e-48dc-8976-5b0c3777accf admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:02.724700 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248545f8-7a3e-45cc-ab45-0c26508b7df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:02.725407 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248545f8-7a3e-45cc-ab45-0c26508b7df4 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:02.725694 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248545f8-7a3e-45cc-ab45-0c26508b7df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:02.725972 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248545f8-7a3e-45cc-ab45-0c26508b7df4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:02.726663 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248545f8-7a3e-45cc-ab45-0c26508b7df4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:02.728555 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248545f8-7a3e-45cc-ab45-0c26508b7df4 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:02.819948 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1251/2502] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:29:02 2022] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:29:02.823893 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9ad1c-6996-4a0e-9b80-1760b383506d None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:02.835441 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9ad1c-6996-4a0e-9b80-1760b383506d None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:02.890872 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231ab5e-1a50-499a-91dc-4cc84db8d345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:02.894835 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231ab5e-1a50-499a-91dc-4cc84db8d345 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:02.894835 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231ab5e-1a50-499a-91dc-4cc84db8d345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:02.894835 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231ab5e-1a50-499a-91dc-4cc84db8d345 admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:02.894835 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231ab5e-1a50-499a-91dc-4cc84db8d345 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:02.895424 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231ab5e-1a50-499a-91dc-4cc84db8d345 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:02.991667 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1252/2503] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:29:02 2022] POST /identity/v3/users => generated 294 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:29:02.995648 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248545f8-7a3e-45cc-ab45-0c26508b7df4 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:03.006728 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248545f8-7a3e-45cc-ab45-0c26508b7df4 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:03.011421 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c76695-0f33-49c4-9839-fb26b6bf812b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:03.012085 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c76695-0f33-49c4-9839-fb26b6bf812b admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:03.012373 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c76695-0f33-49c4-9839-fb26b6bf812b admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:03.012652 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c76695-0f33-49c4-9839-fb26b6bf812b admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:03.013419 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c76695-0f33-49c4-9839-fb26b6bf812b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:03.015029 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c76695-0f33-49c4-9839-fb26b6bf812b admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:03.026085 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1252/2504] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:29:03.030126 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231ab5e-1a50-499a-91dc-4cc84db8d345 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:03.040741 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231ab5e-1a50-499a-91dc-4cc84db8d345 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:03.045827 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b096ca4-c4c8-40a3-afe4-f96ed2916721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:03.053051 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b096ca4-c4c8-40a3-afe4-f96ed2916721 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:03.053051 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b096ca4-c4c8-40a3-afe4-f96ed2916721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:03.053051 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b096ca4-c4c8-40a3-afe4-f96ed2916721 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:03.053051 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b096ca4-c4c8-40a3-afe4-f96ed2916721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:03.053051 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b096ca4-c4c8-40a3-afe4-f96ed2916721 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:03.060282 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1253/2505] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:29:03.065991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c76695-0f33-49c4-9839-fb26b6bf812b admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:03.076185 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c76695-0f33-49c4-9839-fb26b6bf812b admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:03.080969 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94534f-cb64-46fb-8cc3-6b63f204799a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:03.081846 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94534f-cb64-46fb-8cc3-6b63f204799a admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:03.082132 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94534f-cb64-46fb-8cc3-6b63f204799a admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:03.082409 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94534f-cb64-46fb-8cc3-6b63f204799a admin admin] PATH_INFO: `/v3/projects/115b0599629747338f2755c36d24094a/users/916122a2ffb14e39924c96abb6f6d62d/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:03.096983 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94534f-cb64-46fb-8cc3-6b63f204799a admin admin] RBAC: Authorizing `identity:create_grant(project_id=115b0599629747338f2755c36d24094a, user_id=916122a2ffb14e39924c96abb6f6d62d, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:03.105892 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94534f-cb64-46fb-8cc3-6b63f204799a admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:03.190952 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1253/2506] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:29:03 2022] PUT /identity/v3/projects/115b0599629747338f2755c36d24094a/users/916122a2ffb14e39924c96abb6f6d62d/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:03.201812 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae72a99-cd3a-484d-a877-abe2cecc4caf None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:03.203208 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae72a99-cd3a-484d-a877-abe2cecc4caf None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:03.203208 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae72a99-cd3a-484d-a877-abe2cecc4caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:03.228915 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-8ae72a99-cd3a-484d-a877-abe2cecc4caf None None] MFA Rules not processed for user `916122a2ffb14e39924c96abb6f6d62d`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:03.230138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-8ae72a99-cd3a-484d-a877-abe2cecc4caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:03.294525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1254/2507] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:29:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:03.299611 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94534f-cb64-46fb-8cc3-6b63f204799a admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:03.376157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94534f-cb64-46fb-8cc3-6b63f204799a admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:03.384248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d87008-87f0-4a9f-98dd-61b727bf2207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:03.385396 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d87008-87f0-4a9f-98dd-61b727bf2207 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:03.385872 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d87008-87f0-4a9f-98dd-61b727bf2207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:03.386361 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d87008-87f0-4a9f-98dd-61b727bf2207 admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:03.387615 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d87008-87f0-4a9f-98dd-61b727bf2207 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:03.391468 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d87008-87f0-4a9f-98dd-61b727bf2207 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:03.503919 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1254/2508] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:29:03 2022] POST /identity/v3/projects => generated 385 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:29:03.505181 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae72a99-cd3a-484d-a877-abe2cecc4caf None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:03.516167 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae72a99-cd3a-484d-a877-abe2cecc4caf None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:03.568460 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:03.575409 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a4390-0d1c-4b87-ac26-4d9930042d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:03.576315 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a4390-0d1c-4b87-ac26-4d9930042d33 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:03.576656 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a4390-0d1c-4b87-ac26-4d9930042d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:03.576893 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a4390-0d1c-4b87-ac26-4d9930042d33 admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:03.577588 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a4390-0d1c-4b87-ac26-4d9930042d33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:03.579515 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a4390-0d1c-4b87-ac26-4d9930042d33 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:03.705409 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1255/2509] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:29:03 2022] POST /identity/v3/users => generated 299 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:29:03.709022 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d87008-87f0-4a9f-98dd-61b727bf2207 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:03.719197 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d87008-87f0-4a9f-98dd-61b727bf2207 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:03.724343 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a11a3-1e0b-48f5-a483-69c3acbf4524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:03.725026 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a11a3-1e0b-48f5-a483-69c3acbf4524 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:03.725307 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a11a3-1e0b-48f5-a483-69c3acbf4524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:03.725664 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a11a3-1e0b-48f5-a483-69c3acbf4524 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:03.726387 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a11a3-1e0b-48f5-a483-69c3acbf4524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:03.727970 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a11a3-1e0b-48f5-a483-69c3acbf4524 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:03.730105 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:03.739878 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1255/2510] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:29:03.744140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a4390-0d1c-4b87-ac26-4d9930042d33 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:03.754254 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a4390-0d1c-4b87-ac26-4d9930042d33 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:03.759025 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2cbc1e-f76d-4ff4-9170-5150186f7827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:03.762397 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cbc1e-f76d-4ff4-9170-5150186f7827 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:03.762397 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cbc1e-f76d-4ff4-9170-5150186f7827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:03.762397 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cbc1e-f76d-4ff4-9170-5150186f7827 admin admin] PATH_INFO: `/v3/projects/d91b2069df63486fa06a65a1457a2f87/users/242b21f3ab614ff0b009bf8650600e32/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:03.775762 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2cbc1e-f76d-4ff4-9170-5150186f7827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d91b2069df63486fa06a65a1457a2f87, user_id=242b21f3ab614ff0b009bf8650600e32, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:03.778596 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2cbc1e-f76d-4ff4-9170-5150186f7827 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:03.864966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1256/2511] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:29:03 2022] PUT /identity/v3/projects/d91b2069df63486fa06a65a1457a2f87/users/242b21f3ab614ff0b009bf8650600e32/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:29:03.868933 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a11a3-1e0b-48f5-a483-69c3acbf4524 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:03.881193 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a11a3-1e0b-48f5-a483-69c3acbf4524 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:03.934480 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a90c0-e64c-4a5d-8e40-3d2544f51ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:03.935162 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a90c0-e64c-4a5d-8e40-3d2544f51ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:03.935446 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a90c0-e64c-4a5d-8e40-3d2544f51ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:03.935730 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a90c0-e64c-4a5d-8e40-3d2544f51ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:03.936485 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a90c0-e64c-4a5d-8e40-3d2544f51ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:03.938133 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a90c0-e64c-4a5d-8e40-3d2544f51ae1 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:03.948461 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1256/2512] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:29:03.952845 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2cbc1e-f76d-4ff4-9170-5150186f7827 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:03.964300 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2cbc1e-f76d-4ff4-9170-5150186f7827 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:03.969487 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e31f6d-cae1-488c-9ea4-450a35730eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:03.970922 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e31f6d-cae1-488c-9ea4-450a35730eb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:03.971202 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e31f6d-cae1-488c-9ea4-450a35730eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:03.971479 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e31f6d-cae1-488c-9ea4-450a35730eb9 admin admin] PATH_INFO: `/v3/projects/d91b2069df63486fa06a65a1457a2f87/users/242b21f3ab614ff0b009bf8650600e32/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:03.973494 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e31f6d-cae1-488c-9ea4-450a35730eb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d91b2069df63486fa06a65a1457a2f87, user_id=242b21f3ab614ff0b009bf8650600e32, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:03.976612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e31f6d-cae1-488c-9ea4-450a35730eb9 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:03.988065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1257/2513] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:29:03 2022] PUT /identity/v3/projects/d91b2069df63486fa06a65a1457a2f87/users/242b21f3ab614ff0b009bf8650600e32/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:04.003654 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cf152-18ce-480c-bb40-2177dc079101 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:04.003963 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cf152-18ce-480c-bb40-2177dc079101 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:04.004245 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cf152-18ce-480c-bb40-2177dc079101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:04.033064 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-3c0cf152-18ce-480c-bb40-2177dc079101 None None] MFA Rules not processed for user `242b21f3ab614ff0b009bf8650600e32`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:04.034559 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-3c0cf152-18ce-480c-bb40-2177dc079101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:04.104479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1257/2514] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:29:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:29:04.119368 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e31f6d-cae1-488c-9ea4-450a35730eb9 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:04.121105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-56e31f6d-cae1-488c-9ea4-450a35730eb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:04.183242 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e31f6d-cae1-488c-9ea4-450a35730eb9 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:04.187400 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1341a-b01e-4008-8c57-4c3ff25b50e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:04.188086 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1341a-b01e-4008-8c57-4c3ff25b50e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:04.188369 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1341a-b01e-4008-8c57-4c3ff25b50e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:04.189884 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1341a-b01e-4008-8c57-4c3ff25b50e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:04.199362 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db1341a-b01e-4008-8c57-4c3ff25b50e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:04.200809 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db1341a-b01e-4008-8c57-4c3ff25b50e3 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:04.211597 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1258/2515] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:29:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:29:05.430808 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0cf152-18ce-480c-bb40-2177dc079101 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:05.432221 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-3c0cf152-18ce-480c-bb40-2177dc079101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:05.444701 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0cf152-18ce-480c-bb40-2177dc079101 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:05.448304 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02945e-bf94-48c2-b0f7-c780a658865d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:05.448974 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02945e-bf94-48c2-b0f7-c780a658865d service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:05.449261 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02945e-bf94-48c2-b0f7-c780a658865d service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:05.449540 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02945e-bf94-48c2-b0f7-c780a658865d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:05.505935 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02945e-bf94-48c2-b0f7-c780a658865d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:05.507373 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02945e-bf94-48c2-b0f7-c780a658865d service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:05.516575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1258/2516] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:29:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:29:09.747548 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1341a-b01e-4008-8c57-4c3ff25b50e3 service cinder] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:09.749141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-6db1341a-b01e-4008-8c57-4c3ff25b50e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:09.805850 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1341a-b01e-4008-8c57-4c3ff25b50e3 service cinder] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:09.809527 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba2d19-c972-46de-87f1-492e64b44303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:09.810169 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba2d19-c972-46de-87f1-492e64b44303 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:09.810454 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba2d19-c972-46de-87f1-492e64b44303 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:09.810738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba2d19-c972-46de-87f1-492e64b44303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:09.812523 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-d1ba2d19-c972-46de-87f1-492e64b44303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:09.879670 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba2d19-c972-46de-87f1-492e64b44303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:09.881146 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba2d19-c972-46de-87f1-492e64b44303 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:09.886510 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:09.891595 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1259/2517] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:29:09 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:29:11.735022 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02945e-bf94-48c2-b0f7-c780a658865d service cinder] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:11.744173 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02945e-bf94-48c2-b0f7-c780a658865d service cinder] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:11.748725 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b4e1e-f626-41a5-9c0e-86f8bdc0878c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:11.749414 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b4e1e-f626-41a5-9c0e-86f8bdc0878c service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:11.749702 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b4e1e-f626-41a5-9c0e-86f8bdc0878c service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:11.749976 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b4e1e-f626-41a5-9c0e-86f8bdc0878c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:11.764427 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:11.810221 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b4e1e-f626-41a5-9c0e-86f8bdc0878c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:11.811790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b4e1e-f626-41a5-9c0e-86f8bdc0878c service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:11.821586 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1259/2518] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:29:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:29:16.643729 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba2d19-c972-46de-87f1-492e64b44303 service neutron] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:16.719727 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba2d19-c972-46de-87f1-492e64b44303 service neutron] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:16.727529 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743f622-89d9-455f-ae19-9282d73edae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:16.728553 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743f622-89d9-455f-ae19-9282d73edae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:16.728859 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743f622-89d9-455f-ae19-9282d73edae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:16.729139 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743f622-89d9-455f-ae19-9282d73edae9 admin admin] PATH_INFO: `/v3/users/97841676bff44c529f59da537765ad54` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:16.730346 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0743f622-89d9-455f-ae19-9282d73edae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97841676bff44c529f59da537765ad54)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:16.732291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0743f622-89d9-455f-ae19-9282d73edae9 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:16.998283 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-0743f622-89d9-455f-ae19-9282d73edae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97841676bff44c529f59da537765ad54'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:17.010037 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-0743f622-89d9-455f-ae19-9282d73edae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97841676bff44c529f59da537765ad54'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:17.133032 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-0743f622-89d9-455f-ae19-9282d73edae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97841676bff44c529f59da537765ad54'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:17.133666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-0743f622-89d9-455f-ae19-9282d73edae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97841676bff44c529f59da537765ad54'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:17.141229 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-0743f622-89d9-455f-ae19-9282d73edae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97841676bff44c529f59da537765ad54'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:17.147228 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1260/2519] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:29:16 2022] DELETE /identity/v3/users/97841676bff44c529f59da537765ad54 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:17.151622 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77beb0c-306d-47bf-9ded-3f3253d81dd7 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:17.152081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77beb0c-306d-47bf-9ded-3f3253d81dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:17.152178 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77beb0c-306d-47bf-9ded-3f3253d81dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:17.169765 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-a77beb0c-306d-47bf-9ded-3f3253d81dd7 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:17.171030 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-a77beb0c-306d-47bf-9ded-3f3253d81dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:17.232103 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1260/2520] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:17.241697 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743f622-89d9-455f-ae19-9282d73edae9 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:17.243111 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-0743f622-89d9-455f-ae19-9282d73edae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:17.299623 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743f622-89d9-455f-ae19-9282d73edae9 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:17.303334 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea56b0f-c78c-429d-abb7-d7e30da12758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:17.303979 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea56b0f-c78c-429d-abb7-d7e30da12758 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:17.304264 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea56b0f-c78c-429d-abb7-d7e30da12758 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:17.304541 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea56b0f-c78c-429d-abb7-d7e30da12758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:17.313645 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea56b0f-c78c-429d-abb7-d7e30da12758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:17.315075 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea56b0f-c78c-429d-abb7-d7e30da12758 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:17.324530 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1261/2521] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:29:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:29:17.802856 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77beb0c-306d-47bf-9ded-3f3253d81dd7 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:17.804323 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-a77beb0c-306d-47bf-9ded-3f3253d81dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:17.822590 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77beb0c-306d-47bf-9ded-3f3253d81dd7 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:17.822590 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29c7d1-c79c-4374-bc1e-b9de8393daab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:17.823011 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29c7d1-c79c-4374-bc1e-b9de8393daab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:17.823195 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29c7d1-c79c-4374-bc1e-b9de8393daab admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:17.823455 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29c7d1-c79c-4374-bc1e-b9de8393daab admin admin] PATH_INFO: `/v3/projects/d3062cb06f4a4baa9ef7819c79eff918` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:17.824665 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29c7d1-c79c-4374-bc1e-b9de8393daab admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3062cb06f4a4baa9ef7819c79eff918)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:17.826775 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29c7d1-c79c-4374-bc1e-b9de8393daab admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:17.984632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-8e29c7d1-c79c-4374-bc1e-b9de8393daab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3062cb06f4a4baa9ef7819c79eff918', 'request_id': 'req-8e29c7d1-c79c-4374-bc1e-b9de8393daab'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:17.990837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-8e29c7d1-c79c-4374-bc1e-b9de8393daab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3062cb06f4a4baa9ef7819c79eff918', 'request_id': 'req-8e29c7d1-c79c-4374-bc1e-b9de8393daab'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:18.161301 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-8e29c7d1-c79c-4374-bc1e-b9de8393daab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3062cb06f4a4baa9ef7819c79eff918', 'request_id': 'req-8e29c7d1-c79c-4374-bc1e-b9de8393daab'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:18.173595 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-8e29c7d1-c79c-4374-bc1e-b9de8393daab admin admin] The token cache is being invalidate because project d3062cb06f4a4baa9ef7819c79eff918 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:29:18.173883 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-8e29c7d1-c79c-4374-bc1e-b9de8393daab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:18.174521 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-8e29c7d1-c79c-4374-bc1e-b9de8393daab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:18.176091 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1261/2522] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:29:17 2022] DELETE /identity/v3/projects/d3062cb06f4a4baa9ef7819c79eff918 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:18.180246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea56b0f-c78c-429d-abb7-d7e30da12758 service neutron] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:18.190640 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea56b0f-c78c-429d-abb7-d7e30da12758 service neutron] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:18.208666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:18.246857 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a92b42-5bd5-43e8-b4b9-6c1935f5eec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:18.247727 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a92b42-5bd5-43e8-b4b9-6c1935f5eec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:18.248010 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a92b42-5bd5-43e8-b4b9-6c1935f5eec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:18.248291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a92b42-5bd5-43e8-b4b9-6c1935f5eec0 admin admin] PATH_INFO: `/v3/users/916122a2ffb14e39924c96abb6f6d62d` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:18.249523 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a92b42-5bd5-43e8-b4b9-6c1935f5eec0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=916122a2ffb14e39924c96abb6f6d62d)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:18.252119 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a92b42-5bd5-43e8-b4b9-6c1935f5eec0 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:18.517627 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-32a92b42-5bd5-43e8-b4b9-6c1935f5eec0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '916122a2ffb14e39924c96abb6f6d62d'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:18.529943 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-32a92b42-5bd5-43e8-b4b9-6c1935f5eec0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '916122a2ffb14e39924c96abb6f6d62d'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:18.640861 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-32a92b42-5bd5-43e8-b4b9-6c1935f5eec0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '916122a2ffb14e39924c96abb6f6d62d'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:18.641519 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-32a92b42-5bd5-43e8-b4b9-6c1935f5eec0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '916122a2ffb14e39924c96abb6f6d62d'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:18.648903 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-32a92b42-5bd5-43e8-b4b9-6c1935f5eec0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '916122a2ffb14e39924c96abb6f6d62d'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:18.655022 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1262/2523] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:29:18 2022] DELETE /identity/v3/users/916122a2ffb14e39924c96abb6f6d62d => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:29:19.134820 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29c7d1-c79c-4374-bc1e-b9de8393daab admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:19.136287 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-8e29c7d1-c79c-4374-bc1e-b9de8393daab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:19.151601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29c7d1-c79c-4374-bc1e-b9de8393daab admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:19.192142 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:19.212433 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe31e35-4b64-4c18-8c22-54e1f1b9bbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:19.213338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe31e35-4b64-4c18-8c22-54e1f1b9bbb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:19.213616 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe31e35-4b64-4c18-8c22-54e1f1b9bbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:19.213888 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe31e35-4b64-4c18-8c22-54e1f1b9bbb6 admin admin] PATH_INFO: `/v3/projects/115b0599629747338f2755c36d24094a` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:19.215075 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe31e35-4b64-4c18-8c22-54e1f1b9bbb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=115b0599629747338f2755c36d24094a)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:19.217051 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe31e35-4b64-4c18-8c22-54e1f1b9bbb6 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:19.390180 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-dfe31e35-4b64-4c18-8c22-54e1f1b9bbb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '115b0599629747338f2755c36d24094a', 'request_id': 'req-dfe31e35-4b64-4c18-8c22-54e1f1b9bbb6'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:19.396140 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-dfe31e35-4b64-4c18-8c22-54e1f1b9bbb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '115b0599629747338f2755c36d24094a', 'request_id': 'req-dfe31e35-4b64-4c18-8c22-54e1f1b9bbb6'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:19.515820 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-dfe31e35-4b64-4c18-8c22-54e1f1b9bbb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '115b0599629747338f2755c36d24094a', 'request_id': 'req-dfe31e35-4b64-4c18-8c22-54e1f1b9bbb6'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:19.528034 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-dfe31e35-4b64-4c18-8c22-54e1f1b9bbb6 admin admin] The token cache is being invalidate because project 115b0599629747338f2755c36d24094a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:29:19.528327 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-dfe31e35-4b64-4c18-8c22-54e1f1b9bbb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:19.529006 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-dfe31e35-4b64-4c18-8c22-54e1f1b9bbb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:19.530559 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1262/2524] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:29:19 2022] DELETE /identity/v3/projects/115b0599629747338f2755c36d24094a => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:19.534892 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a92b42-5bd5-43e8-b4b9-6c1935f5eec0 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:19.536469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-32a92b42-5bd5-43e8-b4b9-6c1935f5eec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:19.549611 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a92b42-5bd5-43e8-b4b9-6c1935f5eec0 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:19.604703 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437c972-f51a-474c-a4e3-fc9259ee7636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:19.605678 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437c972-f51a-474c-a4e3-fc9259ee7636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:19.606000 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437c972-f51a-474c-a4e3-fc9259ee7636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:19.606280 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437c972-f51a-474c-a4e3-fc9259ee7636 admin admin] PATH_INFO: `/v3/users/242b21f3ab614ff0b009bf8650600e32` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:19.607452 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437c972-f51a-474c-a4e3-fc9259ee7636 admin admin] RBAC: Authorizing `identity:delete_user(user_id=242b21f3ab614ff0b009bf8650600e32)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:19.609405 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437c972-f51a-474c-a4e3-fc9259ee7636 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:19.869872 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:19.872909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-b437c972-f51a-474c-a4e3-fc9259ee7636 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '242b21f3ab614ff0b009bf8650600e32'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:19.884991 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-b437c972-f51a-474c-a4e3-fc9259ee7636 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '242b21f3ab614ff0b009bf8650600e32'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:19.972475 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-b437c972-f51a-474c-a4e3-fc9259ee7636 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '242b21f3ab614ff0b009bf8650600e32'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:19.973125 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-b437c972-f51a-474c-a4e3-fc9259ee7636 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '242b21f3ab614ff0b009bf8650600e32'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:19.980721 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-b437c972-f51a-474c-a4e3-fc9259ee7636 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '242b21f3ab614ff0b009bf8650600e32'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:19.987876 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1263/2525] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:29:19 2022] DELETE /identity/v3/users/242b21f3ab614ff0b009bf8650600e32 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:20.397853 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe31e35-4b64-4c18-8c22-54e1f1b9bbb6 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:20.399518 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-dfe31e35-4b64-4c18-8c22-54e1f1b9bbb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:20.414856 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe31e35-4b64-4c18-8c22-54e1f1b9bbb6 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:20.473281 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37960b-8e3b-4257-9c3d-a4b35f6d83a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:20.474198 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37960b-8e3b-4257-9c3d-a4b35f6d83a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:20.474492 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37960b-8e3b-4257-9c3d-a4b35f6d83a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:20.474774 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37960b-8e3b-4257-9c3d-a4b35f6d83a9 admin admin] PATH_INFO: `/v3/projects/d91b2069df63486fa06a65a1457a2f87` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:20.475969 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37960b-8e3b-4257-9c3d-a4b35f6d83a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d91b2069df63486fa06a65a1457a2f87)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:20.477965 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37960b-8e3b-4257-9c3d-a4b35f6d83a9 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:20.624790 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-ab37960b-8e3b-4257-9c3d-a4b35f6d83a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd91b2069df63486fa06a65a1457a2f87', 'request_id': 'req-ab37960b-8e3b-4257-9c3d-a4b35f6d83a9'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:20.630868 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-ab37960b-8e3b-4257-9c3d-a4b35f6d83a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd91b2069df63486fa06a65a1457a2f87', 'request_id': 'req-ab37960b-8e3b-4257-9c3d-a4b35f6d83a9'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:20.738884 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-ab37960b-8e3b-4257-9c3d-a4b35f6d83a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd91b2069df63486fa06a65a1457a2f87', 'request_id': 'req-ab37960b-8e3b-4257-9c3d-a4b35f6d83a9'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:20.750829 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:20.754641 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-ab37960b-8e3b-4257-9c3d-a4b35f6d83a9 admin admin] The token cache is being invalidate because project d91b2069df63486fa06a65a1457a2f87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:29:20.754934 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-ab37960b-8e3b-4257-9c3d-a4b35f6d83a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:20.755585 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-ab37960b-8e3b-4257-9c3d-a4b35f6d83a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:20.757159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1263/2526] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:29:20 2022] DELETE /identity/v3/projects/d91b2069df63486fa06a65a1457a2f87 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:20.762973 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c788d0-a37d-4628-88fa-f6e4417db960 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:20.763484 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c788d0-a37d-4628-88fa-f6e4417db960 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:20.763600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c788d0-a37d-4628-88fa-f6e4417db960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:20.783238 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-b0c788d0-a37d-4628-88fa-f6e4417db960 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:20.795743 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-b0c788d0-a37d-4628-88fa-f6e4417db960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:20.844044 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1264/2527] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:29:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:20.853578 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13114ab-2b4d-4c90-80e8-1396674b7287 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:20.853869 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13114ab-2b4d-4c90-80e8-1396674b7287 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:20.854147 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13114ab-2b4d-4c90-80e8-1396674b7287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:20.873477 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-c13114ab-2b4d-4c90-80e8-1396674b7287 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:20.878181 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-c13114ab-2b4d-4c90-80e8-1396674b7287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:20.883494 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1264/2528] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:29:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:20.887836 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c788d0-a37d-4628-88fa-f6e4417db960 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:20.898291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c788d0-a37d-4628-88fa-f6e4417db960 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:20.902994 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c958e9-1d38-4e56-9f65-0ce5074404e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:20.903657 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c958e9-1d38-4e56-9f65-0ce5074404e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:20.903943 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c958e9-1d38-4e56-9f65-0ce5074404e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:20.904221 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c958e9-1d38-4e56-9f65-0ce5074404e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:20.904993 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c958e9-1d38-4e56-9f65-0ce5074404e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:29:20.906931 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c958e9-1d38-4e56-9f65-0ce5074404e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:20.906931 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c958e9-1d38-4e56-9f65-0ce5074404e3 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:20.918936 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1265/2529] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:29:20.923797 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13114ab-2b4d-4c90-80e8-1396674b7287 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:20.933677 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13114ab-2b4d-4c90-80e8-1396674b7287 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:20.939346 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedd3c8-3350-4e3b-9588-29425fb7308a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:20.940011 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedd3c8-3350-4e3b-9588-29425fb7308a admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:20.940292 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedd3c8-3350-4e3b-9588-29425fb7308a admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:20.940569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedd3c8-3350-4e3b-9588-29425fb7308a admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:20.941339 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cedd3c8-3350-4e3b-9588-29425fb7308a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:20.944833 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cedd3c8-3350-4e3b-9588-29425fb7308a admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:21.030964 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1265/2530] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:29:20 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:29:21.035295 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c958e9-1d38-4e56-9f65-0ce5074404e3 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:21.045549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c958e9-1d38-4e56-9f65-0ce5074404e3 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:21.101666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c885c8-e6fc-44f3-a9da-f69ae737cf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:21.102517 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c885c8-e6fc-44f3-a9da-f69ae737cf06 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:21.103004 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c885c8-e6fc-44f3-a9da-f69ae737cf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:21.103339 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c885c8-e6fc-44f3-a9da-f69ae737cf06 admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:21.104088 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c885c8-e6fc-44f3-a9da-f69ae737cf06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:21.106174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c885c8-e6fc-44f3-a9da-f69ae737cf06 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:21.179819 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1266/2531] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:29:21 2022] POST /identity/v3/users => generated 286 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:29:21.183857 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedd3c8-3350-4e3b-9588-29425fb7308a admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:21.195130 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedd3c8-3350-4e3b-9588-29425fb7308a admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:21.199910 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d9b96-e7d0-4101-b582-4dfaacd397e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:21.200575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d9b96-e7d0-4101-b582-4dfaacd397e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:21.200890 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d9b96-e7d0-4101-b582-4dfaacd397e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:21.201174 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d9b96-e7d0-4101-b582-4dfaacd397e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:21.201906 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d9b96-e7d0-4101-b582-4dfaacd397e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:21.203602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d9b96-e7d0-4101-b582-4dfaacd397e6 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:21.215384 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1266/2532] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:29:21.219454 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c885c8-e6fc-44f3-a9da-f69ae737cf06 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:21.229701 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c885c8-e6fc-44f3-a9da-f69ae737cf06 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:21.234527 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979dacd-961e-4e03-985b-7d94945261b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:21.235728 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979dacd-961e-4e03-985b-7d94945261b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:21.236016 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979dacd-961e-4e03-985b-7d94945261b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:21.236299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979dacd-961e-4e03-985b-7d94945261b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:21.237067 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979dacd-961e-4e03-985b-7d94945261b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:21.238690 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979dacd-961e-4e03-985b-7d94945261b6 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:21.248738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1267/2533] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:29:21.253631 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d9b96-e7d0-4101-b582-4dfaacd397e6 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:21.263483 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d9b96-e7d0-4101-b582-4dfaacd397e6 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:21.268159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277d58e-e022-41aa-8f3b-d8552368dbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:21.269057 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277d58e-e022-41aa-8f3b-d8552368dbf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:21.269342 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277d58e-e022-41aa-8f3b-d8552368dbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:21.269616 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277d58e-e022-41aa-8f3b-d8552368dbf0 admin admin] PATH_INFO: `/v3/projects/972bb166cf104def947be133d0faeff8/users/749db44328504ae6a1054c8cf023d1c5/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:21.284219 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277d58e-e022-41aa-8f3b-d8552368dbf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=972bb166cf104def947be133d0faeff8, user_id=749db44328504ae6a1054c8cf023d1c5, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:21.287023 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277d58e-e022-41aa-8f3b-d8552368dbf0 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:21.361950 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1267/2534] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:29:21 2022] PUT /identity/v3/projects/972bb166cf104def947be133d0faeff8/users/749db44328504ae6a1054c8cf023d1c5/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:21.367349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f30880-23e8-4606-b04b-22bb784bd943 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:21.367754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f30880-23e8-4606-b04b-22bb784bd943 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:21.368134 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f30880-23e8-4606-b04b-22bb784bd943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:21.386639 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-b4f30880-23e8-4606-b04b-22bb784bd943 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:21.387862 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-b4f30880-23e8-4606-b04b-22bb784bd943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:21.408614 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:21.447566 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1268/2535] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:21.457396 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277d58e-e022-41aa-8f3b-d8552368dbf0 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:21.459094 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-4277d58e-e022-41aa-8f3b-d8552368dbf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:21.514251 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277d58e-e022-41aa-8f3b-d8552368dbf0 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:21.518455 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb599e-16d8-4a18-aa19-ea6ccda5678d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:21.519094 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb599e-16d8-4a18-aa19-ea6ccda5678d service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:21.519375 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb599e-16d8-4a18-aa19-ea6ccda5678d service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:21.519649 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb599e-16d8-4a18-aa19-ea6ccda5678d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:21.528673 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb599e-16d8-4a18-aa19-ea6ccda5678d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:21.530106 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb599e-16d8-4a18-aa19-ea6ccda5678d service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:21.540010 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1268/2536] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:29:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:29:22.786750 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a665e3d-f88d-4eb0-9bc0-f96d8a81555e None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:22.789612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a665e3d-f88d-4eb0-9bc0-f96d8a81555e None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:22.789612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a665e3d-f88d-4eb0-9bc0-f96d8a81555e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:22.816066 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-1a665e3d-f88d-4eb0-9bc0-f96d8a81555e None None] MFA Rules not processed for user `749db44328504ae6a1054c8cf023d1c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:22.821512 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-1a665e3d-f88d-4eb0-9bc0-f96d8a81555e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:22.885365 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1269/2537] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:29:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:22.890362 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb599e-16d8-4a18-aa19-ea6ccda5678d service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:22.900639 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb599e-16d8-4a18-aa19-ea6ccda5678d service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:22.905203 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d0dfe-3297-46f2-a1ce-452d9725a418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:22.905854 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d0dfe-3297-46f2-a1ce-452d9725a418 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:22.906143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d0dfe-3297-46f2-a1ce-452d9725a418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:22.906414 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d0dfe-3297-46f2-a1ce-452d9725a418 admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:22.907129 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d0dfe-3297-46f2-a1ce-452d9725a418 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:22.909374 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d0dfe-3297-46f2-a1ce-452d9725a418 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:23.043336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1269/2538] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:29:22 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:29:23.047601 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a665e3d-f88d-4eb0-9bc0-f96d8a81555e None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:23.058667 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a665e3d-f88d-4eb0-9bc0-f96d8a81555e None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:23.116467 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921118f-999b-4506-94f7-1e0a8621dbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:23.117187 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921118f-999b-4506-94f7-1e0a8621dbc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:23.117500 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921118f-999b-4506-94f7-1e0a8621dbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:23.117780 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921118f-999b-4506-94f7-1e0a8621dbc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:23.118492 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921118f-999b-4506-94f7-1e0a8621dbc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:23.120431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921118f-999b-4506-94f7-1e0a8621dbc1 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:23.225514 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1270/2539] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:29:23 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:29:23.230068 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d0dfe-3297-46f2-a1ce-452d9725a418 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:23.242099 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d0dfe-3297-46f2-a1ce-452d9725a418 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:23.247127 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74640df8-0452-412d-b038-f754874d19dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:23.247810 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74640df8-0452-412d-b038-f754874d19dd admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:23.248094 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74640df8-0452-412d-b038-f754874d19dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:23.248373 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74640df8-0452-412d-b038-f754874d19dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:23.249150 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74640df8-0452-412d-b038-f754874d19dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:23.251394 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74640df8-0452-412d-b038-f754874d19dd admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:23.263537 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1270/2540] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:29:23.268060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921118f-999b-4506-94f7-1e0a8621dbc1 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:23.278717 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921118f-999b-4506-94f7-1e0a8621dbc1 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:23.283826 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d8fb1-0e6a-43c4-b60a-4b4a94c4202a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:23.284733 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d8fb1-0e6a-43c4-b60a-4b4a94c4202a admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:23.285124 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d8fb1-0e6a-43c4-b60a-4b4a94c4202a admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:23.285407 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d8fb1-0e6a-43c4-b60a-4b4a94c4202a admin admin] PATH_INFO: `/v3/projects/ad20d34c19b748a1bc872276f3f8550f/users/42713eb62a13463d9baeb86adbda140c/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:23.302672 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d8fb1-0e6a-43c4-b60a-4b4a94c4202a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad20d34c19b748a1bc872276f3f8550f, user_id=42713eb62a13463d9baeb86adbda140c, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:23.305326 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d8fb1-0e6a-43c4-b60a-4b4a94c4202a admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:23.380300 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1271/2541] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:29:23 2022] PUT /identity/v3/projects/ad20d34c19b748a1bc872276f3f8550f/users/42713eb62a13463d9baeb86adbda140c/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:23.384369 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74640df8-0452-412d-b038-f754874d19dd admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:23.394519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74640df8-0452-412d-b038-f754874d19dd admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:23.452305 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a15158-e70b-4e09-81fb-2c3b6ec63e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:23.453010 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a15158-e70b-4e09-81fb-2c3b6ec63e8e admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:23.453296 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a15158-e70b-4e09-81fb-2c3b6ec63e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:23.453600 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a15158-e70b-4e09-81fb-2c3b6ec63e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:23.454332 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a15158-e70b-4e09-81fb-2c3b6ec63e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:23.455939 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a15158-e70b-4e09-81fb-2c3b6ec63e8e admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:23.466028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1271/2542] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:29:23.470280 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d8fb1-0e6a-43c4-b60a-4b4a94c4202a admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:23.480535 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d8fb1-0e6a-43c4-b60a-4b4a94c4202a admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:23.485638 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c85df-acba-49a7-9731-71ad45e29e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:23.486520 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c85df-acba-49a7-9731-71ad45e29e62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:23.486800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c85df-acba-49a7-9731-71ad45e29e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:23.487073 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c85df-acba-49a7-9731-71ad45e29e62 admin admin] PATH_INFO: `/v3/projects/ad20d34c19b748a1bc872276f3f8550f/users/42713eb62a13463d9baeb86adbda140c/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:23.489077 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c85df-acba-49a7-9731-71ad45e29e62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad20d34c19b748a1bc872276f3f8550f, user_id=42713eb62a13463d9baeb86adbda140c, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:23.491725 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c85df-acba-49a7-9731-71ad45e29e62 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:23.502892 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1272/2543] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:29:23 2022] PUT /identity/v3/projects/ad20d34c19b748a1bc872276f3f8550f/users/42713eb62a13463d9baeb86adbda140c/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:24.844284 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2a4b5-9077-4f02-9221-8b6a5288e20a None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:24.844863 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2a4b5-9077-4f02-9221-8b6a5288e20a None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:24.844863 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2a4b5-9077-4f02-9221-8b6a5288e20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:24.851227 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:24.873287 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-47d2a4b5-9077-4f02-9221-8b6a5288e20a None None] MFA Rules not processed for user `42713eb62a13463d9baeb86adbda140c`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:24.874519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-47d2a4b5-9077-4f02-9221-8b6a5288e20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:24.949763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1272/2544] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:29:24 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:24.961964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c85df-acba-49a7-9731-71ad45e29e62 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:24.963745 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-321c85df-acba-49a7-9731-71ad45e29e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:24.974649 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:25.021581 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c85df-acba-49a7-9731-71ad45e29e62 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:25.025662 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76e4fa-7a1e-43d7-83cb-36877ada3236 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:25.026325 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76e4fa-7a1e-43d7-83cb-36877ada3236 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:25.029209 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76e4fa-7a1e-43d7-83cb-36877ada3236 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:25.029209 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76e4fa-7a1e-43d7-83cb-36877ada3236 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:25.083847 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76e4fa-7a1e-43d7-83cb-36877ada3236 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:25.085368 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76e4fa-7a1e-43d7-83cb-36877ada3236 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:25.094671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1273/2545] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:29:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:29:25.683765 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2a4b5-9077-4f02-9221-8b6a5288e20a None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:25.685383 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-47d2a4b5-9077-4f02-9221-8b6a5288e20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:25.697318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2a4b5-9077-4f02-9221-8b6a5288e20a None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:25.700847 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc7394-cbb9-486f-9a69-776bc26ecb59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:25.701494 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc7394-cbb9-486f-9a69-776bc26ecb59 service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:25.701810 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc7394-cbb9-486f-9a69-776bc26ecb59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:25.702130 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc7394-cbb9-486f-9a69-776bc26ecb59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:25.704584 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-d8dc7394-cbb9-486f-9a69-776bc26ecb59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:25.796734 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc7394-cbb9-486f-9a69-776bc26ecb59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:25.799055 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc7394-cbb9-486f-9a69-776bc26ecb59 service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:25.818514 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1273/2546] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:29:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:29:26.864894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76e4fa-7a1e-43d7-83cb-36877ada3236 service cinder] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:26.873742 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76e4fa-7a1e-43d7-83cb-36877ada3236 service cinder] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:26.877480 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174b735-3790-46ce-818f-beb399d298fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:26.878121 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174b735-3790-46ce-818f-beb399d298fe service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:26.878407 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174b735-3790-46ce-818f-beb399d298fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:26.878687 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174b735-3790-46ce-818f-beb399d298fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:26.888187 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174b735-3790-46ce-818f-beb399d298fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:26.889650 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174b735-3790-46ce-818f-beb399d298fe service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:26.899253 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1274/2547] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:29:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:29:29.231127 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc7394-cbb9-486f-9a69-776bc26ecb59 service cinder] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:29.232565 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-d8dc7394-cbb9-486f-9a69-776bc26ecb59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:29.310369 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:29.340194 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc7394-cbb9-486f-9a69-776bc26ecb59 service cinder] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:29.348604 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a7234-6430-4fe1-a796-f44dcb93a347 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:29.349741 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a7234-6430-4fe1-a796-f44dcb93a347 service nova] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:29.350291 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a7234-6430-4fe1-a796-f44dcb93a347 service nova] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:29.350671 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a7234-6430-4fe1-a796-f44dcb93a347 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:29.353187 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-294a7234-6430-4fe1-a796-f44dcb93a347 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:29.372286 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a7234-6430-4fe1-a796-f44dcb93a347 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:29.374252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a7234-6430-4fe1-a796-f44dcb93a347 service nova] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:29.389526 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1274/2548] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:29:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:29:35.864197 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174b735-3790-46ce-818f-beb399d298fe service cinder] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:35.865357 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-1174b735-3790-46ce-818f-beb399d298fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:35.924092 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174b735-3790-46ce-818f-beb399d298fe service cinder] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:35.927754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6cda8-8d56-4811-a71d-0c061a325728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:35.928408 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6cda8-8d56-4811-a71d-0c061a325728 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:35.928749 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6cda8-8d56-4811-a71d-0c061a325728 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:35.929059 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6cda8-8d56-4811-a71d-0c061a325728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:35.930928 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-09f6cda8-8d56-4811-a71d-0c061a325728 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:35.995453 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6cda8-8d56-4811-a71d-0c061a325728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:35.997054 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6cda8-8d56-4811-a71d-0c061a325728 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:36.002549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:36.007446 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1275/2549] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:29:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:29:39.480771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a7234-6430-4fe1-a796-f44dcb93a347 service nova] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:39.486659 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-294a7234-6430-4fe1-a796-f44dcb93a347 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:39.495901 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a7234-6430-4fe1-a796-f44dcb93a347 service nova] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:39.500573 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c750ed-165f-479f-b611-130d9ec74ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:39.501960 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c750ed-165f-479f-b611-130d9ec74ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:39.502240 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c750ed-165f-479f-b611-130d9ec74ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:39.502515 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c750ed-165f-479f-b611-130d9ec74ef1 admin admin] PATH_INFO: `/v3/users/cef533d7373946dcb340fbf496070e9f` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:39.503709 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c750ed-165f-479f-b611-130d9ec74ef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cef533d7373946dcb340fbf496070e9f)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:39.505658 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c750ed-165f-479f-b611-130d9ec74ef1 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:39.758226 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-f4c750ed-165f-479f-b611-130d9ec74ef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cef533d7373946dcb340fbf496070e9f'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:39.758978 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-f4c750ed-165f-479f-b611-130d9ec74ef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cef533d7373946dcb340fbf496070e9f'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:39.869005 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-f4c750ed-165f-479f-b611-130d9ec74ef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cef533d7373946dcb340fbf496070e9f'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:39.882598 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-f4c750ed-165f-479f-b611-130d9ec74ef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cef533d7373946dcb340fbf496070e9f'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:39.893170 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-f4c750ed-165f-479f-b611-130d9ec74ef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cef533d7373946dcb340fbf496070e9f'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:39.900131 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1275/2550] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:29:39 2022] DELETE /identity/v3/users/cef533d7373946dcb340fbf496070e9f => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:40.156458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6cda8-8d56-4811-a71d-0c061a325728 service neutron] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:40.167419 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6cda8-8d56-4811-a71d-0c061a325728 service neutron] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:40.228593 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdc282-3201-434d-8264-4755bf778c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:40.229495 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdc282-3201-434d-8264-4755bf778c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:40.229806 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdc282-3201-434d-8264-4755bf778c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:40.230083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdc282-3201-434d-8264-4755bf778c47 admin admin] PATH_INFO: `/v3/projects/b3fed4f483e84ec7a10b96de33677cbc` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:40.231292 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdc282-3201-434d-8264-4755bf778c47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3fed4f483e84ec7a10b96de33677cbc)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:40.233307 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdc282-3201-434d-8264-4755bf778c47 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:40.361477 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-56bdc282-3201-434d-8264-4755bf778c47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3fed4f483e84ec7a10b96de33677cbc', 'request_id': 'req-56bdc282-3201-434d-8264-4755bf778c47'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:40.367624 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-56bdc282-3201-434d-8264-4755bf778c47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3fed4f483e84ec7a10b96de33677cbc', 'request_id': 'req-56bdc282-3201-434d-8264-4755bf778c47'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:40.457784 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-56bdc282-3201-434d-8264-4755bf778c47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3fed4f483e84ec7a10b96de33677cbc', 'request_id': 'req-56bdc282-3201-434d-8264-4755bf778c47'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:40.469551 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-56bdc282-3201-434d-8264-4755bf778c47 admin admin] The token cache is being invalidate because project b3fed4f483e84ec7a10b96de33677cbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:29:40.469840 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-56bdc282-3201-434d-8264-4755bf778c47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:40.471028 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-56bdc282-3201-434d-8264-4755bf778c47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:40.472630 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1276/2551] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:29:40 2022] DELETE /identity/v3/projects/b3fed4f483e84ec7a10b96de33677cbc => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:40.477635 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77637de-cbf0-4bd6-8482-df64d610e002 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:40.477955 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77637de-cbf0-4bd6-8482-df64d610e002 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:40.478239 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77637de-cbf0-4bd6-8482-df64d610e002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:40.495526 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-c77637de-cbf0-4bd6-8482-df64d610e002 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:40.496721 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-c77637de-cbf0-4bd6-8482-df64d610e002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:40.559253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1276/2552] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:40.568271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceecab0-31fc-449a-9750-a57742c065db None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:40.568585 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceecab0-31fc-449a-9750-a57742c065db None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:40.568918 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceecab0-31fc-449a-9750-a57742c065db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:40.587828 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-3ceecab0-31fc-449a-9750-a57742c065db None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:40.597790 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-3ceecab0-31fc-449a-9750-a57742c065db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:40.598802 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1277/2553] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:40.601965 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77637de-cbf0-4bd6-8482-df64d610e002 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:40.611777 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77637de-cbf0-4bd6-8482-df64d610e002 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:40.616554 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f959b48-d57c-41b2-8be9-52b131422933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:40.617370 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f959b48-d57c-41b2-8be9-52b131422933 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:40.618210 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f959b48-d57c-41b2-8be9-52b131422933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:40.618523 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f959b48-d57c-41b2-8be9-52b131422933 admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:40.619296 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f959b48-d57c-41b2-8be9-52b131422933 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:29:40.619610 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f959b48-d57c-41b2-8be9-52b131422933 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:40.621476 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f959b48-d57c-41b2-8be9-52b131422933 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:40.633566 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1277/2554] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:29:40.638060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceecab0-31fc-449a-9750-a57742c065db None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:40.648207 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceecab0-31fc-449a-9750-a57742c065db None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:40.653115 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb3e20-8dc3-40e6-a4f7-696a38d28a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:40.653770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb3e20-8dc3-40e6-a4f7-696a38d28a9a admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:40.654076 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb3e20-8dc3-40e6-a4f7-696a38d28a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:40.654355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb3e20-8dc3-40e6-a4f7-696a38d28a9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:40.655057 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb3e20-8dc3-40e6-a4f7-696a38d28a9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:40.657014 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb3e20-8dc3-40e6-a4f7-696a38d28a9a admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:40.796418 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1278/2555] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:29:40 2022] POST /identity/v3/projects => generated 355 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:29:40.800649 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f959b48-d57c-41b2-8be9-52b131422933 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:40.810905 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f959b48-d57c-41b2-8be9-52b131422933 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:40.852681 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:40.869359 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6c274-b6e8-4e64-a994-77da608db81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:40.870053 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6c274-b6e8-4e64-a994-77da608db81b admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:40.870367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6c274-b6e8-4e64-a994-77da608db81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:40.870705 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6c274-b6e8-4e64-a994-77da608db81b admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:40.871408 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6c274-b6e8-4e64-a994-77da608db81b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:40.873536 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6c274-b6e8-4e64-a994-77da608db81b admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:40.995322 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1278/2556] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:29:40 2022] POST /identity/v3/users => generated 278 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:29:40.999517 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb3e20-8dc3-40e6-a4f7-696a38d28a9a admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:41.010446 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb3e20-8dc3-40e6-a4f7-696a38d28a9a admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:41.015138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843ad90-28fd-4a44-a871-e943687be39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:41.015793 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843ad90-28fd-4a44-a871-e943687be39f admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:41.016076 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843ad90-28fd-4a44-a871-e943687be39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:41.016355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843ad90-28fd-4a44-a871-e943687be39f admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:41.017754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843ad90-28fd-4a44-a871-e943687be39f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:41.019359 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843ad90-28fd-4a44-a871-e943687be39f admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:41.029872 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1279/2557] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:29:41.034269 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6c274-b6e8-4e64-a994-77da608db81b admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:41.044468 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6c274-b6e8-4e64-a994-77da608db81b admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:41.049414 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff98f2-8695-4865-8813-68dd146138d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:41.050075 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff98f2-8695-4865-8813-68dd146138d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:41.050401 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff98f2-8695-4865-8813-68dd146138d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:41.050688 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff98f2-8695-4865-8813-68dd146138d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:41.051418 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff98f2-8695-4865-8813-68dd146138d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:41.053096 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff98f2-8695-4865-8813-68dd146138d4 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:41.064239 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1279/2558] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:29:41.068421 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843ad90-28fd-4a44-a871-e943687be39f admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:41.078482 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843ad90-28fd-4a44-a871-e943687be39f admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:41.083592 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dbd5d9-b654-4603-9a99-bad29344072e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:41.084472 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbd5d9-b654-4603-9a99-bad29344072e admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:41.084751 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbd5d9-b654-4603-9a99-bad29344072e admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:41.085080 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbd5d9-b654-4603-9a99-bad29344072e admin admin] PATH_INFO: `/v3/projects/ba4dda978256417aa18e358997b5f2d9/users/de00b55bf3fb4097bcb36668700a1865/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:41.100332 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dbd5d9-b654-4603-9a99-bad29344072e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba4dda978256417aa18e358997b5f2d9, user_id=de00b55bf3fb4097bcb36668700a1865, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:41.103110 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dbd5d9-b654-4603-9a99-bad29344072e admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:41.236249 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1280/2559] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:29:41 2022] PUT /identity/v3/projects/ba4dda978256417aa18e358997b5f2d9/users/de00b55bf3fb4097bcb36668700a1865/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:41.246676 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a45942-aaef-4680-9fb8-5883940bc233 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:41.246967 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a45942-aaef-4680-9fb8-5883940bc233 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:41.247252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a45942-aaef-4680-9fb8-5883940bc233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:41.273950 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-c8a45942-aaef-4680-9fb8-5883940bc233 None None] MFA Rules not processed for user `de00b55bf3fb4097bcb36668700a1865`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:41.275174 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-c8a45942-aaef-4680-9fb8-5883940bc233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:41.338592 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1280/2560] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:29:41 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:29:41.343136 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dbd5d9-b654-4603-9a99-bad29344072e admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:41.372678 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:41.403935 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dbd5d9-b654-4603-9a99-bad29344072e admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:41.409035 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1a0c6-3e61-40d6-87a1-a8ba04179301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:41.409696 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1a0c6-3e61-40d6-87a1-a8ba04179301 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:41.409982 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1a0c6-3e61-40d6-87a1-a8ba04179301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:41.410260 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1a0c6-3e61-40d6-87a1-a8ba04179301 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:41.410952 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1a0c6-3e61-40d6-87a1-a8ba04179301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:41.412912 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff1a0c6-3e61-40d6-87a1-a8ba04179301 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:41.517419 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1281/2561] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:29:41 2022] POST /identity/v3/projects => generated 357 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:29:41.521567 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a45942-aaef-4680-9fb8-5883940bc233 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:41.533466 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a45942-aaef-4680-9fb8-5883940bc233 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:41.588479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fb959-0734-4429-aa82-f4703f05832e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:41.589256 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fb959-0734-4429-aa82-f4703f05832e admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:41.589461 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fb959-0734-4429-aa82-f4703f05832e admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:41.589742 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fb959-0734-4429-aa82-f4703f05832e admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:41.590443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93fb959-0734-4429-aa82-f4703f05832e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:41.592350 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93fb959-0734-4429-aa82-f4703f05832e admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:41.727406 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1281/2562] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:29:41 2022] POST /identity/v3/users => generated 285 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:29:41.731153 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1a0c6-3e61-40d6-87a1-a8ba04179301 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:41.742274 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1a0c6-3e61-40d6-87a1-a8ba04179301 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:41.746932 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74216d-fd41-4f3a-b4aa-e3c68cab0814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:41.747598 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74216d-fd41-4f3a-b4aa-e3c68cab0814 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:41.747879 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74216d-fd41-4f3a-b4aa-e3c68cab0814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:41.748157 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74216d-fd41-4f3a-b4aa-e3c68cab0814 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:41.749033 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74216d-fd41-4f3a-b4aa-e3c68cab0814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:41.750642 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74216d-fd41-4f3a-b4aa-e3c68cab0814 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:41.762214 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1282/2563] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:29:41.766531 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fb959-0734-4429-aa82-f4703f05832e admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:41.777003 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fb959-0734-4429-aa82-f4703f05832e admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:41.781802 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e82a82-0b3d-4d3b-8800-81040295af0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:41.783465 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e82a82-0b3d-4d3b-8800-81040295af0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:41.783747 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e82a82-0b3d-4d3b-8800-81040295af0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:41.784024 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e82a82-0b3d-4d3b-8800-81040295af0b admin admin] PATH_INFO: `/v3/projects/78859ffc28b447daa1b4d2fa0b97cd68/users/4edd7382b07b45198da32d64c4f2a227/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:41.799194 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e82a82-0b3d-4d3b-8800-81040295af0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=78859ffc28b447daa1b4d2fa0b97cd68, user_id=4edd7382b07b45198da32d64c4f2a227, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:41.801896 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e82a82-0b3d-4d3b-8800-81040295af0b admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:41.961296 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1282/2564] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:29:41 2022] PUT /identity/v3/projects/78859ffc28b447daa1b4d2fa0b97cd68/users/4edd7382b07b45198da32d64c4f2a227/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:41.965224 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74216d-fd41-4f3a-b4aa-e3c68cab0814 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:41.976334 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74216d-fd41-4f3a-b4aa-e3c68cab0814 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:42.030543 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23df24a-7412-4f13-b123-93ba36a9929d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:42.031208 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23df24a-7412-4f13-b123-93ba36a9929d admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:42.031493 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23df24a-7412-4f13-b123-93ba36a9929d admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:42.031769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23df24a-7412-4f13-b123-93ba36a9929d admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:42.033404 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23df24a-7412-4f13-b123-93ba36a9929d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:42.035000 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23df24a-7412-4f13-b123-93ba36a9929d admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:42.045257 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1283/2565] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:29:42.049508 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e82a82-0b3d-4d3b-8800-81040295af0b admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:42.060327 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e82a82-0b3d-4d3b-8800-81040295af0b admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:42.065080 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a14a8-89b9-45b1-89dc-84f5d06b44e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:42.065953 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a14a8-89b9-45b1-89dc-84f5d06b44e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:42.066237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a14a8-89b9-45b1-89dc-84f5d06b44e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:42.066512 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a14a8-89b9-45b1-89dc-84f5d06b44e3 admin admin] PATH_INFO: `/v3/projects/78859ffc28b447daa1b4d2fa0b97cd68/users/4edd7382b07b45198da32d64c4f2a227/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:42.068632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a14a8-89b9-45b1-89dc-84f5d06b44e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78859ffc28b447daa1b4d2fa0b97cd68, user_id=4edd7382b07b45198da32d64c4f2a227, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:42.071312 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a14a8-89b9-45b1-89dc-84f5d06b44e3 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:42.082568 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1283/2566] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:29:42 2022] PUT /identity/v3/projects/78859ffc28b447daa1b4d2fa0b97cd68/users/4edd7382b07b45198da32d64c4f2a227/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:42.096835 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26bc93-c3a7-40f1-913e-f13825251880 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:42.097146 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26bc93-c3a7-40f1-913e-f13825251880 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:42.097430 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26bc93-c3a7-40f1-913e-f13825251880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:42.124877 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-0b26bc93-c3a7-40f1-913e-f13825251880 None None] MFA Rules not processed for user `4edd7382b07b45198da32d64c4f2a227`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:42.128125 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-0b26bc93-c3a7-40f1-913e-f13825251880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:42.199843 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1284/2567] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:29:42 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:42.211529 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a14a8-89b9-45b1-89dc-84f5d06b44e3 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:42.213339 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-984a14a8-89b9-45b1-89dc-84f5d06b44e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:42.218675 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:42.271667 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a14a8-89b9-45b1-89dc-84f5d06b44e3 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:42.275382 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784efe5-b646-4bb6-97ca-8d36596f1ebc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:42.276029 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784efe5-b646-4bb6-97ca-8d36596f1ebc service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:42.276320 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784efe5-b646-4bb6-97ca-8d36596f1ebc service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:42.276600 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784efe5-b646-4bb6-97ca-8d36596f1ebc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:42.287671 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5784efe5-b646-4bb6-97ca-8d36596f1ebc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:42.289131 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5784efe5-b646-4bb6-97ca-8d36596f1ebc service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:42.298901 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1284/2568] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:29:42 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:29:42.585427 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26bc93-c3a7-40f1-913e-f13825251880 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:42.594797 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26bc93-c3a7-40f1-913e-f13825251880 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:42.598438 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc5c87-34b6-42c5-97d5-9c370a2fc411 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:42.599106 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc5c87-34b6-42c5-97d5-9c370a2fc411 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:42.599388 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc5c87-34b6-42c5-97d5-9c370a2fc411 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:42.599661 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc5c87-34b6-42c5-97d5-9c370a2fc411 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:42.618312 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:42.656662 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cc5c87-34b6-42c5-97d5-9c370a2fc411 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:42.658390 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cc5c87-34b6-42c5-97d5-9c370a2fc411 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:42.668983 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1285/2569] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:29:42 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:29:46.120250 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784efe5-b646-4bb6-97ca-8d36596f1ebc service cinder] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:46.121799 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-5784efe5-b646-4bb6-97ca-8d36596f1ebc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:46.189117 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784efe5-b646-4bb6-97ca-8d36596f1ebc service cinder] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:46.193736 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773ff7e-bea0-41b4-b2bd-f6e80a898c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:46.194594 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773ff7e-bea0-41b4-b2bd-f6e80a898c42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:46.194873 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773ff7e-bea0-41b4-b2bd-f6e80a898c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:46.195144 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773ff7e-bea0-41b4-b2bd-f6e80a898c42 admin admin] PATH_INFO: `/v3/users/749db44328504ae6a1054c8cf023d1c5` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:46.196320 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773ff7e-bea0-41b4-b2bd-f6e80a898c42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=749db44328504ae6a1054c8cf023d1c5)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:46.198249 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773ff7e-bea0-41b4-b2bd-f6e80a898c42 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:46.598382 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-7773ff7e-bea0-41b4-b2bd-f6e80a898c42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '749db44328504ae6a1054c8cf023d1c5'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:46.599016 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-7773ff7e-bea0-41b4-b2bd-f6e80a898c42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '749db44328504ae6a1054c8cf023d1c5'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:46.725979 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-7773ff7e-bea0-41b4-b2bd-f6e80a898c42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '749db44328504ae6a1054c8cf023d1c5'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:46.739400 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-7773ff7e-bea0-41b4-b2bd-f6e80a898c42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '749db44328504ae6a1054c8cf023d1c5'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:46.746332 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-7773ff7e-bea0-41b4-b2bd-f6e80a898c42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '749db44328504ae6a1054c8cf023d1c5'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:46.752364 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1285/2570] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:29:46 2022] DELETE /identity/v3/users/749db44328504ae6a1054c8cf023d1c5 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:47.100620 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc5c87-34b6-42c5-97d5-9c370a2fc411 service cinder] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:47.114237 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc5c87-34b6-42c5-97d5-9c370a2fc411 service cinder] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:47.178723 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214c581-1c85-45bc-bbf5-6a4feae6f25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:47.179589 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214c581-1c85-45bc-bbf5-6a4feae6f25b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:47.179874 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214c581-1c85-45bc-bbf5-6a4feae6f25b admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:47.180149 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214c581-1c85-45bc-bbf5-6a4feae6f25b admin admin] PATH_INFO: `/v3/projects/972bb166cf104def947be133d0faeff8` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:47.181371 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2214c581-1c85-45bc-bbf5-6a4feae6f25b admin admin] RBAC: Authorizing `identity:delete_project(project_id=972bb166cf104def947be133d0faeff8)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:47.183349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2214c581-1c85-45bc-bbf5-6a4feae6f25b admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:47.362241 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-2214c581-1c85-45bc-bbf5-6a4feae6f25b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '972bb166cf104def947be133d0faeff8', 'request_id': 'req-2214c581-1c85-45bc-bbf5-6a4feae6f25b'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:47.368477 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-2214c581-1c85-45bc-bbf5-6a4feae6f25b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '972bb166cf104def947be133d0faeff8', 'request_id': 'req-2214c581-1c85-45bc-bbf5-6a4feae6f25b'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:47.514599 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-2214c581-1c85-45bc-bbf5-6a4feae6f25b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '972bb166cf104def947be133d0faeff8', 'request_id': 'req-2214c581-1c85-45bc-bbf5-6a4feae6f25b'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:47.525790 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-2214c581-1c85-45bc-bbf5-6a4feae6f25b admin admin] The token cache is being invalidate because project 972bb166cf104def947be133d0faeff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:29:47.526080 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-2214c581-1c85-45bc-bbf5-6a4feae6f25b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:47.526713 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-2214c581-1c85-45bc-bbf5-6a4feae6f25b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:47.528258 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1286/2571] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:29:47 2022] DELETE /identity/v3/projects/972bb166cf104def947be133d0faeff8 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:47.532557 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773ff7e-bea0-41b4-b2bd-f6e80a898c42 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:47.534013 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-7773ff7e-bea0-41b4-b2bd-f6e80a898c42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:47.547162 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773ff7e-bea0-41b4-b2bd-f6e80a898c42 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:47.568129 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:47.602966 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65201575-9c5a-433f-8b27-6c46361507eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:47.603839 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65201575-9c5a-433f-8b27-6c46361507eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:47.604265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65201575-9c5a-433f-8b27-6c46361507eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:47.604545 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65201575-9c5a-433f-8b27-6c46361507eb admin admin] PATH_INFO: `/v3/users/42713eb62a13463d9baeb86adbda140c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:47.605774 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65201575-9c5a-433f-8b27-6c46361507eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=42713eb62a13463d9baeb86adbda140c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:47.607703 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65201575-9c5a-433f-8b27-6c46361507eb admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:47.841946 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-65201575-9c5a-433f-8b27-6c46361507eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42713eb62a13463d9baeb86adbda140c'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:47.842634 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-65201575-9c5a-433f-8b27-6c46361507eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42713eb62a13463d9baeb86adbda140c'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:47.937160 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-65201575-9c5a-433f-8b27-6c46361507eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42713eb62a13463d9baeb86adbda140c'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:47.950332 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-65201575-9c5a-433f-8b27-6c46361507eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42713eb62a13463d9baeb86adbda140c'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:47.957932 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-65201575-9c5a-433f-8b27-6c46361507eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42713eb62a13463d9baeb86adbda140c'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:47.964100 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1286/2572] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:29:47 2022] DELETE /identity/v3/users/42713eb62a13463d9baeb86adbda140c => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:48.266816 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214c581-1c85-45bc-bbf5-6a4feae6f25b admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:48.266816 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-2214c581-1c85-45bc-bbf5-6a4feae6f25b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:48.281738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214c581-1c85-45bc-bbf5-6a4feae6f25b admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:48.330642 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:48.339962 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ae7ba-b196-46a4-8568-8d9e76223369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:48.340836 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ae7ba-b196-46a4-8568-8d9e76223369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:48.341193 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ae7ba-b196-46a4-8568-8d9e76223369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:48.341468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ae7ba-b196-46a4-8568-8d9e76223369 admin admin] PATH_INFO: `/v3/projects/ad20d34c19b748a1bc872276f3f8550f` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:48.342640 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ae7ba-b196-46a4-8568-8d9e76223369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad20d34c19b748a1bc872276f3f8550f)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:48.344550 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ae7ba-b196-46a4-8568-8d9e76223369 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:48.526710 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e87ae7ba-b196-46a4-8568-8d9e76223369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad20d34c19b748a1bc872276f3f8550f', 'request_id': 'req-e87ae7ba-b196-46a4-8568-8d9e76223369'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:48.532997 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e87ae7ba-b196-46a4-8568-8d9e76223369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad20d34c19b748a1bc872276f3f8550f', 'request_id': 'req-e87ae7ba-b196-46a4-8568-8d9e76223369'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:48.645852 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e87ae7ba-b196-46a4-8568-8d9e76223369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad20d34c19b748a1bc872276f3f8550f', 'request_id': 'req-e87ae7ba-b196-46a4-8568-8d9e76223369'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:48.657324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e87ae7ba-b196-46a4-8568-8d9e76223369 admin admin] The token cache is being invalidate because project ad20d34c19b748a1bc872276f3f8550f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:29:48.657615 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e87ae7ba-b196-46a4-8568-8d9e76223369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:48.658298 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e87ae7ba-b196-46a4-8568-8d9e76223369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:48.659832 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1287/2573] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:29:48 2022] DELETE /identity/v3/projects/ad20d34c19b748a1bc872276f3f8550f => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:48.666732 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021d589-fddd-4a40-b50f-b02a6bd5960f None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:48.667241 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021d589-fddd-4a40-b50f-b02a6bd5960f None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:48.667354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021d589-fddd-4a40-b50f-b02a6bd5960f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:48.685513 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-9021d589-fddd-4a40-b50f-b02a6bd5960f None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:48.686746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-9021d589-fddd-4a40-b50f-b02a6bd5960f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:48.748197 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1287/2574] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:48.756391 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c70a08-8b1d-47de-84c8-05f66d5d0a27 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:48.756725 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c70a08-8b1d-47de-84c8-05f66d5d0a27 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:48.756994 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c70a08-8b1d-47de-84c8-05f66d5d0a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:48.775303 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-b0c70a08-8b1d-47de-84c8-05f66d5d0a27 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:48.776504 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-b0c70a08-8b1d-47de-84c8-05f66d5d0a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:48.785811 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1288/2575] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:48.789957 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021d589-fddd-4a40-b50f-b02a6bd5960f None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:48.799482 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021d589-fddd-4a40-b50f-b02a6bd5960f None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:48.805283 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899455f-98f1-4834-a82d-9673bc7d96ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:48.805937 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899455f-98f1-4834-a82d-9673bc7d96ae admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:48.806246 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899455f-98f1-4834-a82d-9673bc7d96ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:48.806525 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899455f-98f1-4834-a82d-9673bc7d96ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:48.807255 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899455f-98f1-4834-a82d-9673bc7d96ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:29:48.807567 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899455f-98f1-4834-a82d-9673bc7d96ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:48.809200 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899455f-98f1-4834-a82d-9673bc7d96ae admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:48.820970 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1288/2576] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:29:48.825291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c70a08-8b1d-47de-84c8-05f66d5d0a27 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:48.834750 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c70a08-8b1d-47de-84c8-05f66d5d0a27 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:48.839549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ae17f-5787-4ab7-9010-c53e1c061eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:48.840201 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ae17f-5787-4ab7-9010-c53e1c061eec admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:48.840489 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ae17f-5787-4ab7-9010-c53e1c061eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:48.840768 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ae17f-5787-4ab7-9010-c53e1c061eec admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:48.841496 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ae17f-5787-4ab7-9010-c53e1c061eec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:48.843412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ae17f-5787-4ab7-9010-c53e1c061eec admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:48.933500 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1289/2577] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:29:48 2022] POST /identity/v3/projects => generated 361 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:29:48.937480 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899455f-98f1-4834-a82d-9673bc7d96ae admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:48.947646 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899455f-98f1-4834-a82d-9673bc7d96ae admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:48.977315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:49.006433 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534316e-0947-4367-9f3e-145d25ed64f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:49.007107 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534316e-0947-4367-9f3e-145d25ed64f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:49.007394 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534316e-0947-4367-9f3e-145d25ed64f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:49.007674 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534316e-0947-4367-9f3e-145d25ed64f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:49.008373 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534316e-0947-4367-9f3e-145d25ed64f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:49.010334 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534316e-0947-4367-9f3e-145d25ed64f2 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:49.172116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1289/2578] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:29:48 2022] POST /identity/v3/users => generated 281 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:29:49.176336 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ae17f-5787-4ab7-9010-c53e1c061eec admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:49.187060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ae17f-5787-4ab7-9010-c53e1c061eec admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:49.191691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de3ce1-3e93-4287-b8e5-aef0f44b2730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:49.192389 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de3ce1-3e93-4287-b8e5-aef0f44b2730 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:49.192675 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de3ce1-3e93-4287-b8e5-aef0f44b2730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:49.192984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de3ce1-3e93-4287-b8e5-aef0f44b2730 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:49.193719 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de3ce1-3e93-4287-b8e5-aef0f44b2730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:49.195320 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de3ce1-3e93-4287-b8e5-aef0f44b2730 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:49.208294 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1290/2579] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:29:49.213882 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534316e-0947-4367-9f3e-145d25ed64f2 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:49.224621 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534316e-0947-4367-9f3e-145d25ed64f2 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:49.229593 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0a2f6-3916-40af-9b51-4fcf5adb9dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:49.230271 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0a2f6-3916-40af-9b51-4fcf5adb9dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:49.230558 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0a2f6-3916-40af-9b51-4fcf5adb9dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:49.230839 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0a2f6-3916-40af-9b51-4fcf5adb9dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:49.231581 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0a2f6-3916-40af-9b51-4fcf5adb9dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:49.233313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0a2f6-3916-40af-9b51-4fcf5adb9dd0 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:49.248045 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1290/2580] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:29:49.249177 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de3ce1-3e93-4287-b8e5-aef0f44b2730 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:49.259204 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de3ce1-3e93-4287-b8e5-aef0f44b2730 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:49.263816 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0fe04-62c9-4f75-8c81-27a68cf69808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:49.264899 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0fe04-62c9-4f75-8c81-27a68cf69808 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:49.265187 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0fe04-62c9-4f75-8c81-27a68cf69808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:49.265463 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0fe04-62c9-4f75-8c81-27a68cf69808 admin admin] PATH_INFO: `/v3/projects/394a1ecea12e40e4a01dc473284fde02/users/13e5c412d1284013b51cc405e9dbb886/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:49.282211 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0fe04-62c9-4f75-8c81-27a68cf69808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=394a1ecea12e40e4a01dc473284fde02, user_id=13e5c412d1284013b51cc405e9dbb886, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:49.284986 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0fe04-62c9-4f75-8c81-27a68cf69808 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:49.384180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1291/2581] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:29:49 2022] PUT /identity/v3/projects/394a1ecea12e40e4a01dc473284fde02/users/13e5c412d1284013b51cc405e9dbb886/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:49.395659 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec195d4-ae1d-4423-bfb2-a1602bf6cfd6 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:49.395971 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec195d4-ae1d-4423-bfb2-a1602bf6cfd6 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:49.396246 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec195d4-ae1d-4423-bfb2-a1602bf6cfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:49.425300 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-aec195d4-ae1d-4423-bfb2-a1602bf6cfd6 None None] MFA Rules not processed for user `13e5c412d1284013b51cc405e9dbb886`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:49.426553 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-aec195d4-ae1d-4423-bfb2-a1602bf6cfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:49.492467 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1291/2582] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:29:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:49.525282 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0fe04-62c9-4f75-8c81-27a68cf69808 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:49.527027 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-0cc0fe04-62c9-4f75-8c81-27a68cf69808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:49.589478 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0fe04-62c9-4f75-8c81-27a68cf69808 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:49.593141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e9443-c949-47b2-b54c-18aeb91a3fb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:49.593789 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e9443-c949-47b2-b54c-18aeb91a3fb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:49.594073 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e9443-c949-47b2-b54c-18aeb91a3fb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:49.594350 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e9443-c949-47b2-b54c-18aeb91a3fb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:49.604447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e9443-c949-47b2-b54c-18aeb91a3fb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:49.606128 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e9443-c949-47b2-b54c-18aeb91a3fb6 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:49.615108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1292/2583] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:29:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:29:49.629820 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec195d4-ae1d-4423-bfb2-a1602bf6cfd6 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:49.693850 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec195d4-ae1d-4423-bfb2-a1602bf6cfd6 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:49.698826 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d42b6-1af5-4dd1-a7be-bb9c7f7eb12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:49.699706 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d42b6-1af5-4dd1-a7be-bb9c7f7eb12e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:49.699989 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d42b6-1af5-4dd1-a7be-bb9c7f7eb12e admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:49.700265 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d42b6-1af5-4dd1-a7be-bb9c7f7eb12e admin admin] PATH_INFO: `/v3/users/13e5c412d1284013b51cc405e9dbb886` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:49.701621 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d42b6-1af5-4dd1-a7be-bb9c7f7eb12e admin admin] RBAC: Authorizing `identity:delete_user(user_id=13e5c412d1284013b51cc405e9dbb886)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:49.709365 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d42b6-1af5-4dd1-a7be-bb9c7f7eb12e admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:49.912079 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:49.917311 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-a13d42b6-1af5-4dd1-a7be-bb9c7f7eb12e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13e5c412d1284013b51cc405e9dbb886'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:49.917961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-a13d42b6-1af5-4dd1-a7be-bb9c7f7eb12e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13e5c412d1284013b51cc405e9dbb886'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:50.068646 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-a13d42b6-1af5-4dd1-a7be-bb9c7f7eb12e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13e5c412d1284013b51cc405e9dbb886'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:50.081528 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-a13d42b6-1af5-4dd1-a7be-bb9c7f7eb12e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13e5c412d1284013b51cc405e9dbb886'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:50.088547 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-a13d42b6-1af5-4dd1-a7be-bb9c7f7eb12e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13e5c412d1284013b51cc405e9dbb886'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:50.095270 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1292/2584] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:29:49 2022] DELETE /identity/v3/users/13e5c412d1284013b51cc405e9dbb886 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:50.100371 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc998e5-819b-4550-afef-19b9578efb14 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:50.100739 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc998e5-819b-4550-afef-19b9578efb14 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:50.101245 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc998e5-819b-4550-afef-19b9578efb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:50.118905 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-9cc998e5-819b-4550-afef-19b9578efb14 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:50.120129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-9cc998e5-819b-4550-afef-19b9578efb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:50.132645 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:50.178234 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1293/2585] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:29:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:50.187900 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d42b6-1af5-4dd1-a7be-bb9c7f7eb12e admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:50.189386 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-a13d42b6-1af5-4dd1-a7be-bb9c7f7eb12e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:50.245786 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d42b6-1af5-4dd1-a7be-bb9c7f7eb12e admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:50.249503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73a80d-0c7c-4f95-a697-4edf7fb6967c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:50.250185 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73a80d-0c7c-4f95-a697-4edf7fb6967c service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:50.250466 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73a80d-0c7c-4f95-a697-4edf7fb6967c service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:50.250738 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73a80d-0c7c-4f95-a697-4edf7fb6967c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:50.260512 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73a80d-0c7c-4f95-a697-4edf7fb6967c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:50.262043 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73a80d-0c7c-4f95-a697-4edf7fb6967c service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:50.273620 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1293/2586] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:29:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:29:50.825352 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc998e5-819b-4550-afef-19b9578efb14 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:50.826870 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-9cc998e5-819b-4550-afef-19b9578efb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:50.840201 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc998e5-819b-4550-afef-19b9578efb14 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:50.845505 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d06f7-631d-4067-bbcb-d417bb536532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:50.846409 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d06f7-631d-4067-bbcb-d417bb536532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:50.846692 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d06f7-631d-4067-bbcb-d417bb536532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:50.846993 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d06f7-631d-4067-bbcb-d417bb536532 admin admin] PATH_INFO: `/v3/projects/394a1ecea12e40e4a01dc473284fde02` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:50.848686 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d06f7-631d-4067-bbcb-d417bb536532 admin admin] RBAC: Authorizing `identity:delete_project(project_id=394a1ecea12e40e4a01dc473284fde02)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:50.850817 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d06f7-631d-4067-bbcb-d417bb536532 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:50.995240 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-228d06f7-631d-4067-bbcb-d417bb536532 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '394a1ecea12e40e4a01dc473284fde02', 'request_id': 'req-228d06f7-631d-4067-bbcb-d417bb536532'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:51.001487 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-228d06f7-631d-4067-bbcb-d417bb536532 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '394a1ecea12e40e4a01dc473284fde02', 'request_id': 'req-228d06f7-631d-4067-bbcb-d417bb536532'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:51.154271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-228d06f7-631d-4067-bbcb-d417bb536532 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '394a1ecea12e40e4a01dc473284fde02', 'request_id': 'req-228d06f7-631d-4067-bbcb-d417bb536532'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:51.166780 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-228d06f7-631d-4067-bbcb-d417bb536532 admin admin] The token cache is being invalidate because project 394a1ecea12e40e4a01dc473284fde02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:29:51.167068 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-228d06f7-631d-4067-bbcb-d417bb536532 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:51.167764 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-228d06f7-631d-4067-bbcb-d417bb536532 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:29:51.169394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1294/2587] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:29:50 2022] DELETE /identity/v3/projects/394a1ecea12e40e4a01dc473284fde02 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:51.177834 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac17af-8481-4928-a97f-bbbda11d73e0 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:51.178633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac17af-8481-4928-a97f-bbbda11d73e0 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:51.178633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac17af-8481-4928-a97f-bbbda11d73e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:51.197235 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-1eac17af-8481-4928-a97f-bbbda11d73e0 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:51.198511 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-1eac17af-8481-4928-a97f-bbbda11d73e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:51.258186 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1294/2588] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:29:51.267173 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15889966-ff59-4898-8d62-b2fe310b6d95 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:51.267462 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15889966-ff59-4898-8d62-b2fe310b6d95 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:51.267720 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15889966-ff59-4898-8d62-b2fe310b6d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:51.287410 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-15889966-ff59-4898-8d62-b2fe310b6d95 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:51.288608 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-15889966-ff59-4898-8d62-b2fe310b6d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:51.296529 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1295/2589] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:51.300783 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac17af-8481-4928-a97f-bbbda11d73e0 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:51.310728 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac17af-8481-4928-a97f-bbbda11d73e0 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:51.315575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a4ddc-5aee-4b14-b99b-68dcf0f43f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:51.316234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a4ddc-5aee-4b14-b99b-68dcf0f43f40 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:51.316515 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a4ddc-5aee-4b14-b99b-68dcf0f43f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:51.316812 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a4ddc-5aee-4b14-b99b-68dcf0f43f40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:51.317617 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a4ddc-5aee-4b14-b99b-68dcf0f43f40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:29:51.317924 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a4ddc-5aee-4b14-b99b-68dcf0f43f40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:51.319509 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a4ddc-5aee-4b14-b99b-68dcf0f43f40 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:51.331046 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1295/2590] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:29:51.335819 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15889966-ff59-4898-8d62-b2fe310b6d95 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:51.345115 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15889966-ff59-4898-8d62-b2fe310b6d95 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:51.350479 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4303dcb-7b77-4143-9059-1cfe27934839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:51.351132 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4303dcb-7b77-4143-9059-1cfe27934839 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:51.351417 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4303dcb-7b77-4143-9059-1cfe27934839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:51.351697 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4303dcb-7b77-4143-9059-1cfe27934839 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:51.352388 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4303dcb-7b77-4143-9059-1cfe27934839 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:51.354321 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4303dcb-7b77-4143-9059-1cfe27934839 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:51.469933 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1296/2591] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:29:51 2022] POST /identity/v3/projects => generated 369 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:29:51.474675 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a4ddc-5aee-4b14-b99b-68dcf0f43f40 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:51.485468 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a4ddc-5aee-4b14-b99b-68dcf0f43f40 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:51.529158 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:51.541905 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c3263-8ea0-4290-83d6-7f80461ed7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:51.542584 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c3263-8ea0-4290-83d6-7f80461ed7b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:51.542878 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c3263-8ea0-4290-83d6-7f80461ed7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:51.543157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c3263-8ea0-4290-83d6-7f80461ed7b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:51.543854 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c3263-8ea0-4290-83d6-7f80461ed7b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:51.545853 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c3263-8ea0-4290-83d6-7f80461ed7b2 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:51.657457 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1296/2592] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:29:51 2022] POST /identity/v3/users => generated 285 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:29:51.661542 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4303dcb-7b77-4143-9059-1cfe27934839 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:51.672323 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4303dcb-7b77-4143-9059-1cfe27934839 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:51.677406 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b9aa0-af4b-406e-aa03-39cf1b2da536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:51.678138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b9aa0-af4b-406e-aa03-39cf1b2da536 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:51.678451 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b9aa0-af4b-406e-aa03-39cf1b2da536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:51.678735 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b9aa0-af4b-406e-aa03-39cf1b2da536 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:51.679470 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b9aa0-af4b-406e-aa03-39cf1b2da536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:51.681135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b9aa0-af4b-406e-aa03-39cf1b2da536 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:51.692409 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1297/2593] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:29:51.696418 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c3263-8ea0-4290-83d6-7f80461ed7b2 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:51.706407 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c3263-8ea0-4290-83d6-7f80461ed7b2 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:51.711578 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c834ec7-575d-49bc-8edd-8cae2d124eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:51.712244 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c834ec7-575d-49bc-8edd-8cae2d124eef admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:51.712534 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c834ec7-575d-49bc-8edd-8cae2d124eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:51.712812 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c834ec7-575d-49bc-8edd-8cae2d124eef admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:51.718059 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c834ec7-575d-49bc-8edd-8cae2d124eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:51.718059 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c834ec7-575d-49bc-8edd-8cae2d124eef admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:51.726013 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1297/2594] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:29:51.730177 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b9aa0-af4b-406e-aa03-39cf1b2da536 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:51.740281 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b9aa0-af4b-406e-aa03-39cf1b2da536 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:51.744967 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d0cd1-2323-4165-a515-54050e7aed86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:51.745846 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d0cd1-2323-4165-a515-54050e7aed86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:51.746129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d0cd1-2323-4165-a515-54050e7aed86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:51.746409 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d0cd1-2323-4165-a515-54050e7aed86 admin admin] PATH_INFO: `/v3/projects/d08235fe423d4493a600f00e67653087/users/22919bdab9b6475b86772b2ed20b297e/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:51.761515 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d0cd1-2323-4165-a515-54050e7aed86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d08235fe423d4493a600f00e67653087, user_id=22919bdab9b6475b86772b2ed20b297e, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:51.764174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d0cd1-2323-4165-a515-54050e7aed86 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:51.869247 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1298/2595] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:29:51 2022] PUT /identity/v3/projects/d08235fe423d4493a600f00e67653087/users/22919bdab9b6475b86772b2ed20b297e/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:29:51.880318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d2639-f826-4b9b-8e71-a6de2131d200 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:51.880738 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d2639-f826-4b9b-8e71-a6de2131d200 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:51.881065 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d2639-f826-4b9b-8e71-a6de2131d200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:51.910846 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-1a5d2639-f826-4b9b-8e71-a6de2131d200 None None] MFA Rules not processed for user `22919bdab9b6475b86772b2ed20b297e`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:29:51.912869 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-1a5d2639-f826-4b9b-8e71-a6de2131d200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:51.981086 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1298/2596] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:29:51 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:29:51.995087 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d0cd1-2323-4165-a515-54050e7aed86 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:29:51.999178 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-459d0cd1-2323-4165-a515-54050e7aed86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:29:52.041778 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:52.055447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d0cd1-2323-4165-a515-54050e7aed86 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:29:52.059217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f305178-35ad-4c6e-9ec9-1eb176857bf0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4fbf9b051940bd82547a700796d118', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:29:52.059858 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f305178-35ad-4c6e-9ec9-1eb176857bf0 service glance] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:29:52.060137 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f305178-35ad-4c6e-9ec9-1eb176857bf0 service glance] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:29:52.060410 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f305178-35ad-4c6e-9ec9-1eb176857bf0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:29:52.069327 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f305178-35ad-4c6e-9ec9-1eb176857bf0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:29:52.070759 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f305178-35ad-4c6e-9ec9-1eb176857bf0 service glance] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:29:52.079485 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1299/2597] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:29:51 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:30:01.977286 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=44,keystone:INSERT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:02.662225 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=8 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:05.855067 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d2639-f826-4b9b-8e71-a6de2131d200 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:05.856515 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-1a5d2639-f826-4b9b-8e71-a6de2131d200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:05.922247 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d2639-f826-4b9b-8e71-a6de2131d200 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:05.926927 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38664b67-bc10-4f7e-b40f-ba64f0ac273c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:05.927806 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38664b67-bc10-4f7e-b40f-ba64f0ac273c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:05.928087 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38664b67-bc10-4f7e-b40f-ba64f0ac273c admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:05.928364 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38664b67-bc10-4f7e-b40f-ba64f0ac273c admin admin] PATH_INFO: `/v3/users/de00b55bf3fb4097bcb36668700a1865` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:05.930164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38664b67-bc10-4f7e-b40f-ba64f0ac273c admin admin] RBAC: Authorizing `identity:delete_user(user_id=de00b55bf3fb4097bcb36668700a1865)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:05.932070 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38664b67-bc10-4f7e-b40f-ba64f0ac273c admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:06.150533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-38664b67-bc10-4f7e-b40f-ba64f0ac273c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de00b55bf3fb4097bcb36668700a1865'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:06.151130 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-38664b67-bc10-4f7e-b40f-ba64f0ac273c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de00b55bf3fb4097bcb36668700a1865'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:06.233978 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-38664b67-bc10-4f7e-b40f-ba64f0ac273c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de00b55bf3fb4097bcb36668700a1865'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:06.246519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-38664b67-bc10-4f7e-b40f-ba64f0ac273c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de00b55bf3fb4097bcb36668700a1865'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:06.253280 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-38664b67-bc10-4f7e-b40f-ba64f0ac273c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de00b55bf3fb4097bcb36668700a1865'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:06.259324 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1299/2598] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:30:05 2022] DELETE /identity/v3/users/de00b55bf3fb4097bcb36668700a1865 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:06.263952 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6b15c-39d4-4059-bc8d-6a6c55664a31 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:06.264432 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6b15c-39d4-4059-bc8d-6a6c55664a31 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:06.264571 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6b15c-39d4-4059-bc8d-6a6c55664a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:06.282872 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-acc6b15c-39d4-4059-bc8d-6a6c55664a31 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:06.284092 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-acc6b15c-39d4-4059-bc8d-6a6c55664a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:06.342773 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1300/2599] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:30:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:06.357437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38664b67-bc10-4f7e-b40f-ba64f0ac273c admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:06.359426 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-38664b67-bc10-4f7e-b40f-ba64f0ac273c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:06.419231 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38664b67-bc10-4f7e-b40f-ba64f0ac273c admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:06.422741 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2293b1-e529-43c2-ba89-19b00173cd8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:06.428987 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2293b1-e529-43c2-ba89-19b00173cd8f service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:06.428987 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2293b1-e529-43c2-ba89-19b00173cd8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:06.428987 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2293b1-e529-43c2-ba89-19b00173cd8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:06.432940 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2293b1-e529-43c2-ba89-19b00173cd8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:06.434356 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2293b1-e529-43c2-ba89-19b00173cd8f service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:06.443857 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1300/2600] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:30:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:30:06.950692 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6b15c-39d4-4059-bc8d-6a6c55664a31 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:06.952171 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-acc6b15c-39d4-4059-bc8d-6a6c55664a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:06.965292 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6b15c-39d4-4059-bc8d-6a6c55664a31 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:06.969182 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e69953-2f5f-4ba3-b2bc-4cfdc8f8c279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:06.970076 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e69953-2f5f-4ba3-b2bc-4cfdc8f8c279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:06.970355 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e69953-2f5f-4ba3-b2bc-4cfdc8f8c279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:06.970626 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e69953-2f5f-4ba3-b2bc-4cfdc8f8c279 admin admin] PATH_INFO: `/v3/projects/ba4dda978256417aa18e358997b5f2d9` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:06.971844 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e69953-2f5f-4ba3-b2bc-4cfdc8f8c279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba4dda978256417aa18e358997b5f2d9)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:06.973802 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e69953-2f5f-4ba3-b2bc-4cfdc8f8c279 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:07.194748 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-09e69953-2f5f-4ba3-b2bc-4cfdc8f8c279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba4dda978256417aa18e358997b5f2d9', 'request_id': 'req-09e69953-2f5f-4ba3-b2bc-4cfdc8f8c279'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:07.201610 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-09e69953-2f5f-4ba3-b2bc-4cfdc8f8c279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba4dda978256417aa18e358997b5f2d9', 'request_id': 'req-09e69953-2f5f-4ba3-b2bc-4cfdc8f8c279'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:07.313654 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-09e69953-2f5f-4ba3-b2bc-4cfdc8f8c279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba4dda978256417aa18e358997b5f2d9', 'request_id': 'req-09e69953-2f5f-4ba3-b2bc-4cfdc8f8c279'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:07.324490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-09e69953-2f5f-4ba3-b2bc-4cfdc8f8c279 admin admin] The token cache is being invalidate because project ba4dda978256417aa18e358997b5f2d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:30:07.324775 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-09e69953-2f5f-4ba3-b2bc-4cfdc8f8c279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:07.325439 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-09e69953-2f5f-4ba3-b2bc-4cfdc8f8c279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:07.327181 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1301/2601] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:30:06 2022] DELETE /identity/v3/projects/ba4dda978256417aa18e358997b5f2d9 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:07.331893 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2293b1-e529-43c2-ba89-19b00173cd8f service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:07.342299 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2293b1-e529-43c2-ba89-19b00173cd8f service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:07.361166 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:07.399231 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3542480-8675-439a-a039-fa7867f18b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:07.400107 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3542480-8675-439a-a039-fa7867f18b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:07.400386 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3542480-8675-439a-a039-fa7867f18b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:07.400659 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3542480-8675-439a-a039-fa7867f18b66 admin admin] PATH_INFO: `/v3/users/4edd7382b07b45198da32d64c4f2a227` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:07.403350 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3542480-8675-439a-a039-fa7867f18b66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4edd7382b07b45198da32d64c4f2a227)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:07.405380 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3542480-8675-439a-a039-fa7867f18b66 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:07.630531 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-d3542480-8675-439a-a039-fa7867f18b66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4edd7382b07b45198da32d64c4f2a227'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:07.631220 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-d3542480-8675-439a-a039-fa7867f18b66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4edd7382b07b45198da32d64c4f2a227'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:07.742388 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-d3542480-8675-439a-a039-fa7867f18b66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4edd7382b07b45198da32d64c4f2a227'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:07.755028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-d3542480-8675-439a-a039-fa7867f18b66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4edd7382b07b45198da32d64c4f2a227'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:07.761972 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-d3542480-8675-439a-a039-fa7867f18b66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4edd7382b07b45198da32d64c4f2a227'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:07.767926 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1301/2602] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:30:07 2022] DELETE /identity/v3/users/4edd7382b07b45198da32d64c4f2a227 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:08.269576 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e69953-2f5f-4ba3-b2bc-4cfdc8f8c279 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:08.271040 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-09e69953-2f5f-4ba3-b2bc-4cfdc8f8c279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:08.287515 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e69953-2f5f-4ba3-b2bc-4cfdc8f8c279 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:08.348580 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c81ed-d8af-427f-9a57-419c3984e330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:08.349498 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c81ed-d8af-427f-9a57-419c3984e330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:08.349810 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c81ed-d8af-427f-9a57-419c3984e330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:08.350085 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c81ed-d8af-427f-9a57-419c3984e330 admin admin] PATH_INFO: `/v3/projects/78859ffc28b447daa1b4d2fa0b97cd68` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:08.351337 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c81ed-d8af-427f-9a57-419c3984e330 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78859ffc28b447daa1b4d2fa0b97cd68)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:08.353304 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c81ed-d8af-427f-9a57-419c3984e330 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:08.492429 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:08.509585 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-eb4c81ed-d8af-427f-9a57-419c3984e330 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78859ffc28b447daa1b4d2fa0b97cd68', 'request_id': 'req-eb4c81ed-d8af-427f-9a57-419c3984e330'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:08.519794 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-eb4c81ed-d8af-427f-9a57-419c3984e330 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78859ffc28b447daa1b4d2fa0b97cd68', 'request_id': 'req-eb4c81ed-d8af-427f-9a57-419c3984e330'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:08.564744 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-eb4c81ed-d8af-427f-9a57-419c3984e330 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78859ffc28b447daa1b4d2fa0b97cd68', 'request_id': 'req-eb4c81ed-d8af-427f-9a57-419c3984e330'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:08.576166 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-eb4c81ed-d8af-427f-9a57-419c3984e330 admin admin] The token cache is being invalidate because project 78859ffc28b447daa1b4d2fa0b97cd68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:30:08.577031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-eb4c81ed-d8af-427f-9a57-419c3984e330 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:08.577304 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-eb4c81ed-d8af-427f-9a57-419c3984e330 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:08.579292 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1302/2603] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:30:08 2022] DELETE /identity/v3/projects/78859ffc28b447daa1b4d2fa0b97cd68 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:08.584024 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c37df-a599-4fca-b93d-f2d1744af2d1 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:08.584498 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c37df-a599-4fca-b93d-f2d1744af2d1 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:08.584605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c37df-a599-4fca-b93d-f2d1744af2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:08.602313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-4c3c37df-a599-4fca-b93d-f2d1744af2d1 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:08.603508 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-4c3c37df-a599-4fca-b93d-f2d1744af2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:08.661741 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1302/2604] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:30:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:08.669663 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672970ed-cc94-494a-b454-36866122bd11 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:08.669963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672970ed-cc94-494a-b454-36866122bd11 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:08.670241 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672970ed-cc94-494a-b454-36866122bd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:08.690442 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-672970ed-cc94-494a-b454-36866122bd11 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:08.691648 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-672970ed-cc94-494a-b454-36866122bd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:08.700176 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1303/2605] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:30:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:30:08.704381 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c37df-a599-4fca-b93d-f2d1744af2d1 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:08.714517 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c37df-a599-4fca-b93d-f2d1744af2d1 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:08.719085 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279f976-6591-406d-9309-8f704f38e7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:08.719739 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279f976-6591-406d-9309-8f704f38e7ce admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:08.720036 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279f976-6591-406d-9309-8f704f38e7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:08.720297 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279f976-6591-406d-9309-8f704f38e7ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:08.721083 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279f976-6591-406d-9309-8f704f38e7ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:30:08.721396 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279f976-6591-406d-9309-8f704f38e7ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:08.722979 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279f976-6591-406d-9309-8f704f38e7ce admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:08.734931 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1303/2606] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:30:08.739292 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672970ed-cc94-494a-b454-36866122bd11 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:08.749112 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672970ed-cc94-494a-b454-36866122bd11 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:08.753804 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927af3a-d936-4d37-a5b7-41cee2ddd535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:08.754450 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927af3a-d936-4d37-a5b7-41cee2ddd535 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:08.754731 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927af3a-d936-4d37-a5b7-41cee2ddd535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:08.755007 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927af3a-d936-4d37-a5b7-41cee2ddd535 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:08.755700 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927af3a-d936-4d37-a5b7-41cee2ddd535 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:08.757635 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927af3a-d936-4d37-a5b7-41cee2ddd535 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:08.847110 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1304/2607] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:30:08 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:30:08.851292 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279f976-6591-406d-9309-8f704f38e7ce admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:08.861810 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279f976-6591-406d-9309-8f704f38e7ce admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:08.887999 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:08.919130 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7f473-41a7-4b92-b215-86c000f75008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:08.919798 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7f473-41a7-4b92-b215-86c000f75008 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:08.920080 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7f473-41a7-4b92-b215-86c000f75008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:08.920363 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7f473-41a7-4b92-b215-86c000f75008 admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:08.921125 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7f473-41a7-4b92-b215-86c000f75008 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:08.923016 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a7f473-41a7-4b92-b215-86c000f75008 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:09.027812 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1304/2608] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:30:08 2022] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:30:09.032240 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927af3a-d936-4d37-a5b7-41cee2ddd535 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:09.043193 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927af3a-d936-4d37-a5b7-41cee2ddd535 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:09.048432 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f67b32-aee7-4fb2-9e69-93671e0dc581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:09.049170 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f67b32-aee7-4fb2-9e69-93671e0dc581 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:09.049457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f67b32-aee7-4fb2-9e69-93671e0dc581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:09.049735 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f67b32-aee7-4fb2-9e69-93671e0dc581 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:09.050468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f67b32-aee7-4fb2-9e69-93671e0dc581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:09.052079 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f67b32-aee7-4fb2-9e69-93671e0dc581 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:09.063389 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1305/2609] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:30:09.067474 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7f473-41a7-4b92-b215-86c000f75008 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:09.077727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7f473-41a7-4b92-b215-86c000f75008 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:09.082558 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559ff8f-d5df-48f0-8840-215a4a72df96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:09.083212 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559ff8f-d5df-48f0-8840-215a4a72df96 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:09.083544 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559ff8f-d5df-48f0-8840-215a4a72df96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:09.083827 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559ff8f-d5df-48f0-8840-215a4a72df96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:09.084585 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559ff8f-d5df-48f0-8840-215a4a72df96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:09.086831 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559ff8f-d5df-48f0-8840-215a4a72df96 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:09.097317 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1305/2610] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:30:09.101584 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f67b32-aee7-4fb2-9e69-93671e0dc581 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:09.112432 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f67b32-aee7-4fb2-9e69-93671e0dc581 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:09.117245 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72270322-de44-4e59-bb96-0b9717c75643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:09.118081 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72270322-de44-4e59-bb96-0b9717c75643 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:09.118380 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72270322-de44-4e59-bb96-0b9717c75643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:09.118637 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72270322-de44-4e59-bb96-0b9717c75643 admin admin] PATH_INFO: `/v3/projects/4afe921f6e554cc6b9786726e2aebee4/users/0b8eed526f6b44ec8148f5b1d22333a1/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:09.133108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72270322-de44-4e59-bb96-0b9717c75643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4afe921f6e554cc6b9786726e2aebee4, user_id=0b8eed526f6b44ec8148f5b1d22333a1, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:09.135774 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72270322-de44-4e59-bb96-0b9717c75643 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:09.275534 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1306/2611] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:30:09 2022] PUT /identity/v3/projects/4afe921f6e554cc6b9786726e2aebee4/users/0b8eed526f6b44ec8148f5b1d22333a1/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:30:09.286083 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85bc24-1468-45a0-b659-7594b0761ec4 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:09.286375 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85bc24-1468-45a0-b659-7594b0761ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:09.286663 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85bc24-1468-45a0-b659-7594b0761ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:09.314410 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-da85bc24-1468-45a0-b659-7594b0761ec4 None None] MFA Rules not processed for user `0b8eed526f6b44ec8148f5b1d22333a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:09.315627 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-da85bc24-1468-45a0-b659-7594b0761ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:09.379880 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1306/2612] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:30:09 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:09.384661 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72270322-de44-4e59-bb96-0b9717c75643 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:09.447197 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72270322-de44-4e59-bb96-0b9717c75643 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:09.451907 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bb2f9-148b-418d-9bf3-a95596096c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:09.452623 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bb2f9-148b-418d-9bf3-a95596096c65 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:09.452933 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bb2f9-148b-418d-9bf3-a95596096c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:09.453213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bb2f9-148b-418d-9bf3-a95596096c65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:09.453898 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780bb2f9-148b-418d-9bf3-a95596096c65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:09.455865 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780bb2f9-148b-418d-9bf3-a95596096c65 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:09.560526 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1307/2613] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:30:09 2022] POST /identity/v3/projects => generated 367 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:30:09.564630 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85bc24-1468-45a0-b659-7594b0761ec4 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:09.576207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85bc24-1468-45a0-b659-7594b0761ec4 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:09.635950 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0df884-35e1-4516-b6b4-2fc7946a9709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:09.636641 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0df884-35e1-4516-b6b4-2fc7946a9709 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:09.637084 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0df884-35e1-4516-b6b4-2fc7946a9709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:09.637358 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0df884-35e1-4516-b6b4-2fc7946a9709 admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:09.638085 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0df884-35e1-4516-b6b4-2fc7946a9709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:09.640068 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0df884-35e1-4516-b6b4-2fc7946a9709 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:09.726173 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1307/2614] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:30:09 2022] POST /identity/v3/users => generated 290 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:30:09.730221 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bb2f9-148b-418d-9bf3-a95596096c65 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:09.741527 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bb2f9-148b-418d-9bf3-a95596096c65 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:09.747064 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e58843-3aa0-436a-a0fd-9e49be1b0e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:09.747771 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e58843-3aa0-436a-a0fd-9e49be1b0e4a admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:09.748059 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e58843-3aa0-436a-a0fd-9e49be1b0e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:09.748340 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e58843-3aa0-436a-a0fd-9e49be1b0e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:09.749180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e58843-3aa0-436a-a0fd-9e49be1b0e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:09.750809 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e58843-3aa0-436a-a0fd-9e49be1b0e4a admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:09.763634 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1308/2615] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:30:09.768095 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0df884-35e1-4516-b6b4-2fc7946a9709 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:09.779376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0df884-35e1-4516-b6b4-2fc7946a9709 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:09.785586 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2069779-7dbc-49ff-8a78-213f86d7582d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:09.786486 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2069779-7dbc-49ff-8a78-213f86d7582d admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:09.786923 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2069779-7dbc-49ff-8a78-213f86d7582d admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:09.787206 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2069779-7dbc-49ff-8a78-213f86d7582d admin admin] PATH_INFO: `/v3/projects/3b2c39bf42bb42d68e3b5d20cff3e063/users/12fc2709f6ab4669bd7c9ad738fa3ad2/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:09.806659 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2069779-7dbc-49ff-8a78-213f86d7582d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b2c39bf42bb42d68e3b5d20cff3e063, user_id=12fc2709f6ab4669bd7c9ad738fa3ad2, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:09.809391 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2069779-7dbc-49ff-8a78-213f86d7582d admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:09.928631 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1308/2616] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:30:09 2022] PUT /identity/v3/projects/3b2c39bf42bb42d68e3b5d20cff3e063/users/12fc2709f6ab4669bd7c9ad738fa3ad2/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:30:09.933360 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e58843-3aa0-436a-a0fd-9e49be1b0e4a admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:09.943431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e58843-3aa0-436a-a0fd-9e49be1b0e4a admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:09.965468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:10.005258 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58257e-ca72-4ad0-b2aa-f180a34dbb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:10.005932 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58257e-ca72-4ad0-b2aa-f180a34dbb53 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:10.006217 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58257e-ca72-4ad0-b2aa-f180a34dbb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:10.006496 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58257e-ca72-4ad0-b2aa-f180a34dbb53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:10.007228 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58257e-ca72-4ad0-b2aa-f180a34dbb53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:10.009587 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58257e-ca72-4ad0-b2aa-f180a34dbb53 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:10.019609 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1309/2617] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:30:10.023921 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2069779-7dbc-49ff-8a78-213f86d7582d admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:10.029358 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:10.034841 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2069779-7dbc-49ff-8a78-213f86d7582d admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:10.040043 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8cf05-0735-4f42-8004-4f6973cf9514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:10.041248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8cf05-0735-4f42-8004-4f6973cf9514 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:10.042481 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8cf05-0735-4f42-8004-4f6973cf9514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:10.042628 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8cf05-0735-4f42-8004-4f6973cf9514 admin admin] PATH_INFO: `/v3/projects/3b2c39bf42bb42d68e3b5d20cff3e063/users/12fc2709f6ab4669bd7c9ad738fa3ad2/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:10.046776 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8cf05-0735-4f42-8004-4f6973cf9514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b2c39bf42bb42d68e3b5d20cff3e063, user_id=12fc2709f6ab4669bd7c9ad738fa3ad2, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:10.049870 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8cf05-0735-4f42-8004-4f6973cf9514 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:10.062694 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1309/2618] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:30:10 2022] PUT /identity/v3/projects/3b2c39bf42bb42d68e3b5d20cff3e063/users/12fc2709f6ab4669bd7c9ad738fa3ad2/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:10.075388 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019ad61-3eaf-48ae-a0b7-20f8954fd404 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:10.075702 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019ad61-3eaf-48ae-a0b7-20f8954fd404 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:10.075989 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019ad61-3eaf-48ae-a0b7-20f8954fd404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:10.104636 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-5019ad61-3eaf-48ae-a0b7-20f8954fd404 None None] MFA Rules not processed for user `12fc2709f6ab4669bd7c9ad738fa3ad2`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:10.105895 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-5019ad61-3eaf-48ae-a0b7-20f8954fd404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:10.178416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1310/2619] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:30:10 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:10.190415 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8cf05-0735-4f42-8004-4f6973cf9514 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:10.192336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-30a8cf05-0735-4f42-8004-4f6973cf9514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:10.251521 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8cf05-0735-4f42-8004-4f6973cf9514 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:10.255304 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34385c-78d2-4649-be61-a84d4204cb45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:10.255955 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34385c-78d2-4649-be61-a84d4204cb45 service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:10.256241 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34385c-78d2-4649-be61-a84d4204cb45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:10.256518 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34385c-78d2-4649-be61-a84d4204cb45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:10.266429 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff34385c-78d2-4649-be61-a84d4204cb45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:10.267863 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff34385c-78d2-4649-be61-a84d4204cb45 service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:10.278333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1310/2620] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:30:10 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:30:13.211479 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019ad61-3eaf-48ae-a0b7-20f8954fd404 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:13.274184 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019ad61-3eaf-48ae-a0b7-20f8954fd404 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:13.278992 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8e36b-95cc-4d3c-b0c2-046e23ae7fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:13.279919 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8e36b-95cc-4d3c-b0c2-046e23ae7fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:13.280203 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8e36b-95cc-4d3c-b0c2-046e23ae7fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:13.280502 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8e36b-95cc-4d3c-b0c2-046e23ae7fad admin admin] PATH_INFO: `/v3/users/0b8eed526f6b44ec8148f5b1d22333a1` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:13.282000 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8e36b-95cc-4d3c-b0c2-046e23ae7fad admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b8eed526f6b44ec8148f5b1d22333a1)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:13.283977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8e36b-95cc-4d3c-b0c2-046e23ae7fad admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:13.562106 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-75b8e36b-95cc-4d3c-b0c2-046e23ae7fad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b8eed526f6b44ec8148f5b1d22333a1'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:13.575577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:13.575577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-75b8e36b-95cc-4d3c-b0c2-046e23ae7fad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b8eed526f6b44ec8148f5b1d22333a1'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:13.673471 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-75b8e36b-95cc-4d3c-b0c2-046e23ae7fad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b8eed526f6b44ec8148f5b1d22333a1'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:13.674099 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-75b8e36b-95cc-4d3c-b0c2-046e23ae7fad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b8eed526f6b44ec8148f5b1d22333a1'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:13.681818 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-75b8e36b-95cc-4d3c-b0c2-046e23ae7fad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b8eed526f6b44ec8148f5b1d22333a1'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:13.689967 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1311/2621] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:30:13 2022] DELETE /identity/v3/users/0b8eed526f6b44ec8148f5b1d22333a1 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:13.694656 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1930d70-869d-4e19-b0f4-a0b4bdbb8c98 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:13.695184 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1930d70-869d-4e19-b0f4-a0b4bdbb8c98 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:13.695184 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1930d70-869d-4e19-b0f4-a0b4bdbb8c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:13.714849 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-e1930d70-869d-4e19-b0f4-a0b4bdbb8c98 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:13.716381 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-e1930d70-869d-4e19-b0f4-a0b4bdbb8c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:13.779524 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1311/2622] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:30:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:30:13.790001 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8e36b-95cc-4d3c-b0c2-046e23ae7fad admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:13.791423 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-75b8e36b-95cc-4d3c-b0c2-046e23ae7fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:13.848116 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8e36b-95cc-4d3c-b0c2-046e23ae7fad admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:13.851823 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd051946-f825-479c-8910-4b07596809f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:13.853105 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd051946-f825-479c-8910-4b07596809f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:13.853399 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd051946-f825-479c-8910-4b07596809f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:13.853677 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd051946-f825-479c-8910-4b07596809f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:13.862923 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd051946-f825-479c-8910-4b07596809f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:13.864393 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd051946-f825-479c-8910-4b07596809f1 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:13.873955 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1312/2623] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:30:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:30:14.372751 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1930d70-869d-4e19-b0f4-a0b4bdbb8c98 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:14.374519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-e1930d70-869d-4e19-b0f4-a0b4bdbb8c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:14.388242 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1930d70-869d-4e19-b0f4-a0b4bdbb8c98 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:14.393209 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2eb123-83b3-427d-8aca-207a6869c747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:14.394083 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2eb123-83b3-427d-8aca-207a6869c747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:14.394467 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2eb123-83b3-427d-8aca-207a6869c747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:14.394649 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2eb123-83b3-427d-8aca-207a6869c747 admin admin] PATH_INFO: `/v3/projects/4afe921f6e554cc6b9786726e2aebee4` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:14.395860 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2eb123-83b3-427d-8aca-207a6869c747 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4afe921f6e554cc6b9786726e2aebee4)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:14.397836 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2eb123-83b3-427d-8aca-207a6869c747 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:14.519224 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-4b2eb123-83b3-427d-8aca-207a6869c747 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4afe921f6e554cc6b9786726e2aebee4', 'request_id': 'req-4b2eb123-83b3-427d-8aca-207a6869c747'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:14.524805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-4b2eb123-83b3-427d-8aca-207a6869c747 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4afe921f6e554cc6b9786726e2aebee4', 'request_id': 'req-4b2eb123-83b3-427d-8aca-207a6869c747'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:14.656714 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-4b2eb123-83b3-427d-8aca-207a6869c747 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4afe921f6e554cc6b9786726e2aebee4', 'request_id': 'req-4b2eb123-83b3-427d-8aca-207a6869c747'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:14.669443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-4b2eb123-83b3-427d-8aca-207a6869c747 admin admin] The token cache is being invalidate because project 4afe921f6e554cc6b9786726e2aebee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:30:14.669744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-4b2eb123-83b3-427d-8aca-207a6869c747 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:14.670438 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-4b2eb123-83b3-427d-8aca-207a6869c747 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:14.672061 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1312/2624] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:30:14 2022] DELETE /identity/v3/projects/4afe921f6e554cc6b9786726e2aebee4 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:14.676056 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd051946-f825-479c-8910-4b07596809f1 service neutron] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:14.686394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd051946-f825-479c-8910-4b07596809f1 service neutron] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:14.744090 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5130c-48ef-42ab-8264-afa9e0dc4a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:14.745028 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5130c-48ef-42ab-8264-afa9e0dc4a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:14.745315 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5130c-48ef-42ab-8264-afa9e0dc4a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:14.745594 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5130c-48ef-42ab-8264-afa9e0dc4a40 admin admin] PATH_INFO: `/v3/users/12fc2709f6ab4669bd7c9ad738fa3ad2` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:14.746800 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a5130c-48ef-42ab-8264-afa9e0dc4a40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12fc2709f6ab4669bd7c9ad738fa3ad2)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:14.748770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a5130c-48ef-42ab-8264-afa9e0dc4a40 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:15.094756 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-75a5130c-48ef-42ab-8264-afa9e0dc4a40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12fc2709f6ab4669bd7c9ad738fa3ad2'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:15.107606 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-75a5130c-48ef-42ab-8264-afa9e0dc4a40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12fc2709f6ab4669bd7c9ad738fa3ad2'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:15.111310 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:15.262090 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-75a5130c-48ef-42ab-8264-afa9e0dc4a40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12fc2709f6ab4669bd7c9ad738fa3ad2'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:15.262723 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-75a5130c-48ef-42ab-8264-afa9e0dc4a40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12fc2709f6ab4669bd7c9ad738fa3ad2'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:15.270336 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-75a5130c-48ef-42ab-8264-afa9e0dc4a40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12fc2709f6ab4669bd7c9ad738fa3ad2'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:15.276876 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1313/2625] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:30:14 2022] DELETE /identity/v3/users/12fc2709f6ab4669bd7c9ad738fa3ad2 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:15.910174 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2eb123-83b3-427d-8aca-207a6869c747 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:15.911804 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-4b2eb123-83b3-427d-8aca-207a6869c747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:15.927575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2eb123-83b3-427d-8aca-207a6869c747 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:15.941622 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:15.998534 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30293800-79aa-459b-af6e-bddaffc815a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:15.999441 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30293800-79aa-459b-af6e-bddaffc815a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:15.999733 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30293800-79aa-459b-af6e-bddaffc815a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:16.000009 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30293800-79aa-459b-af6e-bddaffc815a0 admin admin] PATH_INFO: `/v3/projects/3b2c39bf42bb42d68e3b5d20cff3e063` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:16.001277 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30293800-79aa-459b-af6e-bddaffc815a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b2c39bf42bb42d68e3b5d20cff3e063)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:16.003908 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30293800-79aa-459b-af6e-bddaffc815a0 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:16.240252 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-30293800-79aa-459b-af6e-bddaffc815a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b2c39bf42bb42d68e3b5d20cff3e063', 'request_id': 'req-30293800-79aa-459b-af6e-bddaffc815a0'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:16.246420 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-30293800-79aa-459b-af6e-bddaffc815a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b2c39bf42bb42d68e3b5d20cff3e063', 'request_id': 'req-30293800-79aa-459b-af6e-bddaffc815a0'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:16.383174 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-30293800-79aa-459b-af6e-bddaffc815a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b2c39bf42bb42d68e3b5d20cff3e063', 'request_id': 'req-30293800-79aa-459b-af6e-bddaffc815a0'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:16.396007 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-30293800-79aa-459b-af6e-bddaffc815a0 admin admin] The token cache is being invalidate because project 3b2c39bf42bb42d68e3b5d20cff3e063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:30:16.396306 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-30293800-79aa-459b-af6e-bddaffc815a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:16.399466 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-30293800-79aa-459b-af6e-bddaffc815a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:16.399673 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1313/2626] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:30:15 2022] DELETE /identity/v3/projects/3b2c39bf42bb42d68e3b5d20cff3e063 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:16.404661 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8595b-10c4-4b70-b115-8908d4b0099e None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:16.405240 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8595b-10c4-4b70-b115-8908d4b0099e None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:16.405344 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8595b-10c4-4b70-b115-8908d4b0099e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:16.428283 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-1cd8595b-10c4-4b70-b115-8908d4b0099e None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:16.430407 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-1cd8595b-10c4-4b70-b115-8908d4b0099e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:16.506726 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1314/2627] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:16.514557 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83ae96-a066-41de-bf39-6e35b338e2cf None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:16.515595 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83ae96-a066-41de-bf39-6e35b338e2cf None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:16.515885 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83ae96-a066-41de-bf39-6e35b338e2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:16.534544 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-8b83ae96-a066-41de-bf39-6e35b338e2cf None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:16.535753 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-8b83ae96-a066-41de-bf39-6e35b338e2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:16.544382 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1314/2628] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:30:16.548699 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8595b-10c4-4b70-b115-8908d4b0099e None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:16.559309 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8595b-10c4-4b70-b115-8908d4b0099e None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:16.564649 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a56d1-2418-41ef-8610-e03b1eb71b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:16.565361 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a56d1-2418-41ef-8610-e03b1eb71b2f admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:16.565647 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a56d1-2418-41ef-8610-e03b1eb71b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:16.565921 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a56d1-2418-41ef-8610-e03b1eb71b2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:16.566652 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a56d1-2418-41ef-8610-e03b1eb71b2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:30:16.566961 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a56d1-2418-41ef-8610-e03b1eb71b2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:16.568599 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a56d1-2418-41ef-8610-e03b1eb71b2f admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:16.581046 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1315/2629] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:30:16.585336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83ae96-a066-41de-bf39-6e35b338e2cf None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:16.595505 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83ae96-a066-41de-bf39-6e35b338e2cf None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:16.600337 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351994d4-366f-4b57-b473-98db3a1dc2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:16.601048 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351994d4-366f-4b57-b473-98db3a1dc2ae admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:16.601350 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351994d4-366f-4b57-b473-98db3a1dc2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:16.601735 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351994d4-366f-4b57-b473-98db3a1dc2ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:16.602925 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351994d4-366f-4b57-b473-98db3a1dc2ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:16.604891 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351994d4-366f-4b57-b473-98db3a1dc2ae admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:16.755638 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1315/2630] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:30:16 2022] POST /identity/v3/projects => generated 369 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:30:16.759923 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a56d1-2418-41ef-8610-e03b1eb71b2f admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:16.770307 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a56d1-2418-41ef-8610-e03b1eb71b2f admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:16.837131 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1c241-4cef-4087-86ec-890a7a463a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:16.837810 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1c241-4cef-4087-86ec-890a7a463a58 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:16.838095 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1c241-4cef-4087-86ec-890a7a463a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:16.838372 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1c241-4cef-4087-86ec-890a7a463a58 admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:16.839097 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1c241-4cef-4087-86ec-890a7a463a58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:16.841118 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1c241-4cef-4087-86ec-890a7a463a58 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:16.953624 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1316/2631] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:30:16 2022] POST /identity/v3/users => generated 285 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:30:16.957889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351994d4-366f-4b57-b473-98db3a1dc2ae admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:16.969012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351994d4-366f-4b57-b473-98db3a1dc2ae admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:16.973653 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552b5fa-dcb0-4216-877d-70d011c877e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:16.974307 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552b5fa-dcb0-4216-877d-70d011c877e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:16.974591 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552b5fa-dcb0-4216-877d-70d011c877e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:16.974874 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552b5fa-dcb0-4216-877d-70d011c877e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:16.975841 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552b5fa-dcb0-4216-877d-70d011c877e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:16.978061 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552b5fa-dcb0-4216-877d-70d011c877e7 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:16.988575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1316/2632] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:30:16.995293 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1c241-4cef-4087-86ec-890a7a463a58 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:17.005839 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1c241-4cef-4087-86ec-890a7a463a58 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:17.011007 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0de20-ca6d-445d-85f7-220a270f6dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:17.011599 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0de20-ca6d-445d-85f7-220a270f6dbd admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:17.011882 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0de20-ca6d-445d-85f7-220a270f6dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:17.012155 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0de20-ca6d-445d-85f7-220a270f6dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:17.012915 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0de20-ca6d-445d-85f7-220a270f6dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:17.014511 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0de20-ca6d-445d-85f7-220a270f6dbd admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:17.025098 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1317/2633] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:30:17.029681 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552b5fa-dcb0-4216-877d-70d011c877e7 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:17.040797 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552b5fa-dcb0-4216-877d-70d011c877e7 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:17.046917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f274934-4d97-46f3-8e0b-3e548b3b27c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:17.046917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f274934-4d97-46f3-8e0b-3e548b3b27c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:17.047191 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f274934-4d97-46f3-8e0b-3e548b3b27c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:17.047484 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f274934-4d97-46f3-8e0b-3e548b3b27c8 admin admin] PATH_INFO: `/v3/projects/130fef9a9c2649f99ecb37d4501e7a22/users/701d6430b05544fb82e150a5ec6b655a/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:17.063473 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f274934-4d97-46f3-8e0b-3e548b3b27c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=130fef9a9c2649f99ecb37d4501e7a22, user_id=701d6430b05544fb82e150a5ec6b655a, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:17.066241 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f274934-4d97-46f3-8e0b-3e548b3b27c8 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:17.259725 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1317/2634] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:30:17 2022] PUT /identity/v3/projects/130fef9a9c2649f99ecb37d4501e7a22/users/701d6430b05544fb82e150a5ec6b655a/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:17.279040 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f94a2b-632a-4078-8b56-abf08c6e2966 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:17.279040 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f94a2b-632a-4078-8b56-abf08c6e2966 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:17.279040 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f94a2b-632a-4078-8b56-abf08c6e2966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:17.303303 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-d3f94a2b-632a-4078-8b56-abf08c6e2966 None None] MFA Rules not processed for user `701d6430b05544fb82e150a5ec6b655a`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:17.304518 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-d3f94a2b-632a-4078-8b56-abf08c6e2966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:17.347195 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:17.372578 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1318/2635] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:30:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:17.377078 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f274934-4d97-46f3-8e0b-3e548b3b27c8 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:17.425374 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:17.443748 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f274934-4d97-46f3-8e0b-3e548b3b27c8 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:17.449619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e7751-f905-4dc2-8328-e0f50d362e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:17.449948 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e7751-f905-4dc2-8328-e0f50d362e5c admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:17.450232 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e7751-f905-4dc2-8328-e0f50d362e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:17.450508 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e7751-f905-4dc2-8328-e0f50d362e5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:17.451210 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e7751-f905-4dc2-8328-e0f50d362e5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:17.453127 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e7751-f905-4dc2-8328-e0f50d362e5c admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:17.606896 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1318/2636] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:30:17 2022] POST /identity/v3/projects => generated 367 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:30:17.611039 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f94a2b-632a-4078-8b56-abf08c6e2966 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:17.622600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f94a2b-632a-4078-8b56-abf08c6e2966 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:17.678647 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7949d0b-2c47-4b4a-98b2-29f4c1a58022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:17.679289 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7949d0b-2c47-4b4a-98b2-29f4c1a58022 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:17.684406 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7949d0b-2c47-4b4a-98b2-29f4c1a58022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:17.684406 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7949d0b-2c47-4b4a-98b2-29f4c1a58022 admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:17.684406 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7949d0b-2c47-4b4a-98b2-29f4c1a58022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:17.684406 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7949d0b-2c47-4b4a-98b2-29f4c1a58022 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:17.840187 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1319/2637] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:30:17 2022] POST /identity/v3/users => generated 290 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:30:17.844568 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e7751-f905-4dc2-8328-e0f50d362e5c admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:17.855501 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e7751-f905-4dc2-8328-e0f50d362e5c admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:17.862011 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e2f24-3ebd-4ee4-9a55-5ed6a8288efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:17.862011 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e2f24-3ebd-4ee4-9a55-5ed6a8288efa admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:17.862011 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e2f24-3ebd-4ee4-9a55-5ed6a8288efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:17.862011 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e2f24-3ebd-4ee4-9a55-5ed6a8288efa admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:17.862452 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e2f24-3ebd-4ee4-9a55-5ed6a8288efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:17.863726 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e2f24-3ebd-4ee4-9a55-5ed6a8288efa admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:17.875513 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1319/2638] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:30:17.879786 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7949d0b-2c47-4b4a-98b2-29f4c1a58022 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:17.890491 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7949d0b-2c47-4b4a-98b2-29f4c1a58022 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:17.895922 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474933d-7a95-4bf6-835c-1a393a4eaa75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:17.896892 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474933d-7a95-4bf6-835c-1a393a4eaa75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:17.897219 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474933d-7a95-4bf6-835c-1a393a4eaa75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:17.897515 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474933d-7a95-4bf6-835c-1a393a4eaa75 admin admin] PATH_INFO: `/v3/projects/809beb5664ff49caadd4501826242387/users/2c363ed2a39c48f79c9244e1dda43afd/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:17.914587 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474933d-7a95-4bf6-835c-1a393a4eaa75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=809beb5664ff49caadd4501826242387, user_id=2c363ed2a39c48f79c9244e1dda43afd, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:17.918314 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474933d-7a95-4bf6-835c-1a393a4eaa75 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:18.131660 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1320/2639] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:30:17 2022] PUT /identity/v3/projects/809beb5664ff49caadd4501826242387/users/2c363ed2a39c48f79c9244e1dda43afd/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:18.135929 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e2f24-3ebd-4ee4-9a55-5ed6a8288efa admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:18.146132 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e2f24-3ebd-4ee4-9a55-5ed6a8288efa admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:18.201589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9070ab-1d71-469c-8c2e-da46ecd910f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:18.202278 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9070ab-1d71-469c-8c2e-da46ecd910f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:18.202565 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9070ab-1d71-469c-8c2e-da46ecd910f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:18.202845 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9070ab-1d71-469c-8c2e-da46ecd910f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:18.203578 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9070ab-1d71-469c-8c2e-da46ecd910f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:18.205230 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9070ab-1d71-469c-8c2e-da46ecd910f7 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:18.215363 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1320/2640] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:30:18.219694 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474933d-7a95-4bf6-835c-1a393a4eaa75 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:18.231124 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474933d-7a95-4bf6-835c-1a393a4eaa75 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:18.235815 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40856fbd-0dfc-43d0-a160-6684e8aedd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:18.236727 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40856fbd-0dfc-43d0-a160-6684e8aedd92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:18.237039 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40856fbd-0dfc-43d0-a160-6684e8aedd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:18.237319 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40856fbd-0dfc-43d0-a160-6684e8aedd92 admin admin] PATH_INFO: `/v3/projects/809beb5664ff49caadd4501826242387/users/2c363ed2a39c48f79c9244e1dda43afd/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:18.239286 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40856fbd-0dfc-43d0-a160-6684e8aedd92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=809beb5664ff49caadd4501826242387, user_id=2c363ed2a39c48f79c9244e1dda43afd, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:18.241987 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40856fbd-0dfc-43d0-a160-6684e8aedd92 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:18.252311 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1321/2641] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:30:18 2022] PUT /identity/v3/projects/809beb5664ff49caadd4501826242387/users/2c363ed2a39c48f79c9244e1dda43afd/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:18.262722 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac758d7-d610-4a52-8200-9277e4a16aec None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:18.262999 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac758d7-d610-4a52-8200-9277e4a16aec None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:18.263279 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac758d7-d610-4a52-8200-9277e4a16aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:18.289990 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-eac758d7-d610-4a52-8200-9277e4a16aec None None] MFA Rules not processed for user `2c363ed2a39c48f79c9244e1dda43afd`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:18.291293 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-eac758d7-d610-4a52-8200-9277e4a16aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:18.357389 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1321/2642] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:30:18 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:18.369060 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40856fbd-0dfc-43d0-a160-6684e8aedd92 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:18.370776 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-40856fbd-0dfc-43d0-a160-6684e8aedd92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:18.442857 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40856fbd-0dfc-43d0-a160-6684e8aedd92 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:18.446789 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df0ec0-2b29-4ccb-a417-5878dfec4081 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:18.447458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df0ec0-2b29-4ccb-a417-5878dfec4081 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:18.447745 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df0ec0-2b29-4ccb-a417-5878dfec4081 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:18.448027 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df0ec0-2b29-4ccb-a417-5878dfec4081 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:18.460605 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df0ec0-2b29-4ccb-a417-5878dfec4081 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:18.463570 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df0ec0-2b29-4ccb-a417-5878dfec4081 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:18.483251 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1322/2643] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:30:18 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:30:18.842788 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac758d7-d610-4a52-8200-9277e4a16aec None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:18.844241 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-eac758d7-d610-4a52-8200-9277e4a16aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:18.856447 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac758d7-d610-4a52-8200-9277e4a16aec None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:18.860028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f4519-0911-4cf8-964a-8c67a3e9e758 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:18.860669 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f4519-0911-4cf8-964a-8c67a3e9e758 service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:18.860988 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f4519-0911-4cf8-964a-8c67a3e9e758 service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:18.861267 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f4519-0911-4cf8-964a-8c67a3e9e758 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:18.895667 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:18.918583 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f4519-0911-4cf8-964a-8c67a3e9e758 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:18.920050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f4519-0911-4cf8-964a-8c67a3e9e758 service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:18.929000 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1322/2644] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:30:18 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:30:24.414688 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df0ec0-2b29-4ccb-a417-5878dfec4081 service cinder] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:24.458181 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:24.479846 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df0ec0-2b29-4ccb-a417-5878dfec4081 service cinder] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:24.484772 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a889f9c-a74d-4fe1-809e-155f50c434e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:24.485681 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a889f9c-a74d-4fe1-809e-155f50c434e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:24.485989 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a889f9c-a74d-4fe1-809e-155f50c434e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:24.486268 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a889f9c-a74d-4fe1-809e-155f50c434e0 admin admin] PATH_INFO: `/v3/users/701d6430b05544fb82e150a5ec6b655a` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:24.487469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a889f9c-a74d-4fe1-809e-155f50c434e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=701d6430b05544fb82e150a5ec6b655a)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:24.489604 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a889f9c-a74d-4fe1-809e-155f50c434e0 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:24.757003 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-2a889f9c-a74d-4fe1-809e-155f50c434e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '701d6430b05544fb82e150a5ec6b655a'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:24.770044 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-2a889f9c-a74d-4fe1-809e-155f50c434e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '701d6430b05544fb82e150a5ec6b655a'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:24.861786 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-2a889f9c-a74d-4fe1-809e-155f50c434e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '701d6430b05544fb82e150a5ec6b655a'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:24.862406 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-2a889f9c-a74d-4fe1-809e-155f50c434e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '701d6430b05544fb82e150a5ec6b655a'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:24.870624 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-2a889f9c-a74d-4fe1-809e-155f50c434e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '701d6430b05544fb82e150a5ec6b655a'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:24.876629 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1323/2645] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:30:24 2022] DELETE /identity/v3/users/701d6430b05544fb82e150a5ec6b655a => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:24.881164 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4931e9-0c7f-41e8-9bfc-5bd468efeddf None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:24.881643 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4931e9-0c7f-41e8-9bfc-5bd468efeddf None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:24.881741 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4931e9-0c7f-41e8-9bfc-5bd468efeddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:24.899136 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-3d4931e9-0c7f-41e8-9bfc-5bd468efeddf None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:24.900340 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-3d4931e9-0c7f-41e8-9bfc-5bd468efeddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:24.958994 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1323/2646] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:30:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:24.969053 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a889f9c-a74d-4fe1-809e-155f50c434e0 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:24.970488 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-2a889f9c-a74d-4fe1-809e-155f50c434e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:25.028249 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a889f9c-a74d-4fe1-809e-155f50c434e0 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:25.032129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b1a8f-2fa9-459f-b0d0-5be9feb543c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:25.032778 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b1a8f-2fa9-459f-b0d0-5be9feb543c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:25.033090 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b1a8f-2fa9-459f-b0d0-5be9feb543c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:25.033366 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b1a8f-2fa9-459f-b0d0-5be9feb543c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:25.042733 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b1a8f-2fa9-459f-b0d0-5be9feb543c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:25.044228 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b1a8f-2fa9-459f-b0d0-5be9feb543c3 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:25.053810 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1324/2647] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:30:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:30:25.487058 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4931e9-0c7f-41e8-9bfc-5bd468efeddf None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:25.495139 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-3d4931e9-0c7f-41e8-9bfc-5bd468efeddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:25.516552 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4931e9-0c7f-41e8-9bfc-5bd468efeddf None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:25.529193 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7560cee-4055-42d1-8551-39c685615eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:25.530080 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7560cee-4055-42d1-8551-39c685615eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:25.530357 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7560cee-4055-42d1-8551-39c685615eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:25.530891 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7560cee-4055-42d1-8551-39c685615eca admin admin] PATH_INFO: `/v3/projects/130fef9a9c2649f99ecb37d4501e7a22` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:25.532095 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7560cee-4055-42d1-8551-39c685615eca admin admin] RBAC: Authorizing `identity:delete_project(project_id=130fef9a9c2649f99ecb37d4501e7a22)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:25.534127 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7560cee-4055-42d1-8551-39c685615eca admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:25.668602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-a7560cee-4055-42d1-8551-39c685615eca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '130fef9a9c2649f99ecb37d4501e7a22', 'request_id': 'req-a7560cee-4055-42d1-8551-39c685615eca'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:25.675122 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-a7560cee-4055-42d1-8551-39c685615eca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '130fef9a9c2649f99ecb37d4501e7a22', 'request_id': 'req-a7560cee-4055-42d1-8551-39c685615eca'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:25.747519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-a7560cee-4055-42d1-8551-39c685615eca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '130fef9a9c2649f99ecb37d4501e7a22', 'request_id': 'req-a7560cee-4055-42d1-8551-39c685615eca'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:25.760183 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-a7560cee-4055-42d1-8551-39c685615eca admin admin] The token cache is being invalidate because project 130fef9a9c2649f99ecb37d4501e7a22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:30:25.760466 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-a7560cee-4055-42d1-8551-39c685615eca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:25.761137 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-a7560cee-4055-42d1-8551-39c685615eca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:25.762704 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1324/2648] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:30:25 2022] DELETE /identity/v3/projects/130fef9a9c2649f99ecb37d4501e7a22 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:25.770071 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b1a8f-2fa9-459f-b0d0-5be9feb543c3 service neutron] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:25.777042 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b1a8f-2fa9-459f-b0d0-5be9feb543c3 service neutron] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:25.839418 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475b895-61d3-4844-b000-fce0029628b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:25.840295 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475b895-61d3-4844-b000-fce0029628b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:25.840577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475b895-61d3-4844-b000-fce0029628b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:25.840877 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475b895-61d3-4844-b000-fce0029628b2 admin admin] PATH_INFO: `/v3/users/2c363ed2a39c48f79c9244e1dda43afd` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:25.842078 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475b895-61d3-4844-b000-fce0029628b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c363ed2a39c48f79c9244e1dda43afd)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:25.844140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475b895-61d3-4844-b000-fce0029628b2 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:25.845851 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:26.196854 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-c475b895-61d3-4844-b000-fce0029628b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c363ed2a39c48f79c9244e1dda43afd'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:26.209360 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-c475b895-61d3-4844-b000-fce0029628b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c363ed2a39c48f79c9244e1dda43afd'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:26.342159 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-c475b895-61d3-4844-b000-fce0029628b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c363ed2a39c48f79c9244e1dda43afd'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:26.342868 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-c475b895-61d3-4844-b000-fce0029628b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c363ed2a39c48f79c9244e1dda43afd'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:26.362079 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-c475b895-61d3-4844-b000-fce0029628b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c363ed2a39c48f79c9244e1dda43afd'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:26.370796 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1325/2649] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:30:25 2022] DELETE /identity/v3/users/2c363ed2a39c48f79c9244e1dda43afd => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:26.946101 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7560cee-4055-42d1-8551-39c685615eca admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:26.946101 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-a7560cee-4055-42d1-8551-39c685615eca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:26.970237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7560cee-4055-42d1-8551-39c685615eca admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:27.037649 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39082819-8498-4ec3-8977-6751a59bb0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:27.038519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39082819-8498-4ec3-8977-6751a59bb0d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:27.038806 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39082819-8498-4ec3-8977-6751a59bb0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:27.039086 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39082819-8498-4ec3-8977-6751a59bb0d7 admin admin] PATH_INFO: `/v3/projects/809beb5664ff49caadd4501826242387` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:27.040288 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39082819-8498-4ec3-8977-6751a59bb0d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=809beb5664ff49caadd4501826242387)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:27.042282 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39082819-8498-4ec3-8977-6751a59bb0d7 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:27.044105 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:27.178619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-39082819-8498-4ec3-8977-6751a59bb0d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '809beb5664ff49caadd4501826242387', 'request_id': 'req-39082819-8498-4ec3-8977-6751a59bb0d7'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:27.185110 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-39082819-8498-4ec3-8977-6751a59bb0d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '809beb5664ff49caadd4501826242387', 'request_id': 'req-39082819-8498-4ec3-8977-6751a59bb0d7'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:27.250916 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-39082819-8498-4ec3-8977-6751a59bb0d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '809beb5664ff49caadd4501826242387', 'request_id': 'req-39082819-8498-4ec3-8977-6751a59bb0d7'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:27.266047 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-39082819-8498-4ec3-8977-6751a59bb0d7 admin admin] The token cache is being invalidate because project 809beb5664ff49caadd4501826242387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:30:27.266196 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-39082819-8498-4ec3-8977-6751a59bb0d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:27.266934 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-39082819-8498-4ec3-8977-6751a59bb0d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:27.268674 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1325/2650] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:30:26 2022] DELETE /identity/v3/projects/809beb5664ff49caadd4501826242387 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:27.274483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c76ef-8137-40e3-96c9-199f33f5b916 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:27.275033 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c76ef-8137-40e3-96c9-199f33f5b916 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:27.275033 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c76ef-8137-40e3-96c9-199f33f5b916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:27.294460 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-e12c76ef-8137-40e3-96c9-199f33f5b916 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:27.295702 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-e12c76ef-8137-40e3-96c9-199f33f5b916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:27.360639 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1326/2651] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:27.370348 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300692b9-1160-47de-b0df-9a20df68fc07 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:27.370673 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300692b9-1160-47de-b0df-9a20df68fc07 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:27.370970 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300692b9-1160-47de-b0df-9a20df68fc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:27.395619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-300692b9-1160-47de-b0df-9a20df68fc07 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:27.396994 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-300692b9-1160-47de-b0df-9a20df68fc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:27.409570 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1326/2652] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:27.413838 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c76ef-8137-40e3-96c9-199f33f5b916 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:27.424349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c76ef-8137-40e3-96c9-199f33f5b916 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:27.429460 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a69eec-ef22-4e87-bb19-5a5dd65879e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:27.430139 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a69eec-ef22-4e87-bb19-5a5dd65879e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:27.430424 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a69eec-ef22-4e87-bb19-5a5dd65879e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:27.430733 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a69eec-ef22-4e87-bb19-5a5dd65879e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:27.431501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a69eec-ef22-4e87-bb19-5a5dd65879e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:30:27.432401 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a69eec-ef22-4e87-bb19-5a5dd65879e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:27.434055 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a69eec-ef22-4e87-bb19-5a5dd65879e8 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:27.450115 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1327/2653] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:30:27.451519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300692b9-1160-47de-b0df-9a20df68fc07 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:27.461404 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300692b9-1160-47de-b0df-9a20df68fc07 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:27.467386 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e455718-1b93-45cb-a765-18c251a73926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:27.468056 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e455718-1b93-45cb-a765-18c251a73926 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:27.468347 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e455718-1b93-45cb-a765-18c251a73926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:27.468626 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e455718-1b93-45cb-a765-18c251a73926 admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:27.469420 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e455718-1b93-45cb-a765-18c251a73926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:27.471627 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e455718-1b93-45cb-a765-18c251a73926 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:27.589905 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1327/2654] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:30:27 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:30:27.598192 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a69eec-ef22-4e87-bb19-5a5dd65879e8 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:27.609627 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a69eec-ef22-4e87-bb19-5a5dd65879e8 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:27.681852 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced31d5-7527-4c5a-9466-ee4b45b8384a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:27.683072 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced31d5-7527-4c5a-9466-ee4b45b8384a admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:27.683380 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced31d5-7527-4c5a-9466-ee4b45b8384a admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:27.683671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced31d5-7527-4c5a-9466-ee4b45b8384a admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:27.684389 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced31d5-7527-4c5a-9466-ee4b45b8384a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:27.686354 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced31d5-7527-4c5a-9466-ee4b45b8384a admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:27.696842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:27.834741 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1328/2655] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:30:27 2022] POST /identity/v3/users => generated 288 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:30:27.839312 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e455718-1b93-45cb-a765-18c251a73926 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:27.849709 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e455718-1b93-45cb-a765-18c251a73926 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:27.855002 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0ff16-2e21-44c9-9314-7bbf4609fd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:27.855690 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0ff16-2e21-44c9-9314-7bbf4609fd71 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:27.855976 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0ff16-2e21-44c9-9314-7bbf4609fd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:27.856254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0ff16-2e21-44c9-9314-7bbf4609fd71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:27.857018 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0ff16-2e21-44c9-9314-7bbf4609fd71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:27.858646 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0ff16-2e21-44c9-9314-7bbf4609fd71 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:27.869507 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1328/2656] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:30:27.875823 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced31d5-7527-4c5a-9466-ee4b45b8384a admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:27.886552 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced31d5-7527-4c5a-9466-ee4b45b8384a admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:27.891403 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d9c0b-f074-429b-8c14-1318cf637237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:27.896007 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d9c0b-f074-429b-8c14-1318cf637237 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:27.896007 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d9c0b-f074-429b-8c14-1318cf637237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:27.896007 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d9c0b-f074-429b-8c14-1318cf637237 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:27.896007 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d9c0b-f074-429b-8c14-1318cf637237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:27.896007 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d9c0b-f074-429b-8c14-1318cf637237 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:27.907257 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1329/2657] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:30:27.919727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0ff16-2e21-44c9-9314-7bbf4609fd71 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:27.930241 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0ff16-2e21-44c9-9314-7bbf4609fd71 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:27.935385 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1c7ed-6f3f-41e4-b26f-9b3e2a0e7b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:27.936299 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1c7ed-6f3f-41e4-b26f-9b3e2a0e7b3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:27.936605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1c7ed-6f3f-41e4-b26f-9b3e2a0e7b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:27.936921 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1c7ed-6f3f-41e4-b26f-9b3e2a0e7b3c admin admin] PATH_INFO: `/v3/projects/e8dd794f49ae46ee8dee19cf32ad05d6/users/b478b5fd3cde43fd8b03e18be4b1b59c/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:27.952425 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e1c7ed-6f3f-41e4-b26f-9b3e2a0e7b3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8dd794f49ae46ee8dee19cf32ad05d6, user_id=b478b5fd3cde43fd8b03e18be4b1b59c, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:27.955103 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e1c7ed-6f3f-41e4-b26f-9b3e2a0e7b3c admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:28.090931 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1329/2658] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:30:27 2022] PUT /identity/v3/projects/e8dd794f49ae46ee8dee19cf32ad05d6/users/b478b5fd3cde43fd8b03e18be4b1b59c/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:28.104914 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45446a9e-024c-47d9-90f0-28834d9ded4b None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:28.105213 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45446a9e-024c-47d9-90f0-28834d9ded4b None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:28.105497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45446a9e-024c-47d9-90f0-28834d9ded4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:28.132688 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-45446a9e-024c-47d9-90f0-28834d9ded4b None None] MFA Rules not processed for user `b478b5fd3cde43fd8b03e18be4b1b59c`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:28.133941 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-45446a9e-024c-47d9-90f0-28834d9ded4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:28.204095 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1330/2659] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:30:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:28.208781 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1c7ed-6f3f-41e4-b26f-9b3e2a0e7b3c admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:28.271378 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1c7ed-6f3f-41e4-b26f-9b3e2a0e7b3c admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:28.276017 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448acca5-875b-4f6e-92c9-776582746aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:28.276671 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448acca5-875b-4f6e-92c9-776582746aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:28.277062 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448acca5-875b-4f6e-92c9-776582746aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:28.277348 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448acca5-875b-4f6e-92c9-776582746aa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:28.278072 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448acca5-875b-4f6e-92c9-776582746aa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:28.279970 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448acca5-875b-4f6e-92c9-776582746aa8 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:28.389062 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1330/2660] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:30:28 2022] POST /identity/v3/projects => generated 375 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:30:28.393660 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45446a9e-024c-47d9-90f0-28834d9ded4b None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:28.406906 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45446a9e-024c-47d9-90f0-28834d9ded4b None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:28.463922 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d7463-39dd-4c24-a098-645eb25057ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:28.464519 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d7463-39dd-4c24-a098-645eb25057ab admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:28.464803 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d7463-39dd-4c24-a098-645eb25057ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:28.465115 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d7463-39dd-4c24-a098-645eb25057ab admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:28.465844 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d7463-39dd-4c24-a098-645eb25057ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:28.467720 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d7463-39dd-4c24-a098-645eb25057ab admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:28.592786 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1331/2661] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:30:28 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:30:28.592924 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448acca5-875b-4f6e-92c9-776582746aa8 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:28.603262 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448acca5-875b-4f6e-92c9-776582746aa8 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:28.615752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6879b-fbba-4752-80b8-d35dea1f1694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:28.616406 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6879b-fbba-4752-80b8-d35dea1f1694 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:28.616688 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6879b-fbba-4752-80b8-d35dea1f1694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:28.616997 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6879b-fbba-4752-80b8-d35dea1f1694 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:28.617727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6879b-fbba-4752-80b8-d35dea1f1694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:28.619951 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6879b-fbba-4752-80b8-d35dea1f1694 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:28.626445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:28.632207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1331/2662] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:30:28.637045 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d7463-39dd-4c24-a098-645eb25057ab admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:28.647203 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d7463-39dd-4c24-a098-645eb25057ab admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:28.652102 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ea391-35ba-40ce-9e4f-3f500178296b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:28.653013 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ea391-35ba-40ce-9e4f-3f500178296b admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:28.653297 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ea391-35ba-40ce-9e4f-3f500178296b admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:28.653573 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ea391-35ba-40ce-9e4f-3f500178296b admin admin] PATH_INFO: `/v3/projects/1997d1c3cceb4b069277438fb7f749e7/users/8984ba7fe486460b93f9ab6c86f6343e/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:28.669599 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ea391-35ba-40ce-9e4f-3f500178296b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1997d1c3cceb4b069277438fb7f749e7, user_id=8984ba7fe486460b93f9ab6c86f6343e, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:28.672371 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ea391-35ba-40ce-9e4f-3f500178296b admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:28.817980 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1332/2663] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:30:28 2022] PUT /identity/v3/projects/1997d1c3cceb4b069277438fb7f749e7/users/8984ba7fe486460b93f9ab6c86f6343e/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:28.821984 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6879b-fbba-4752-80b8-d35dea1f1694 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:28.834195 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6879b-fbba-4752-80b8-d35dea1f1694 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:28.895991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e27bf9-cc77-4b0b-b977-629f7050e5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:28.896667 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e27bf9-cc77-4b0b-b977-629f7050e5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:28.896986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e27bf9-cc77-4b0b-b977-629f7050e5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:28.897262 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e27bf9-cc77-4b0b-b977-629f7050e5a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:28.898023 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e27bf9-cc77-4b0b-b977-629f7050e5a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:28.899605 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e27bf9-cc77-4b0b-b977-629f7050e5a2 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:28.910176 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1332/2664] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:30:28.914373 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ea391-35ba-40ce-9e4f-3f500178296b admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:28.925457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ea391-35ba-40ce-9e4f-3f500178296b admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:28.930312 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02937120-2e2b-4cd6-bb74-9d37ab2fcaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:28.931191 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02937120-2e2b-4cd6-bb74-9d37ab2fcaf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:28.931471 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02937120-2e2b-4cd6-bb74-9d37ab2fcaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:28.932431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02937120-2e2b-4cd6-bb74-9d37ab2fcaf1 admin admin] PATH_INFO: `/v3/projects/1997d1c3cceb4b069277438fb7f749e7/users/8984ba7fe486460b93f9ab6c86f6343e/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:28.934526 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02937120-2e2b-4cd6-bb74-9d37ab2fcaf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1997d1c3cceb4b069277438fb7f749e7, user_id=8984ba7fe486460b93f9ab6c86f6343e, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:28.937230 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02937120-2e2b-4cd6-bb74-9d37ab2fcaf1 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:28.958238 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1333/2665] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:30:28 2022] PUT /identity/v3/projects/1997d1c3cceb4b069277438fb7f749e7/users/8984ba7fe486460b93f9ab6c86f6343e/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:28.964923 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4a69b-4f72-4a94-aa91-20dd2b34f691 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:28.964923 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4a69b-4f72-4a94-aa91-20dd2b34f691 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:28.964923 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4a69b-4f72-4a94-aa91-20dd2b34f691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:29.001016 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-c6c4a69b-4f72-4a94-aa91-20dd2b34f691 None None] MFA Rules not processed for user `8984ba7fe486460b93f9ab6c86f6343e`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:29.002312 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-c6c4a69b-4f72-4a94-aa91-20dd2b34f691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:29.076417 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1333/2666] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:30:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:29.088516 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02937120-2e2b-4cd6-bb74-9d37ab2fcaf1 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:29.090278 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-02937120-2e2b-4cd6-bb74-9d37ab2fcaf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:29.123226 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:29.150892 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02937120-2e2b-4cd6-bb74-9d37ab2fcaf1 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:29.154972 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fc2e3-2db8-4ce4-9fa9-f80ff5695b17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:29.156031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fc2e3-2db8-4ce4-9fa9-f80ff5695b17 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:29.156415 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fc2e3-2db8-4ce4-9fa9-f80ff5695b17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:29.156892 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fc2e3-2db8-4ce4-9fa9-f80ff5695b17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:29.216172 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087fc2e3-2db8-4ce4-9fa9-f80ff5695b17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:29.220180 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087fc2e3-2db8-4ce4-9fa9-f80ff5695b17 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:29.230240 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1334/2667] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:30:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:30:37.787077 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4a69b-4f72-4a94-aa91-20dd2b34f691 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:37.892648 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:37.935534 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4a69b-4f72-4a94-aa91-20dd2b34f691 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:37.948669 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58587fcf-641d-4cb8-b623-f40e54d45283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:37.957875 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58587fcf-641d-4cb8-b623-f40e54d45283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:37.958809 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58587fcf-641d-4cb8-b623-f40e54d45283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:37.959266 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58587fcf-641d-4cb8-b623-f40e54d45283 admin admin] PATH_INFO: `/v3/users/b478b5fd3cde43fd8b03e18be4b1b59c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:37.963255 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58587fcf-641d-4cb8-b623-f40e54d45283 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b478b5fd3cde43fd8b03e18be4b1b59c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:37.965536 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58587fcf-641d-4cb8-b623-f40e54d45283 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:38.604406 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-58587fcf-641d-4cb8-b623-f40e54d45283 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b478b5fd3cde43fd8b03e18be4b1b59c'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:38.605220 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-58587fcf-641d-4cb8-b623-f40e54d45283 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b478b5fd3cde43fd8b03e18be4b1b59c'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:38.891044 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-58587fcf-641d-4cb8-b623-f40e54d45283 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b478b5fd3cde43fd8b03e18be4b1b59c'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:38.911233 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-58587fcf-641d-4cb8-b623-f40e54d45283 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b478b5fd3cde43fd8b03e18be4b1b59c'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:38.922248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-58587fcf-641d-4cb8-b623-f40e54d45283 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b478b5fd3cde43fd8b03e18be4b1b59c'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:38.929664 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1334/2668] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:30:37 2022] DELETE /identity/v3/users/b478b5fd3cde43fd8b03e18be4b1b59c => generated 0 bytes in 1143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:38.934066 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e307f3-ff8d-43c4-8203-dfe796285543 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:38.934527 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e307f3-ff8d-43c4-8203-dfe796285543 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:38.937205 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e307f3-ff8d-43c4-8203-dfe796285543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:38.994507 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-88e307f3-ff8d-43c4-8203-dfe796285543 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:38.995733 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-88e307f3-ff8d-43c4-8203-dfe796285543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:39.072560 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1335/2669] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:39.080611 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58587fcf-641d-4cb8-b623-f40e54d45283 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:39.082597 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-58587fcf-641d-4cb8-b623-f40e54d45283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:39.198047 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58587fcf-641d-4cb8-b623-f40e54d45283 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:39.203510 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd08940-c2d7-47ad-87a9-8ea5483d83be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:39.204167 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd08940-c2d7-47ad-87a9-8ea5483d83be service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:39.204452 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd08940-c2d7-47ad-87a9-8ea5483d83be service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:39.204738 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd08940-c2d7-47ad-87a9-8ea5483d83be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:39.216878 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd08940-c2d7-47ad-87a9-8ea5483d83be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:39.218361 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd08940-c2d7-47ad-87a9-8ea5483d83be service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:39.230413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1335/2670] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:30:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:30:39.766659 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e307f3-ff8d-43c4-8203-dfe796285543 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:39.768117 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-88e307f3-ff8d-43c4-8203-dfe796285543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:39.781306 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e307f3-ff8d-43c4-8203-dfe796285543 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:39.786269 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5066457-aa0a-43a5-a42e-18f15f115f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:39.787140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5066457-aa0a-43a5-a42e-18f15f115f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:39.787521 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5066457-aa0a-43a5-a42e-18f15f115f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:39.787806 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5066457-aa0a-43a5-a42e-18f15f115f02 admin admin] PATH_INFO: `/v3/projects/e8dd794f49ae46ee8dee19cf32ad05d6` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:39.789061 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5066457-aa0a-43a5-a42e-18f15f115f02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8dd794f49ae46ee8dee19cf32ad05d6)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:39.790952 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5066457-aa0a-43a5-a42e-18f15f115f02 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:39.952907 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f5066457-aa0a-43a5-a42e-18f15f115f02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8dd794f49ae46ee8dee19cf32ad05d6', 'request_id': 'req-f5066457-aa0a-43a5-a42e-18f15f115f02'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:39.954467 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:39.965230 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f5066457-aa0a-43a5-a42e-18f15f115f02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8dd794f49ae46ee8dee19cf32ad05d6', 'request_id': 'req-f5066457-aa0a-43a5-a42e-18f15f115f02'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:40.061420 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f5066457-aa0a-43a5-a42e-18f15f115f02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8dd794f49ae46ee8dee19cf32ad05d6', 'request_id': 'req-f5066457-aa0a-43a5-a42e-18f15f115f02'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:40.072908 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f5066457-aa0a-43a5-a42e-18f15f115f02 admin admin] The token cache is being invalidate because project e8dd794f49ae46ee8dee19cf32ad05d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:30:40.073416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f5066457-aa0a-43a5-a42e-18f15f115f02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:40.074259 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f5066457-aa0a-43a5-a42e-18f15f115f02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:40.076332 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1336/2671] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:30:39 2022] DELETE /identity/v3/projects/e8dd794f49ae46ee8dee19cf32ad05d6 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:40.080132 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd08940-c2d7-47ad-87a9-8ea5483d83be service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:40.093188 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd08940-c2d7-47ad-87a9-8ea5483d83be service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:40.120020 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:40.163357 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da295b08-43a9-443f-8fa7-8128dd4d3655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:40.164979 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da295b08-43a9-443f-8fa7-8128dd4d3655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:40.165473 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da295b08-43a9-443f-8fa7-8128dd4d3655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:40.166037 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da295b08-43a9-443f-8fa7-8128dd4d3655 admin admin] PATH_INFO: `/v3/users/8984ba7fe486460b93f9ab6c86f6343e` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:40.168709 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da295b08-43a9-443f-8fa7-8128dd4d3655 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8984ba7fe486460b93f9ab6c86f6343e)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:40.173171 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da295b08-43a9-443f-8fa7-8128dd4d3655 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:40.435688 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-da295b08-43a9-443f-8fa7-8128dd4d3655 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8984ba7fe486460b93f9ab6c86f6343e'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:40.436374 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-da295b08-43a9-443f-8fa7-8128dd4d3655 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8984ba7fe486460b93f9ab6c86f6343e'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:40.513921 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-da295b08-43a9-443f-8fa7-8128dd4d3655 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8984ba7fe486460b93f9ab6c86f6343e'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:40.529945 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-da295b08-43a9-443f-8fa7-8128dd4d3655 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8984ba7fe486460b93f9ab6c86f6343e'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:40.537169 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-da295b08-43a9-443f-8fa7-8128dd4d3655 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8984ba7fe486460b93f9ab6c86f6343e'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:40.547955 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1336/2672] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:30:40 2022] DELETE /identity/v3/users/8984ba7fe486460b93f9ab6c86f6343e => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:41.018356 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5066457-aa0a-43a5-a42e-18f15f115f02 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:41.019772 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-f5066457-aa0a-43a5-a42e-18f15f115f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:41.044947 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5066457-aa0a-43a5-a42e-18f15f115f02 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:41.102451 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb3e5d7-e00a-4064-971d-1be7a87068f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:41.103229 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3e5d7-e00a-4064-971d-1be7a87068f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:41.103514 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3e5d7-e00a-4064-971d-1be7a87068f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:41.103786 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3e5d7-e00a-4064-971d-1be7a87068f6 admin admin] PATH_INFO: `/v3/projects/1997d1c3cceb4b069277438fb7f749e7` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:41.104989 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb3e5d7-e00a-4064-971d-1be7a87068f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1997d1c3cceb4b069277438fb7f749e7)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:41.107470 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb3e5d7-e00a-4064-971d-1be7a87068f6 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:41.261258 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-aeb3e5d7-e00a-4064-971d-1be7a87068f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1997d1c3cceb4b069277438fb7f749e7', 'request_id': 'req-aeb3e5d7-e00a-4064-971d-1be7a87068f6'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:41.269788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-aeb3e5d7-e00a-4064-971d-1be7a87068f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1997d1c3cceb4b069277438fb7f749e7', 'request_id': 'req-aeb3e5d7-e00a-4064-971d-1be7a87068f6'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:41.353258 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-aeb3e5d7-e00a-4064-971d-1be7a87068f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1997d1c3cceb4b069277438fb7f749e7', 'request_id': 'req-aeb3e5d7-e00a-4064-971d-1be7a87068f6'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:41.370357 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-aeb3e5d7-e00a-4064-971d-1be7a87068f6 admin admin] The token cache is being invalidate because project 1997d1c3cceb4b069277438fb7f749e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:30:41.373112 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-aeb3e5d7-e00a-4064-971d-1be7a87068f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:41.373928 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-aeb3e5d7-e00a-4064-971d-1be7a87068f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:41.377150 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1337/2673] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:30:41 2022] DELETE /identity/v3/projects/1997d1c3cceb4b069277438fb7f749e7 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:41.383475 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9f48d-c473-4e00-bb50-f79ae8a1a7e0 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:41.383475 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9f48d-c473-4e00-bb50-f79ae8a1a7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:41.383475 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9f48d-c473-4e00-bb50-f79ae8a1a7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:41.438987 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-68e9f48d-c473-4e00-bb50-f79ae8a1a7e0 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:41.441911 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-68e9f48d-c473-4e00-bb50-f79ae8a1a7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:41.518134 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1337/2674] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:41.526337 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6870deb-78c8-4909-9c99-3f0e11167da2 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:41.526568 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6870deb-78c8-4909-9c99-3f0e11167da2 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:41.526925 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6870deb-78c8-4909-9c99-3f0e11167da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:41.553623 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-c6870deb-78c8-4909-9c99-3f0e11167da2 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:41.555473 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-c6870deb-78c8-4909-9c99-3f0e11167da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:41.564203 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1338/2675] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:41.568484 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9f48d-c473-4e00-bb50-f79ae8a1a7e0 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:41.578669 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9f48d-c473-4e00-bb50-f79ae8a1a7e0 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:41.583982 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d649c0e-852b-426e-881e-ce8ff26a48e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:41.584723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d649c0e-852b-426e-881e-ce8ff26a48e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:41.585171 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d649c0e-852b-426e-881e-ce8ff26a48e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:41.585452 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d649c0e-852b-426e-881e-ce8ff26a48e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:41.586200 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d649c0e-852b-426e-881e-ce8ff26a48e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:30:41.586515 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d649c0e-852b-426e-881e-ce8ff26a48e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:41.588148 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d649c0e-852b-426e-881e-ce8ff26a48e4 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:41.602165 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1338/2676] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:30:41.606135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6870deb-78c8-4909-9c99-3f0e11167da2 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:41.619972 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6870deb-78c8-4909-9c99-3f0e11167da2 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:41.625958 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6c6bd-bdcb-4f26-8183-212eefe7bdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:41.626625 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6c6bd-bdcb-4f26-8183-212eefe7bdb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:41.626903 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6c6bd-bdcb-4f26-8183-212eefe7bdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:41.627177 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6c6bd-bdcb-4f26-8183-212eefe7bdb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:41.627870 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6c6bd-bdcb-4f26-8183-212eefe7bdb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:41.629887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6c6bd-bdcb-4f26-8183-212eefe7bdb9 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:41.752588 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1339/2677] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:30:41 2022] POST /identity/v3/projects => generated 375 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:30:41.753805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d649c0e-852b-426e-881e-ce8ff26a48e4 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:41.764617 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d649c0e-852b-426e-881e-ce8ff26a48e4 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:41.777631 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:41.821539 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c80bc2-3e04-4674-b09b-a6a36765ba2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:41.822211 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c80bc2-3e04-4674-b09b-a6a36765ba2f admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:41.822497 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c80bc2-3e04-4674-b09b-a6a36765ba2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:41.822827 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c80bc2-3e04-4674-b09b-a6a36765ba2f admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:41.823517 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c80bc2-3e04-4674-b09b-a6a36765ba2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:41.826012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c80bc2-3e04-4674-b09b-a6a36765ba2f admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:41.919405 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1339/2678] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:30:41 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:30:41.923725 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6c6bd-bdcb-4f26-8183-212eefe7bdb9 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:41.934136 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6c6bd-bdcb-4f26-8183-212eefe7bdb9 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:41.938932 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa807c0-fdad-460d-9f33-ff197ee26dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:41.939594 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa807c0-fdad-460d-9f33-ff197ee26dca admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:41.939879 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa807c0-fdad-460d-9f33-ff197ee26dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:41.940157 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa807c0-fdad-460d-9f33-ff197ee26dca admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:41.940921 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa807c0-fdad-460d-9f33-ff197ee26dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:41.942557 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa807c0-fdad-460d-9f33-ff197ee26dca admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:41.953694 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1340/2679] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:30:41.957736 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c80bc2-3e04-4674-b09b-a6a36765ba2f admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:41.968761 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c80bc2-3e04-4674-b09b-a6a36765ba2f admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:41.973521 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001730f7-d6ee-4fdf-ac6f-707a0795e6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:41.974182 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001730f7-d6ee-4fdf-ac6f-707a0795e6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:41.974471 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001730f7-d6ee-4fdf-ac6f-707a0795e6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:41.974752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001730f7-d6ee-4fdf-ac6f-707a0795e6a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:41.975494 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001730f7-d6ee-4fdf-ac6f-707a0795e6a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:41.977118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001730f7-d6ee-4fdf-ac6f-707a0795e6a4 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:41.987113 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1340/2680] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:30:41.991363 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa807c0-fdad-460d-9f33-ff197ee26dca admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:42.001342 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa807c0-fdad-460d-9f33-ff197ee26dca admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:42.006343 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38167893-d9e7-4bcb-8be3-fa6b7e986c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:42.007456 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38167893-d9e7-4bcb-8be3-fa6b7e986c0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:42.007583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38167893-d9e7-4bcb-8be3-fa6b7e986c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:42.007853 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38167893-d9e7-4bcb-8be3-fa6b7e986c0d admin admin] PATH_INFO: `/v3/projects/7960db36898b408c913dd16b38b32211/users/8c6d0878dfac4554b79007b0b1078056/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:42.024093 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38167893-d9e7-4bcb-8be3-fa6b7e986c0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7960db36898b408c913dd16b38b32211, user_id=8c6d0878dfac4554b79007b0b1078056, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:42.026989 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38167893-d9e7-4bcb-8be3-fa6b7e986c0d admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:42.147608 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1341/2681] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:30:41 2022] PUT /identity/v3/projects/7960db36898b408c913dd16b38b32211/users/8c6d0878dfac4554b79007b0b1078056/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:42.159702 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f76f4-d781-4cd5-bc10-b27408922495 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:42.159991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f76f4-d781-4cd5-bc10-b27408922495 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:42.160360 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f76f4-d781-4cd5-bc10-b27408922495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:42.187945 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-778f76f4-d781-4cd5-bc10-b27408922495 None None] MFA Rules not processed for user `8c6d0878dfac4554b79007b0b1078056`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:42.189214 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-778f76f4-d781-4cd5-bc10-b27408922495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:42.256641 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1341/2682] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:30:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:42.267595 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38167893-d9e7-4bcb-8be3-fa6b7e986c0d admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:42.269363 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-38167893-d9e7-4bcb-8be3-fa6b7e986c0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:42.275856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:42.329559 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38167893-d9e7-4bcb-8be3-fa6b7e986c0d admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:42.333298 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fcd0eb-8aaf-4a67-bb83-efc7ba7d9804 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:42.333949 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcd0eb-8aaf-4a67-bb83-efc7ba7d9804 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:42.334228 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcd0eb-8aaf-4a67-bb83-efc7ba7d9804 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:42.334506 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcd0eb-8aaf-4a67-bb83-efc7ba7d9804 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:42.345301 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fcd0eb-8aaf-4a67-bb83-efc7ba7d9804 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:42.346795 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fcd0eb-8aaf-4a67-bb83-efc7ba7d9804 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:42.357420 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1342/2683] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:30:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:30:43.407564 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11c92d-9d55-4081-9ef1-66052a4375b7 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:43.408149 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11c92d-9d55-4081-9ef1-66052a4375b7 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:43.408255 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11c92d-9d55-4081-9ef1-66052a4375b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:43.427173 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-7e11c92d-9d55-4081-9ef1-66052a4375b7 None None] MFA Rules not processed for user `082ece6ea4244242a6ba99152572c80f`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:43.428411 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-7e11c92d-9d55-4081-9ef1-66052a4375b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:43.484741 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1342/2684] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:30:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:43.964635 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fcd0eb-8aaf-4a67-bb83-efc7ba7d9804 service cinder] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:43.966872 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-93fcd0eb-8aaf-4a67-bb83-efc7ba7d9804 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:44.039365 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fcd0eb-8aaf-4a67-bb83-efc7ba7d9804 service cinder] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:44.044716 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8155b7-47e7-4d70-acf7-e1dea3d75f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:44.045662 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8155b7-47e7-4d70-acf7-e1dea3d75f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:44.052972 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8155b7-47e7-4d70-acf7-e1dea3d75f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:44.052972 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8155b7-47e7-4d70-acf7-e1dea3d75f94 admin admin] PATH_INFO: `/v3/users/22919bdab9b6475b86772b2ed20b297e` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:44.052972 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8155b7-47e7-4d70-acf7-e1dea3d75f94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22919bdab9b6475b86772b2ed20b297e)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:44.052972 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8155b7-47e7-4d70-acf7-e1dea3d75f94 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:44.401648 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-da8155b7-47e7-4d70-acf7-e1dea3d75f94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22919bdab9b6475b86772b2ed20b297e'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:44.416956 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-da8155b7-47e7-4d70-acf7-e1dea3d75f94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22919bdab9b6475b86772b2ed20b297e'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:44.486243 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e11c92d-9d55-4081-9ef1-66052a4375b7 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:44.487780 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-7e11c92d-9d55-4081-9ef1-66052a4375b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:44.523729 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:44.535015 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-da8155b7-47e7-4d70-acf7-e1dea3d75f94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22919bdab9b6475b86772b2ed20b297e'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:44.535742 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-da8155b7-47e7-4d70-acf7-e1dea3d75f94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22919bdab9b6475b86772b2ed20b297e'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:44.547475 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-da8155b7-47e7-4d70-acf7-e1dea3d75f94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22919bdab9b6475b86772b2ed20b297e'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:44.550489 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1343/2685] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:30:43 2022] DELETE /identity/v3/users/22919bdab9b6475b86772b2ed20b297e => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:44.554893 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedcef82-80b9-42c5-a2e7-60dae67f3fac None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:44.555186 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedcef82-80b9-42c5-a2e7-60dae67f3fac None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:44.555466 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedcef82-80b9-42c5-a2e7-60dae67f3fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:44.562304 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e11c92d-9d55-4081-9ef1-66052a4375b7 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:44.574917 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-bedcef82-80b9-42c5-a2e7-60dae67f3fac None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:44.576257 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-bedcef82-80b9-42c5-a2e7-60dae67f3fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:44.599044 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:44.625504 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3215e0-dc17-44d5-b866-938e16e8d353 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '675892a676054b4f86f9ac12d95f4f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:44.626278 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3215e0-dc17-44d5-b866-938e16e8d353 service placement] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:44.626917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3215e0-dc17-44d5-b866-938e16e8d353 service placement] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:44.627434 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3215e0-dc17-44d5-b866-938e16e8d353 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:44.629878 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-4c3215e0-dc17-44d5-b866-938e16e8d353 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:44.640412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1344/2686] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:30:44.641726 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3215e0-dc17-44d5-b866-938e16e8d353 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:44.643342 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3215e0-dc17-44d5-b866-938e16e8d353 service placement] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:44.650585 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedcef82-80b9-42c5-a2e7-60dae67f3fac None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:44.651951 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-bedcef82-80b9-42c5-a2e7-60dae67f3fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:44.655650 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1343/2687] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:30:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:30:44.713500 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedcef82-80b9-42c5-a2e7-60dae67f3fac None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:44.718224 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066308d-c49b-4a6f-a715-b15474d0ac00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:44.719292 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066308d-c49b-4a6f-a715-b15474d0ac00 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:44.719580 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066308d-c49b-4a6f-a715-b15474d0ac00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:44.719885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066308d-c49b-4a6f-a715-b15474d0ac00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:44.730711 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6066308d-c49b-4a6f-a715-b15474d0ac00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:44.732369 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6066308d-c49b-4a6f-a715-b15474d0ac00 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:44.750381 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1345/2688] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:30:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:30:45.217308 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3215e0-dc17-44d5-b866-938e16e8d353 service placement] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:45.218774 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-4c3215e0-dc17-44d5-b866-938e16e8d353 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:45.240331 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3215e0-dc17-44d5-b866-938e16e8d353 service placement] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:45.240331 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10dbfa-d51e-4a38-820e-e2510ad7caa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:45.240331 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10dbfa-d51e-4a38-820e-e2510ad7caa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:45.240331 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10dbfa-d51e-4a38-820e-e2510ad7caa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:45.240794 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10dbfa-d51e-4a38-820e-e2510ad7caa8 admin admin] PATH_INFO: `/v3/projects/d08235fe423d4493a600f00e67653087` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:45.240794 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10dbfa-d51e-4a38-820e-e2510ad7caa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d08235fe423d4493a600f00e67653087)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:45.242254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10dbfa-d51e-4a38-820e-e2510ad7caa8 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:45.394999 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-da10dbfa-d51e-4a38-820e-e2510ad7caa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd08235fe423d4493a600f00e67653087', 'request_id': 'req-da10dbfa-d51e-4a38-820e-e2510ad7caa8'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:45.400628 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-da10dbfa-d51e-4a38-820e-e2510ad7caa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd08235fe423d4493a600f00e67653087', 'request_id': 'req-da10dbfa-d51e-4a38-820e-e2510ad7caa8'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:45.501539 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-da10dbfa-d51e-4a38-820e-e2510ad7caa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd08235fe423d4493a600f00e67653087', 'request_id': 'req-da10dbfa-d51e-4a38-820e-e2510ad7caa8'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:45.513189 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-da10dbfa-d51e-4a38-820e-e2510ad7caa8 admin admin] The token cache is being invalidate because project d08235fe423d4493a600f00e67653087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:30:45.513479 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-da10dbfa-d51e-4a38-820e-e2510ad7caa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:45.514118 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-da10dbfa-d51e-4a38-820e-e2510ad7caa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:45.515690 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1344/2689] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:30:45 2022] DELETE /identity/v3/projects/d08235fe423d4493a600f00e67653087 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:45.520627 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551481e-2ff8-4b39-8449-1e5991ffcced None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:45.521156 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551481e-2ff8-4b39-8449-1e5991ffcced None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:45.521258 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551481e-2ff8-4b39-8449-1e5991ffcced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:45.539131 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-9551481e-2ff8-4b39-8449-1e5991ffcced None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:45.540126 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-9551481e-2ff8-4b39-8449-1e5991ffcced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:45.609994 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1346/2690] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:30:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:45.622995 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab29f7-046f-458f-bdbd-a1ca84a345dc None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:45.622995 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab29f7-046f-458f-bdbd-a1ca84a345dc None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:45.622995 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab29f7-046f-458f-bdbd-a1ca84a345dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:45.637706 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-c6ab29f7-046f-458f-bdbd-a1ca84a345dc None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:45.638921 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-c6ab29f7-046f-458f-bdbd-a1ca84a345dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:45.647126 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1345/2691] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:30:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:45.651370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551481e-2ff8-4b39-8449-1e5991ffcced None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:45.661802 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551481e-2ff8-4b39-8449-1e5991ffcced None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:45.666700 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d686fb0-6e72-4140-987f-1858dcb379e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:45.667370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d686fb0-6e72-4140-987f-1858dcb379e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:45.667655 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d686fb0-6e72-4140-987f-1858dcb379e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:45.667975 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d686fb0-6e72-4140-987f-1858dcb379e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:45.668647 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d686fb0-6e72-4140-987f-1858dcb379e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:30:45.669506 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d686fb0-6e72-4140-987f-1858dcb379e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:45.671199 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d686fb0-6e72-4140-987f-1858dcb379e0 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:45.686784 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1347/2692] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:30:45.689729 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab29f7-046f-458f-bdbd-a1ca84a345dc None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:45.699176 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab29f7-046f-458f-bdbd-a1ca84a345dc None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:45.704719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba54da-da0a-4c8e-abbe-161934ef626c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:45.705430 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba54da-da0a-4c8e-abbe-161934ef626c admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:45.705716 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba54da-da0a-4c8e-abbe-161934ef626c admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:45.706115 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba54da-da0a-4c8e-abbe-161934ef626c admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:45.706828 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba54da-da0a-4c8e-abbe-161934ef626c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:45.708730 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba54da-da0a-4c8e-abbe-161934ef626c admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:45.817707 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1346/2693] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:30:45 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:30:45.821995 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d686fb0-6e72-4140-987f-1858dcb379e0 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:45.832374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d686fb0-6e72-4140-987f-1858dcb379e0 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:45.885817 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:45.891875 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775198d-c382-4d3c-8853-030e7e4ceba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:45.892555 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775198d-c382-4d3c-8853-030e7e4ceba6 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:45.892876 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775198d-c382-4d3c-8853-030e7e4ceba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:45.893161 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775198d-c382-4d3c-8853-030e7e4ceba6 admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:45.893878 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775198d-c382-4d3c-8853-030e7e4ceba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:45.895827 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775198d-c382-4d3c-8853-030e7e4ceba6 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:46.065582 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1348/2694] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:30:45 2022] POST /identity/v3/users => generated 286 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:30:46.074059 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba54da-da0a-4c8e-abbe-161934ef626c admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:46.078120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba54da-da0a-4c8e-abbe-161934ef626c admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:46.088633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51c0b2-4ecc-400e-96d8-26fd1c73a797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:46.090233 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51c0b2-4ecc-400e-96d8-26fd1c73a797 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:46.090522 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51c0b2-4ecc-400e-96d8-26fd1c73a797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:46.091329 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51c0b2-4ecc-400e-96d8-26fd1c73a797 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:46.092080 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c51c0b2-4ecc-400e-96d8-26fd1c73a797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:46.093748 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c51c0b2-4ecc-400e-96d8-26fd1c73a797 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:46.104801 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1347/2695] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:30:46.109445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775198d-c382-4d3c-8853-030e7e4ceba6 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:46.119786 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775198d-c382-4d3c-8853-030e7e4ceba6 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:46.124691 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf201a-d72d-4dfc-b37b-d243ad733012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:46.125404 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf201a-d72d-4dfc-b37b-d243ad733012 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:46.125683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf201a-d72d-4dfc-b37b-d243ad733012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:46.125959 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf201a-d72d-4dfc-b37b-d243ad733012 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:46.126686 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf201a-d72d-4dfc-b37b-d243ad733012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:46.128305 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf201a-d72d-4dfc-b37b-d243ad733012 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:46.139023 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1349/2696] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:30:46.143258 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51c0b2-4ecc-400e-96d8-26fd1c73a797 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:46.154443 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51c0b2-4ecc-400e-96d8-26fd1c73a797 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:46.159370 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5cb61-fc9f-4406-9ab7-b38c1cb235f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:46.160456 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5cb61-fc9f-4406-9ab7-b38c1cb235f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:46.160739 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5cb61-fc9f-4406-9ab7-b38c1cb235f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:46.161044 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5cb61-fc9f-4406-9ab7-b38c1cb235f7 admin admin] PATH_INFO: `/v3/projects/a47513dee3b5421196fb86d7bfd3e273/users/6bf58df77ce14b5d91add6159fd06655/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:46.163485 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:46.178819 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5cb61-fc9f-4406-9ab7-b38c1cb235f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a47513dee3b5421196fb86d7bfd3e273, user_id=6bf58df77ce14b5d91add6159fd06655, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:46.181555 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5cb61-fc9f-4406-9ab7-b38c1cb235f7 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:46.324296 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1348/2697] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:30:46 2022] PUT /identity/v3/projects/a47513dee3b5421196fb86d7bfd3e273/users/6bf58df77ce14b5d91add6159fd06655/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:46.335113 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2324a57-2de6-4d13-906f-a4bde4f8b598 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:46.335402 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2324a57-2de6-4d13-906f-a4bde4f8b598 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:46.335680 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2324a57-2de6-4d13-906f-a4bde4f8b598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:46.363910 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-a2324a57-2de6-4d13-906f-a4bde4f8b598 None None] MFA Rules not processed for user `6bf58df77ce14b5d91add6159fd06655`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:46.365380 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-a2324a57-2de6-4d13-906f-a4bde4f8b598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:46.435417 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1350/2698] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:30:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:46.446842 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5cb61-fc9f-4406-9ab7-b38c1cb235f7 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:46.448566 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-40c5cb61-fc9f-4406-9ab7-b38c1cb235f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:46.506338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5cb61-fc9f-4406-9ab7-b38c1cb235f7 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:46.510308 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7e468-d7f7-4a91-b50f-534fb1cc95f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:46.510989 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7e468-d7f7-4a91-b50f-534fb1cc95f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:46.511273 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7e468-d7f7-4a91-b50f-534fb1cc95f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:46.511551 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7e468-d7f7-4a91-b50f-534fb1cc95f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:46.521140 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7e468-d7f7-4a91-b50f-534fb1cc95f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:46.522561 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7e468-d7f7-4a91-b50f-534fb1cc95f2 service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:46.532291 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1349/2699] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:30:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:30:46.556916 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2324a57-2de6-4d13-906f-a4bde4f8b598 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:46.619084 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2324a57-2de6-4d13-906f-a4bde4f8b598 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:46.624252 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7590e5e-a313-4b07-87b4-001df01113d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:46.626536 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7590e5e-a313-4b07-87b4-001df01113d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:46.626822 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7590e5e-a313-4b07-87b4-001df01113d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:46.627102 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7590e5e-a313-4b07-87b4-001df01113d6 admin admin] PATH_INFO: `/v3/users/6bf58df77ce14b5d91add6159fd06655` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:46.628384 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7590e5e-a313-4b07-87b4-001df01113d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bf58df77ce14b5d91add6159fd06655)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:46.630370 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7590e5e-a313-4b07-87b4-001df01113d6 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:46.881289 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-c7590e5e-a313-4b07-87b4-001df01113d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bf58df77ce14b5d91add6159fd06655'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:46.894279 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-c7590e5e-a313-4b07-87b4-001df01113d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bf58df77ce14b5d91add6159fd06655'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:46.896767 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:46.982519 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-c7590e5e-a313-4b07-87b4-001df01113d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bf58df77ce14b5d91add6159fd06655'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:46.983294 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-c7590e5e-a313-4b07-87b4-001df01113d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bf58df77ce14b5d91add6159fd06655'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:46.991031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-c7590e5e-a313-4b07-87b4-001df01113d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bf58df77ce14b5d91add6159fd06655'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:46.997830 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1351/2700] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:30:46 2022] DELETE /identity/v3/users/6bf58df77ce14b5d91add6159fd06655 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:47.002381 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cb14a-2e04-417a-806b-6cd71a94dff1 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:47.002785 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cb14a-2e04-417a-806b-6cd71a94dff1 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:47.003022 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cb14a-2e04-417a-806b-6cd71a94dff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:47.021992 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-0a7cb14a-2e04-417a-806b-6cd71a94dff1 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:47.031283 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-0a7cb14a-2e04-417a-806b-6cd71a94dff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:47.086470 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1350/2701] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:47.099163 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7590e5e-a313-4b07-87b4-001df01113d6 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:47.101864 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-c7590e5e-a313-4b07-87b4-001df01113d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:47.182986 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7590e5e-a313-4b07-87b4-001df01113d6 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:47.187606 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80948b14-89dd-478a-9d01-1da42b341e04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:47.188266 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80948b14-89dd-478a-9d01-1da42b341e04 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:47.188554 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80948b14-89dd-478a-9d01-1da42b341e04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:47.188846 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80948b14-89dd-478a-9d01-1da42b341e04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:47.203376 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80948b14-89dd-478a-9d01-1da42b341e04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:47.203376 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80948b14-89dd-478a-9d01-1da42b341e04 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:47.216276 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1352/2702] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:30:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:30:47.805540 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cb14a-2e04-417a-806b-6cd71a94dff1 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:47.807122 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-0a7cb14a-2e04-417a-806b-6cd71a94dff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:47.832967 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cb14a-2e04-417a-806b-6cd71a94dff1 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:47.839787 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62745189-e0e2-49b7-8801-70a81d4df1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:47.841725 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62745189-e0e2-49b7-8801-70a81d4df1d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:47.842283 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62745189-e0e2-49b7-8801-70a81d4df1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:47.842768 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62745189-e0e2-49b7-8801-70a81d4df1d1 admin admin] PATH_INFO: `/v3/projects/a47513dee3b5421196fb86d7bfd3e273` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:47.844346 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62745189-e0e2-49b7-8801-70a81d4df1d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a47513dee3b5421196fb86d7bfd3e273)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:47.846540 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62745189-e0e2-49b7-8801-70a81d4df1d1 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:47.961644 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-62745189-e0e2-49b7-8801-70a81d4df1d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a47513dee3b5421196fb86d7bfd3e273', 'request_id': 'req-62745189-e0e2-49b7-8801-70a81d4df1d1'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:47.967412 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-62745189-e0e2-49b7-8801-70a81d4df1d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a47513dee3b5421196fb86d7bfd3e273', 'request_id': 'req-62745189-e0e2-49b7-8801-70a81d4df1d1'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:48.033896 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-62745189-e0e2-49b7-8801-70a81d4df1d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a47513dee3b5421196fb86d7bfd3e273', 'request_id': 'req-62745189-e0e2-49b7-8801-70a81d4df1d1'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:48.052971 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-62745189-e0e2-49b7-8801-70a81d4df1d1 admin admin] The token cache is being invalidate because project a47513dee3b5421196fb86d7bfd3e273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:30:48.053693 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-62745189-e0e2-49b7-8801-70a81d4df1d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:48.054579 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-62745189-e0e2-49b7-8801-70a81d4df1d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:48.056550 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1351/2703] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:30:47 2022] DELETE /identity/v3/projects/a47513dee3b5421196fb86d7bfd3e273 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:30:55.237384 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80948b14-89dd-478a-9d01-1da42b341e04 service neutron] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:55.238903 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-80948b14-89dd-478a-9d01-1da42b341e04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:55.252295 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80948b14-89dd-478a-9d01-1da42b341e04 service neutron] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:55.308710 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ef6cd-849c-4c94-bf10-c4a4c68c2bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:55.309607 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ef6cd-849c-4c94-bf10-c4a4c68c2bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:55.309894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ef6cd-849c-4c94-bf10-c4a4c68c2bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:55.310766 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ef6cd-849c-4c94-bf10-c4a4c68c2bf8 admin admin] PATH_INFO: `/v3/users/8c6d0878dfac4554b79007b0b1078056` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:55.311993 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ef6cd-849c-4c94-bf10-c4a4c68c2bf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c6d0878dfac4554b79007b0b1078056)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:55.315159 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ef6cd-849c-4c94-bf10-c4a4c68c2bf8 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:55.532693 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-af5ef6cd-849c-4c94-bf10-c4a4c68c2bf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c6d0878dfac4554b79007b0b1078056'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:55.544350 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-af5ef6cd-849c-4c94-bf10-c4a4c68c2bf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c6d0878dfac4554b79007b0b1078056'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:55.609682 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-af5ef6cd-849c-4c94-bf10-c4a4c68c2bf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c6d0878dfac4554b79007b0b1078056'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:55.610306 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-af5ef6cd-849c-4c94-bf10-c4a4c68c2bf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c6d0878dfac4554b79007b0b1078056'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:55.617753 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-af5ef6cd-849c-4c94-bf10-c4a4c68c2bf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c6d0878dfac4554b79007b0b1078056'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:55.623815 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1353/2704] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:30:55 2022] DELETE /identity/v3/users/8c6d0878dfac4554b79007b0b1078056 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:55.628481 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46836d-cacf-4c89-9dbf-f896a47750f0 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:55.628977 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46836d-cacf-4c89-9dbf-f896a47750f0 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:55.629076 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46836d-cacf-4c89-9dbf-f896a47750f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:55.646783 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-1a46836d-cacf-4c89-9dbf-f896a47750f0 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:55.647991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-1a46836d-cacf-4c89-9dbf-f896a47750f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:55.652051 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:55.712534 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1352/2705] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:55.722538 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ef6cd-849c-4c94-bf10-c4a4c68c2bf8 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:55.724008 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-af5ef6cd-849c-4c94-bf10-c4a4c68c2bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:55.739907 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:55.783529 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ef6cd-849c-4c94-bf10-c4a4c68c2bf8 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:55.787525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29efaeb-dabd-46f8-a7bb-156dd09ea288 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:55.788171 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29efaeb-dabd-46f8-a7bb-156dd09ea288 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:55.788464 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29efaeb-dabd-46f8-a7bb-156dd09ea288 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:55.788743 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29efaeb-dabd-46f8-a7bb-156dd09ea288 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:55.799781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29efaeb-dabd-46f8-a7bb-156dd09ea288 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:55.804077 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29efaeb-dabd-46f8-a7bb-156dd09ea288 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:55.811199 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1354/2706] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:30:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:30:56.208083 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46836d-cacf-4c89-9dbf-f896a47750f0 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:56.209511 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-1a46836d-cacf-4c89-9dbf-f896a47750f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:56.280468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29efaeb-dabd-46f8-a7bb-156dd09ea288 service neutron] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:56.282014 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-f29efaeb-dabd-46f8-a7bb-156dd09ea288 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:56.283448 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46836d-cacf-4c89-9dbf-f896a47750f0 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:56.295588 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29efaeb-dabd-46f8-a7bb-156dd09ea288 service neutron] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:56.296713 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a28a19-aa49-45dc-bf8d-48f588b6cf25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:56.298094 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a28a19-aa49-45dc-bf8d-48f588b6cf25 service nova] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:56.298385 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a28a19-aa49-45dc-bf8d-48f588b6cf25 service nova] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:56.298666 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a28a19-aa49-45dc-bf8d-48f588b6cf25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:56.300785 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-e1a28a19-aa49-45dc-bf8d-48f588b6cf25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:56.304331 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76be4a-cdc6-4ded-9912-c3e6f7b64a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:56.304331 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76be4a-cdc6-4ded-9912-c3e6f7b64a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:56.304331 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76be4a-cdc6-4ded-9912-c3e6f7b64a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:56.304331 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76be4a-cdc6-4ded-9912-c3e6f7b64a79 admin admin] PATH_INFO: `/v3/projects/7960db36898b408c913dd16b38b32211` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:56.304706 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76be4a-cdc6-4ded-9912-c3e6f7b64a79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7960db36898b408c913dd16b38b32211)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:56.306523 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76be4a-cdc6-4ded-9912-c3e6f7b64a79 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:56.322468 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a28a19-aa49-45dc-bf8d-48f588b6cf25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:56.324253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a28a19-aa49-45dc-bf8d-48f588b6cf25 service nova] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:56.336971 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1353/2707] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:30:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:30:56.435625 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-bf76be4a-cdc6-4ded-9912-c3e6f7b64a79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7960db36898b408c913dd16b38b32211', 'request_id': 'req-bf76be4a-cdc6-4ded-9912-c3e6f7b64a79'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:56.442136 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-bf76be4a-cdc6-4ded-9912-c3e6f7b64a79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7960db36898b408c913dd16b38b32211', 'request_id': 'req-bf76be4a-cdc6-4ded-9912-c3e6f7b64a79'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:56.546808 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-bf76be4a-cdc6-4ded-9912-c3e6f7b64a79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7960db36898b408c913dd16b38b32211', 'request_id': 'req-bf76be4a-cdc6-4ded-9912-c3e6f7b64a79'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:56.559372 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-bf76be4a-cdc6-4ded-9912-c3e6f7b64a79 admin admin] The token cache is being invalidate because project 7960db36898b408c913dd16b38b32211 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:30:56.559660 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-bf76be4a-cdc6-4ded-9912-c3e6f7b64a79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:56.560449 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-bf76be4a-cdc6-4ded-9912-c3e6f7b64a79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:30:56.562044 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1355/2708] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:30:56 2022] DELETE /identity/v3/projects/7960db36898b408c913dd16b38b32211 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:56.567116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f479af-1e95-4dfe-9ff0-258fedc11f1e None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:56.567504 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f479af-1e95-4dfe-9ff0-258fedc11f1e None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:56.567791 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f479af-1e95-4dfe-9ff0-258fedc11f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:56.598082 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-d6f479af-1e95-4dfe-9ff0-258fedc11f1e None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:56.599291 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-d6f479af-1e95-4dfe-9ff0-258fedc11f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:56.660034 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1354/2709] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:56.668452 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23880e75-f280-4ebb-9737-b309c33a20cb None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:56.668652 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23880e75-f280-4ebb-9737-b309c33a20cb None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:56.668985 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23880e75-f280-4ebb-9737-b309c33a20cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:56.689745 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-23880e75-f280-4ebb-9737-b309c33a20cb None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:56.691896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-23880e75-f280-4ebb-9737-b309c33a20cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:56.702209 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1356/2710] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:56.706481 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f479af-1e95-4dfe-9ff0-258fedc11f1e None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:56.716966 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f479af-1e95-4dfe-9ff0-258fedc11f1e None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:56.721769 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7063f46-f647-4713-b24e-10680730d27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:56.722442 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7063f46-f647-4713-b24e-10680730d27d admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:56.722758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7063f46-f647-4713-b24e-10680730d27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:56.723035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7063f46-f647-4713-b24e-10680730d27d admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:56.723778 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7063f46-f647-4713-b24e-10680730d27d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:30:56.724092 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7063f46-f647-4713-b24e-10680730d27d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:56.725737 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7063f46-f647-4713-b24e-10680730d27d admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:56.742380 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1355/2711] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:30:56.746805 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23880e75-f280-4ebb-9737-b309c33a20cb None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:56.756671 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23880e75-f280-4ebb-9737-b309c33a20cb None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:56.761828 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd9498-a676-444d-901e-5288fbeb4f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:56.762490 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd9498-a676-444d-901e-5288fbeb4f18 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:56.762768 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd9498-a676-444d-901e-5288fbeb4f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:56.763040 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd9498-a676-444d-901e-5288fbeb4f18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:56.764254 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd9498-a676-444d-901e-5288fbeb4f18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:56.766248 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd9498-a676-444d-901e-5288fbeb4f18 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:56.879665 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1357/2712] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:30:56 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:30:56.884156 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7063f46-f647-4713-b24e-10680730d27d admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:56.895266 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7063f46-f647-4713-b24e-10680730d27d admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:56.904731 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=100 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:56.950214 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9e8d2-6c98-4ede-b19c-661fb6e587ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:56.951499 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9e8d2-6c98-4ede-b19c-661fb6e587ac admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:56.951775 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9e8d2-6c98-4ede-b19c-661fb6e587ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:56.952077 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9e8d2-6c98-4ede-b19c-661fb6e587ac admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:56.952803 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda9e8d2-6c98-4ede-b19c-661fb6e587ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:56.954778 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda9e8d2-6c98-4ede-b19c-661fb6e587ac admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:57.133584 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1356/2713] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:30:56 2022] POST /identity/v3/users => generated 291 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:30:57.134975 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd9498-a676-444d-901e-5288fbeb4f18 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:57.146278 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd9498-a676-444d-901e-5288fbeb4f18 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:57.150967 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247194d0-18d4-4ecf-b26d-b339cee8410b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:57.151628 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247194d0-18d4-4ecf-b26d-b339cee8410b admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:57.151909 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247194d0-18d4-4ecf-b26d-b339cee8410b admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:57.152185 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247194d0-18d4-4ecf-b26d-b339cee8410b admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:57.152936 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247194d0-18d4-4ecf-b26d-b339cee8410b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:57.154929 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247194d0-18d4-4ecf-b26d-b339cee8410b admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:57.169646 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1358/2714] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:30:57.173662 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9e8d2-6c98-4ede-b19c-661fb6e587ac admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:57.183957 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9e8d2-6c98-4ede-b19c-661fb6e587ac admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:57.189326 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2de10-540c-4c7f-bcc5-9d2fee127d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:57.190005 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2de10-540c-4c7f-bcc5-9d2fee127d0a admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:57.190293 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2de10-540c-4c7f-bcc5-9d2fee127d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:57.190574 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2de10-540c-4c7f-bcc5-9d2fee127d0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:57.191652 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2de10-540c-4c7f-bcc5-9d2fee127d0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:57.193298 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2de10-540c-4c7f-bcc5-9d2fee127d0a admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:57.204731 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1357/2715] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:30:57.209169 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247194d0-18d4-4ecf-b26d-b339cee8410b admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:57.219416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247194d0-18d4-4ecf-b26d-b339cee8410b admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:57.224291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7dcbe9-8a49-4a03-a70d-840e16e9a2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:57.225212 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dcbe9-8a49-4a03-a70d-840e16e9a2ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:57.225499 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dcbe9-8a49-4a03-a70d-840e16e9a2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:57.225777 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dcbe9-8a49-4a03-a70d-840e16e9a2ac admin admin] PATH_INFO: `/v3/projects/4ec35c44695245b2ab61de1996ceb0ac/users/50ad963ccc5b4504a0e5bc7751fc76cf/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:57.241894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7dcbe9-8a49-4a03-a70d-840e16e9a2ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ec35c44695245b2ab61de1996ceb0ac, user_id=50ad963ccc5b4504a0e5bc7751fc76cf, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:57.244863 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7dcbe9-8a49-4a03-a70d-840e16e9a2ac admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:57.341291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1359/2716] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:30:57 2022] PUT /identity/v3/projects/4ec35c44695245b2ab61de1996ceb0ac/users/50ad963ccc5b4504a0e5bc7751fc76cf/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:30:57.347020 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8f8eb-3d04-48a9-8445-ab22821892ad None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:57.350606 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8f8eb-3d04-48a9-8445-ab22821892ad None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:57.350606 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8f8eb-3d04-48a9-8445-ab22821892ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:57.365408 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-74f8f8eb-3d04-48a9-8445-ab22821892ad None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:57.366565 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-74f8f8eb-3d04-48a9-8445-ab22821892ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:57.435613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1358/2717] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:30:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:30:57.445348 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7dcbe9-8a49-4a03-a70d-840e16e9a2ac admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:57.447207 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-eb7dcbe9-8a49-4a03-a70d-840e16e9a2ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:57.477925 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:57.503911 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7dcbe9-8a49-4a03-a70d-840e16e9a2ac admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:57.508247 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aba3f6-234d-4ba7-a8b5-c9e1031e4c94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:57.508920 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aba3f6-234d-4ba7-a8b5-c9e1031e4c94 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:57.509207 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aba3f6-234d-4ba7-a8b5-c9e1031e4c94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:57.509484 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aba3f6-234d-4ba7-a8b5-c9e1031e4c94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:57.518665 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aba3f6-234d-4ba7-a8b5-c9e1031e4c94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:57.520133 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aba3f6-234d-4ba7-a8b5-c9e1031e4c94 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:57.529925 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1360/2718] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:30:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:30:59.028813 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31582c9a-d1b9-4945-a945-0d6dd05cb2e4 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:59.029859 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31582c9a-d1b9-4945-a945-0d6dd05cb2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:59.029859 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31582c9a-d1b9-4945-a945-0d6dd05cb2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:59.062152 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-31582c9a-d1b9-4945-a945-0d6dd05cb2e4 None None] MFA Rules not processed for user `50ad963ccc5b4504a0e5bc7751fc76cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:30:59.063521 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-31582c9a-d1b9-4945-a945-0d6dd05cb2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:59.128884 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1359/2719] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:30:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:30:59.139587 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aba3f6-234d-4ba7-a8b5-c9e1031e4c94 service neutron] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:30:59.141002 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-06aba3f6-234d-4ba7-a8b5-c9e1031e4c94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:30:59.197865 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aba3f6-234d-4ba7-a8b5-c9e1031e4c94 service neutron] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:30:59.201519 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e7612-504f-4462-aef1-c6bcada10e7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:30:59.202201 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e7612-504f-4462-aef1-c6bcada10e7e service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:30:59.202481 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e7612-504f-4462-aef1-c6bcada10e7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:30:59.202755 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e7612-504f-4462-aef1-c6bcada10e7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:30:59.211457 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e7612-504f-4462-aef1-c6bcada10e7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:30:59.212935 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e7612-504f-4462-aef1-c6bcada10e7e service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:30:59.221759 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1361/2720] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:30:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:31:00.985357 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a1a9f-45ef-4173-83d7-6ea4fb1121a1 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:31:00.985934 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a1a9f-45ef-4173-83d7-6ea4fb1121a1 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:31:00.985934 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a1a9f-45ef-4173-83d7-6ea4fb1121a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:31:01.005680 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-e72a1a9f-45ef-4173-83d7-6ea4fb1121a1 None None] MFA Rules not processed for user `50ad963ccc5b4504a0e5bc7751fc76cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:31:01.006887 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-e72a1a9f-45ef-4173-83d7-6ea4fb1121a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:31:01.014473 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1360/2721] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:31:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:31:01.382620 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e7612-504f-4462-aef1-c6bcada10e7e service cinder] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:31:01.385538 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-bf9e7612-504f-4462-aef1-c6bcada10e7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:31:01.397676 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e7612-504f-4462-aef1-c6bcada10e7e service cinder] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:31:01.401718 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41682e9c-6493-4723-b255-39ece2c0b32f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:31:01.402609 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41682e9c-6493-4723-b255-39ece2c0b32f service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:31:01.402890 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41682e9c-6493-4723-b255-39ece2c0b32f service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:31:01.403326 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41682e9c-6493-4723-b255-39ece2c0b32f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:31:01.405670 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-41682e9c-6493-4723-b255-39ece2c0b32f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:31:01.416510 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41682e9c-6493-4723-b255-39ece2c0b32f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:31:01.418290 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41682e9c-6493-4723-b255-39ece2c0b32f service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:31:01.427842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1362/2722] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:31:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:31:10.998968 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=90,keystone:INSERT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:31:11.423902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=45 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:31:32.829439 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a1a9f-45ef-4173-83d7-6ea4fb1121a1 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:31:32.839180 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a1a9f-45ef-4173-83d7-6ea4fb1121a1 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:31:32.842729 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be8eb5-e39b-42c1-8351-1954bff60c06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:31:32.843373 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be8eb5-e39b-42c1-8351-1954bff60c06 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:31:32.843665 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be8eb5-e39b-42c1-8351-1954bff60c06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:31:32.843943 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be8eb5-e39b-42c1-8351-1954bff60c06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:31:32.845744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-06be8eb5-e39b-42c1-8351-1954bff60c06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:31:32.857895 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be8eb5-e39b-42c1-8351-1954bff60c06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:31:32.859820 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be8eb5-e39b-42c1-8351-1954bff60c06 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:31:32.869674 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1361/2723] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:31:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:31:36.073575 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41682e9c-6493-4723-b255-39ece2c0b32f service neutron] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:31:36.075547 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-41682e9c-6493-4723-b255-39ece2c0b32f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:31:36.209021 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41682e9c-6493-4723-b255-39ece2c0b32f service neutron] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:31:36.214309 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c1c01-fe70-4246-8af0-d768488e9b9c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '675892a676054b4f86f9ac12d95f4f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:31:36.214969 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c1c01-fe70-4246-8af0-d768488e9b9c service placement] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:31:36.215256 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c1c01-fe70-4246-8af0-d768488e9b9c service placement] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:31:36.215572 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c1c01-fe70-4246-8af0-d768488e9b9c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:31:36.217398 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-604c1c01-fe70-4246-8af0-d768488e9b9c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:31:36.229842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c1c01-fe70-4246-8af0-d768488e9b9c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:31:36.231426 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c1c01-fe70-4246-8af0-d768488e9b9c service placement] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:31:36.242567 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1363/2724] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:31:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:31:40.158397 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be8eb5-e39b-42c1-8351-1954bff60c06 service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:31:40.160295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-06be8eb5-e39b-42c1-8351-1954bff60c06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:31:40.190321 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be8eb5-e39b-42c1-8351-1954bff60c06 service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:31:40.199769 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6aa15-fde8-408c-8c88-c962a80048f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:31:40.200700 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6aa15-fde8-408c-8c88-c962a80048f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:31:40.201019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6aa15-fde8-408c-8c88-c962a80048f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:31:40.201360 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6aa15-fde8-408c-8c88-c962a80048f2 admin admin] PATH_INFO: `/v3/users/401fdd54d8a143a892fd2d2407a78bc5` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:31:40.204683 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6aa15-fde8-408c-8c88-c962a80048f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=401fdd54d8a143a892fd2d2407a78bc5)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:31:40.204683 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6aa15-fde8-408c-8c88-c962a80048f2 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:31:40.420647 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b5e6aa15-fde8-408c-8c88-c962a80048f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '401fdd54d8a143a892fd2d2407a78bc5'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:31:40.421346 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b5e6aa15-fde8-408c-8c88-c962a80048f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '401fdd54d8a143a892fd2d2407a78bc5'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:31:40.505589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b5e6aa15-fde8-408c-8c88-c962a80048f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '401fdd54d8a143a892fd2d2407a78bc5'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:31:40.518522 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b5e6aa15-fde8-408c-8c88-c962a80048f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '401fdd54d8a143a892fd2d2407a78bc5'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:31:40.535138 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b5e6aa15-fde8-408c-8c88-c962a80048f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '401fdd54d8a143a892fd2d2407a78bc5'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:31:40.541486 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1362/2725] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:31:40 2022] DELETE /identity/v3/users/401fdd54d8a143a892fd2d2407a78bc5 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:31:40.816338 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c1c01-fe70-4246-8af0-d768488e9b9c service placement] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:31:40.827199 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c1c01-fe70-4246-8af0-d768488e9b9c service placement] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:31:40.888978 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930187a-c537-4a45-bdb6-7576e0bc7fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:31:40.889846 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930187a-c537-4a45-bdb6-7576e0bc7fa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:31:40.890133 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930187a-c537-4a45-bdb6-7576e0bc7fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:31:40.890415 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930187a-c537-4a45-bdb6-7576e0bc7fa1 admin admin] PATH_INFO: `/v3/projects/abd71b49f6d9403b8cea1fd9e7680ffb` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:31:40.891616 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930187a-c537-4a45-bdb6-7576e0bc7fa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abd71b49f6d9403b8cea1fd9e7680ffb)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:31:40.893630 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930187a-c537-4a45-bdb6-7576e0bc7fa1 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:31:41.018641 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-6930187a-c537-4a45-bdb6-7576e0bc7fa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'request_id': 'req-6930187a-c537-4a45-bdb6-7576e0bc7fa1'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:31:41.025002 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-6930187a-c537-4a45-bdb6-7576e0bc7fa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'request_id': 'req-6930187a-c537-4a45-bdb6-7576e0bc7fa1'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:31:41.111868 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-6930187a-c537-4a45-bdb6-7576e0bc7fa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'request_id': 'req-6930187a-c537-4a45-bdb6-7576e0bc7fa1'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:31:41.119514 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:31:41.128520 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-6930187a-c537-4a45-bdb6-7576e0bc7fa1 admin admin] The token cache is being invalidate because project abd71b49f6d9403b8cea1fd9e7680ffb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:31:41.128520 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-6930187a-c537-4a45-bdb6-7576e0bc7fa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:31:41.128520 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-6930187a-c537-4a45-bdb6-7576e0bc7fa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:31:41.128520 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1364/2726] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:31:40 2022] DELETE /identity/v3/projects/abd71b49f6d9403b8cea1fd9e7680ffb => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:31:41.129989 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6aa15-fde8-408c-8c88-c962a80048f2 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:31:41.131381 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-b5e6aa15-fde8-408c-8c88-c962a80048f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:31:41.144713 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6aa15-fde8-408c-8c88-c962a80048f2 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:31:41.203297 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2a82b-5eaa-4d04-ba5c-fd6e13e9a842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:31:41.204275 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2a82b-5eaa-4d04-ba5c-fd6e13e9a842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:31:41.204611 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2a82b-5eaa-4d04-ba5c-fd6e13e9a842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:31:41.205442 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2a82b-5eaa-4d04-ba5c-fd6e13e9a842 admin admin] PATH_INFO: `/v3/users/dc1bb7cf8e6945f3bdb2166027f06948` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:31:41.206656 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2a82b-5eaa-4d04-ba5c-fd6e13e9a842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc1bb7cf8e6945f3bdb2166027f06948)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:31:41.208572 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2a82b-5eaa-4d04-ba5c-fd6e13e9a842 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:31:41.412377 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-45c2a82b-5eaa-4d04-ba5c-fd6e13e9a842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc1bb7cf8e6945f3bdb2166027f06948'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:31:41.413004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-45c2a82b-5eaa-4d04-ba5c-fd6e13e9a842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc1bb7cf8e6945f3bdb2166027f06948'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:31:41.554603 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-45c2a82b-5eaa-4d04-ba5c-fd6e13e9a842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc1bb7cf8e6945f3bdb2166027f06948'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:31:41.560310 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:31:41.567019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-45c2a82b-5eaa-4d04-ba5c-fd6e13e9a842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc1bb7cf8e6945f3bdb2166027f06948'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:31:41.573942 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-45c2a82b-5eaa-4d04-ba5c-fd6e13e9a842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc1bb7cf8e6945f3bdb2166027f06948'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:31:41.580527 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1363/2727] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:31:41 2022] DELETE /identity/v3/users/dc1bb7cf8e6945f3bdb2166027f06948 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:31:41.836887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930187a-c537-4a45-bdb6-7576e0bc7fa1 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:31:41.838454 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-6930187a-c537-4a45-bdb6-7576e0bc7fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:31:41.853818 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930187a-c537-4a45-bdb6-7576e0bc7fa1 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:31:41.912449 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe3acb-8d69-480f-ae2d-b9d18c2abcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:31:41.913341 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe3acb-8d69-480f-ae2d-b9d18c2abcda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:31:41.913621 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe3acb-8d69-480f-ae2d-b9d18c2abcda admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:31:41.913895 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe3acb-8d69-480f-ae2d-b9d18c2abcda admin admin] PATH_INFO: `/v3/projects/101f44497a69444c8eccb021149df611` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:31:41.915157 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe3acb-8d69-480f-ae2d-b9d18c2abcda admin admin] RBAC: Authorizing `identity:delete_project(project_id=101f44497a69444c8eccb021149df611)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:31:41.917079 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe3acb-8d69-480f-ae2d-b9d18c2abcda admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:31:42.026833 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-5cbe3acb-8d69-480f-ae2d-b9d18c2abcda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '101f44497a69444c8eccb021149df611', 'request_id': 'req-5cbe3acb-8d69-480f-ae2d-b9d18c2abcda'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:31:42.033299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-5cbe3acb-8d69-480f-ae2d-b9d18c2abcda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '101f44497a69444c8eccb021149df611', 'request_id': 'req-5cbe3acb-8d69-480f-ae2d-b9d18c2abcda'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:31:42.114804 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-5cbe3acb-8d69-480f-ae2d-b9d18c2abcda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '101f44497a69444c8eccb021149df611', 'request_id': 'req-5cbe3acb-8d69-480f-ae2d-b9d18c2abcda'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:31:42.126145 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-5cbe3acb-8d69-480f-ae2d-b9d18c2abcda admin admin] The token cache is being invalidate because project 101f44497a69444c8eccb021149df611 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:31:42.126959 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-5cbe3acb-8d69-480f-ae2d-b9d18c2abcda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:31:42.127593 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-5cbe3acb-8d69-480f-ae2d-b9d18c2abcda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:31:42.129304 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1365/2728] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:31:41 2022] DELETE /identity/v3/projects/101f44497a69444c8eccb021149df611 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:31:51.737179 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=9,keystone:DELETE=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:31:52.122890 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:26.206898 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba66b46-34fe-4dd5-9bac-6203492a7e08 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:26.207520 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba66b46-34fe-4dd5-9bac-6203492a7e08 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:26.207520 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba66b46-34fe-4dd5-9bac-6203492a7e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:26.224752 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-aba66b46-34fe-4dd5-9bac-6203492a7e08 None None] MFA Rules not processed for user `50ad963ccc5b4504a0e5bc7751fc76cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:32:26.225981 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-aba66b46-34fe-4dd5-9bac-6203492a7e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:26.281529 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1364/2729] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:32:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:32:36.274510 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=25 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:43.059693 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe3acb-8d69-480f-ae2d-b9d18c2abcda admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:32:43.061307 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-5cbe3acb-8d69-480f-ae2d-b9d18c2abcda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:43.162781 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe3acb-8d69-480f-ae2d-b9d18c2abcda admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:32:43.168414 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c35eb-7266-4dfa-ab34-abd6439845fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:32:43.169083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c35eb-7266-4dfa-ab34-abd6439845fa service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:32:43.169373 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c35eb-7266-4dfa-ab34-abd6439845fa service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:32:43.169652 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c35eb-7266-4dfa-ab34-abd6439845fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:32:43.171442 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-3b8c35eb-7266-4dfa-ab34-abd6439845fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:32:43.229708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c35eb-7266-4dfa-ab34-abd6439845fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:32:43.231225 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c35eb-7266-4dfa-ab34-abd6439845fa service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:32:43.240700 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1366/2730] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:32:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:32:53.235990 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=68 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:09.675474 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a17061-d78b-4f16-a5d0-eb783c99eeb1 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:09.676028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a17061-d78b-4f16-a5d0-eb783c99eeb1 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:09.676156 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a17061-d78b-4f16-a5d0-eb783c99eeb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:09.694289 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-e6a17061-d78b-4f16-a5d0-eb783c99eeb1 None None] MFA Rules not processed for user `082ece6ea4244242a6ba99152572c80f`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:09.695522 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-e6a17061-d78b-4f16-a5d0-eb783c99eeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:09.702738 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1365/2731] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:33:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:10.005473 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c35eb-7266-4dfa-ab34-abd6439845fa service nova] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:10.006873 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-3b8c35eb-7266-4dfa-ab34-abd6439845fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:10.063375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c35eb-7266-4dfa-ab34-abd6439845fa service nova] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:10.067633 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58971fd3-7b0e-49d9-8680-11fb16a1debe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:10.068222 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58971fd3-7b0e-49d9-8680-11fb16a1debe service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:10.068506 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58971fd3-7b0e-49d9-8680-11fb16a1debe service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:10.068783 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58971fd3-7b0e-49d9-8680-11fb16a1debe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:10.070595 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-58971fd3-7b0e-49d9-8680-11fb16a1debe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:10.080088 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58971fd3-7b0e-49d9-8680-11fb16a1debe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:10.081551 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58971fd3-7b0e-49d9-8680-11fb16a1debe service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:10.090181 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1367/2732] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:33:19.688688 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:20.086550 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=26 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:20.801370 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a17061-d78b-4f16-a5d0-eb783c99eeb1 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:20.813410 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a17061-d78b-4f16-a5d0-eb783c99eeb1 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:20.818726 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe3b0e-a0a5-4c89-8a08-a70ee994897a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:20.820607 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe3b0e-a0a5-4c89-8a08-a70ee994897a service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:20.820936 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe3b0e-a0a5-4c89-8a08-a70ee994897a service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:20.821358 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe3b0e-a0a5-4c89-8a08-a70ee994897a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:20.823631 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-8dbe3b0e-a0a5-4c89-8a08-a70ee994897a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:20.840613 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe3b0e-a0a5-4c89-8a08-a70ee994897a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:20.842567 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe3b0e-a0a5-4c89-8a08-a70ee994897a service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:20.855243 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1366/2733] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:33:23.221485 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58971fd3-7b0e-49d9-8680-11fb16a1debe service neutron] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:23.231006 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58971fd3-7b0e-49d9-8680-11fb16a1debe service neutron] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:23.234738 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb48bf-401a-4b73-9899-fc1a9b4b3922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:23.235418 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb48bf-401a-4b73-9899-fc1a9b4b3922 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:23.235686 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb48bf-401a-4b73-9899-fc1a9b4b3922 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:23.235962 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb48bf-401a-4b73-9899-fc1a9b4b3922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:23.239038 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-f2cb48bf-401a-4b73-9899-fc1a9b4b3922 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:23.253161 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb48bf-401a-4b73-9899-fc1a9b4b3922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:23.255019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb48bf-401a-4b73-9899-fc1a9b4b3922 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:23.268077 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1368/2734] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:33:30.626093 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe3b0e-a0a5-4c89-8a08-a70ee994897a service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:30.628053 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-8dbe3b0e-a0a5-4c89-8a08-a70ee994897a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:30.644429 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe3b0e-a0a5-4c89-8a08-a70ee994897a service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:30.652143 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5acfd1d-22ee-4a3a-bacd-6424045b867f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:30.652886 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acfd1d-22ee-4a3a-bacd-6424045b867f service nova] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:30.653161 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acfd1d-22ee-4a3a-bacd-6424045b867f service nova] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:30.653447 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acfd1d-22ee-4a3a-bacd-6424045b867f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:30.655337 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-f5acfd1d-22ee-4a3a-bacd-6424045b867f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:30.670667 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5acfd1d-22ee-4a3a-bacd-6424045b867f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:30.672306 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5acfd1d-22ee-4a3a-bacd-6424045b867f service nova] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:30.689415 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1367/2735] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:33:33.262240 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=6 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:40.227150 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb48bf-401a-4b73-9899-fc1a9b4b3922 service neutron] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:40.228861 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-f2cb48bf-401a-4b73-9899-fc1a9b4b3922 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:40.298839 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb48bf-401a-4b73-9899-fc1a9b4b3922 service neutron] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:40.303814 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c3c56-815c-44ff-9576-62ff8c84e1cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '675892a676054b4f86f9ac12d95f4f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:40.304452 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c3c56-815c-44ff-9576-62ff8c84e1cc service placement] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:40.304730 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c3c56-815c-44ff-9576-62ff8c84e1cc service placement] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:40.305029 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c3c56-815c-44ff-9576-62ff8c84e1cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:40.306956 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-db1c3c56-815c-44ff-9576-62ff8c84e1cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:40.319889 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c3c56-815c-44ff-9576-62ff8c84e1cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:40.332709 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c3c56-815c-44ff-9576-62ff8c84e1cc service placement] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:40.332709 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1369/2736] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:33:40.374236 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5acfd1d-22ee-4a3a-bacd-6424045b867f service nova] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:40.380581 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-f5acfd1d-22ee-4a3a-bacd-6424045b867f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:40.449099 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5acfd1d-22ee-4a3a-bacd-6424045b867f service nova] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:40.454250 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c0510-3a27-4e22-88f7-5662905c8cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:40.455160 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c0510-3a27-4e22-88f7-5662905c8cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:40.455445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c0510-3a27-4e22-88f7-5662905c8cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:40.455742 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c0510-3a27-4e22-88f7-5662905c8cfc admin admin] PATH_INFO: `/v3/users/50ad963ccc5b4504a0e5bc7751fc76cf` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:40.457009 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c0510-3a27-4e22-88f7-5662905c8cfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=50ad963ccc5b4504a0e5bc7751fc76cf)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:40.459035 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c0510-3a27-4e22-88f7-5662905c8cfc admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:40.740587 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-192c0510-3a27-4e22-88f7-5662905c8cfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50ad963ccc5b4504a0e5bc7751fc76cf'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:40.742284 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-192c0510-3a27-4e22-88f7-5662905c8cfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50ad963ccc5b4504a0e5bc7751fc76cf'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:40.846019 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-192c0510-3a27-4e22-88f7-5662905c8cfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50ad963ccc5b4504a0e5bc7751fc76cf'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:40.859532 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-192c0510-3a27-4e22-88f7-5662905c8cfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50ad963ccc5b4504a0e5bc7751fc76cf'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:40.867275 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-192c0510-3a27-4e22-88f7-5662905c8cfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50ad963ccc5b4504a0e5bc7751fc76cf'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:40.874236 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1368/2737] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:33:40 2022] DELETE /identity/v3/users/50ad963ccc5b4504a0e5bc7751fc76cf => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:41.203147 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c3c56-815c-44ff-9576-62ff8c84e1cc service placement] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:41.217064 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c3c56-815c-44ff-9576-62ff8c84e1cc service placement] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:41.284431 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb843b-a783-4b1e-a3ed-aaa96406e8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:41.285266 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb843b-a783-4b1e-a3ed-aaa96406e8c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:41.285555 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb843b-a783-4b1e-a3ed-aaa96406e8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:41.285833 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb843b-a783-4b1e-a3ed-aaa96406e8c1 admin admin] PATH_INFO: `/v3/projects/4ec35c44695245b2ab61de1996ceb0ac` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:41.287090 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb843b-a783-4b1e-a3ed-aaa96406e8c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ec35c44695245b2ab61de1996ceb0ac)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:41.289578 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb843b-a783-4b1e-a3ed-aaa96406e8c1 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:41.457733 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-abeb843b-a783-4b1e-a3ed-aaa96406e8c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ec35c44695245b2ab61de1996ceb0ac', 'request_id': 'req-abeb843b-a783-4b1e-a3ed-aaa96406e8c1'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:41.464122 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-abeb843b-a783-4b1e-a3ed-aaa96406e8c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ec35c44695245b2ab61de1996ceb0ac', 'request_id': 'req-abeb843b-a783-4b1e-a3ed-aaa96406e8c1'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:41.542483 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-abeb843b-a783-4b1e-a3ed-aaa96406e8c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ec35c44695245b2ab61de1996ceb0ac', 'request_id': 'req-abeb843b-a783-4b1e-a3ed-aaa96406e8c1'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:41.553932 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-abeb843b-a783-4b1e-a3ed-aaa96406e8c1 admin admin] The token cache is being invalidate because project 4ec35c44695245b2ab61de1996ceb0ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:33:41.554218 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-abeb843b-a783-4b1e-a3ed-aaa96406e8c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:41.554859 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-abeb843b-a783-4b1e-a3ed-aaa96406e8c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:33:41.556443 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1370/2738] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:33:41 2022] DELETE /identity/v3/projects/4ec35c44695245b2ab61de1996ceb0ac => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:41.561487 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a7445-8703-4034-94a0-8cb2765928ab None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:41.561949 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a7445-8703-4034-94a0-8cb2765928ab None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:41.562045 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a7445-8703-4034-94a0-8cb2765928ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:41.580031 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-267a7445-8703-4034-94a0-8cb2765928ab None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:41.581289 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-267a7445-8703-4034-94a0-8cb2765928ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:41.627952 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:41.640201 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1369/2739] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:41.650237 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6953d8-80a8-410e-bdc5-a6df71bcb731 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:41.650237 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6953d8-80a8-410e-bdc5-a6df71bcb731 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:41.650237 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6953d8-80a8-410e-bdc5-a6df71bcb731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:41.669936 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-1a6953d8-80a8-410e-bdc5-a6df71bcb731 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:41.671169 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-1a6953d8-80a8-410e-bdc5-a6df71bcb731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:41.679234 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1371/2740] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:41.685535 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a7445-8703-4034-94a0-8cb2765928ab None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:41.695461 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a7445-8703-4034-94a0-8cb2765928ab None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:41.700111 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349425c9-e504-4ca0-a8cd-5d7e148e92a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:41.700766 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349425c9-e504-4ca0-a8cd-5d7e148e92a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:41.701081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349425c9-e504-4ca0-a8cd-5d7e148e92a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:41.701362 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349425c9-e504-4ca0-a8cd-5d7e148e92a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:41.702093 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349425c9-e504-4ca0-a8cd-5d7e148e92a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:33:41.702405 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349425c9-e504-4ca0-a8cd-5d7e148e92a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:41.703992 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349425c9-e504-4ca0-a8cd-5d7e148e92a7 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:41.716705 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1370/2741] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:33:41.721031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6953d8-80a8-410e-bdc5-a6df71bcb731 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:41.730259 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6953d8-80a8-410e-bdc5-a6df71bcb731 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:41.734825 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d5adc-bd78-466f-9795-751cd2a2411b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:41.735463 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d5adc-bd78-466f-9795-751cd2a2411b admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:41.735743 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d5adc-bd78-466f-9795-751cd2a2411b admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:41.736022 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d5adc-bd78-466f-9795-751cd2a2411b admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:41.736705 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d5adc-bd78-466f-9795-751cd2a2411b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:41.738628 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d5adc-bd78-466f-9795-751cd2a2411b admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:41.748769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:41.812743 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1372/2742] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:33:41 2022] POST /identity/v3/projects => generated 369 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:33:41.834652 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349425c9-e504-4ca0-a8cd-5d7e148e92a7 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:41.845982 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349425c9-e504-4ca0-a8cd-5d7e148e92a7 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:41.903987 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26a47b-605c-4170-a6a0-1f8fa10169bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:41.904658 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26a47b-605c-4170-a6a0-1f8fa10169bd admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:41.904987 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26a47b-605c-4170-a6a0-1f8fa10169bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:41.905270 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26a47b-605c-4170-a6a0-1f8fa10169bd admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:41.905958 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26a47b-605c-4170-a6a0-1f8fa10169bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:41.907880 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26a47b-605c-4170-a6a0-1f8fa10169bd admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:41.988416 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1371/2743] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:33:41 2022] POST /identity/v3/users => generated 285 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:33:41.992981 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d5adc-bd78-466f-9795-751cd2a2411b admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:42.003449 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d5adc-bd78-466f-9795-751cd2a2411b admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:42.008373 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a4e98-3475-4f39-8d2a-3427698601ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:42.009432 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a4e98-3475-4f39-8d2a-3427698601ab admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:42.009432 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a4e98-3475-4f39-8d2a-3427698601ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:42.009659 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a4e98-3475-4f39-8d2a-3427698601ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:42.010377 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a4e98-3475-4f39-8d2a-3427698601ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:42.012022 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a4e98-3475-4f39-8d2a-3427698601ab admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:42.022970 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1373/2744] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:33:42.027159 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26a47b-605c-4170-a6a0-1f8fa10169bd admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:42.037367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26a47b-605c-4170-a6a0-1f8fa10169bd admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:42.045798 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb170b82-9a68-4e9c-b7cb-c3d3a8bcc7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:42.045798 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb170b82-9a68-4e9c-b7cb-c3d3a8bcc7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:42.045798 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb170b82-9a68-4e9c-b7cb-c3d3a8bcc7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:42.045798 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb170b82-9a68-4e9c-b7cb-c3d3a8bcc7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:42.046238 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb170b82-9a68-4e9c-b7cb-c3d3a8bcc7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:42.046330 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb170b82-9a68-4e9c-b7cb-c3d3a8bcc7d0 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:42.057052 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1372/2745] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:33:42.061225 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a4e98-3475-4f39-8d2a-3427698601ab admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:42.071403 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a4e98-3475-4f39-8d2a-3427698601ab admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:42.076078 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c0c12-828a-461c-b5a1-96b92d2206d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:42.077065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c0c12-828a-461c-b5a1-96b92d2206d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:42.077349 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c0c12-828a-461c-b5a1-96b92d2206d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:42.077627 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c0c12-828a-461c-b5a1-96b92d2206d2 admin admin] PATH_INFO: `/v3/projects/7ed0bebe0a884b0b96282770ef35b22e/users/ce996aac321f4f39a4fb8bc759020a6d/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:42.092045 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c0c12-828a-461c-b5a1-96b92d2206d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed0bebe0a884b0b96282770ef35b22e, user_id=ce996aac321f4f39a4fb8bc759020a6d, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:42.102373 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c0c12-828a-461c-b5a1-96b92d2206d2 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:42.210260 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1374/2746] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:33:42 2022] PUT /identity/v3/projects/7ed0bebe0a884b0b96282770ef35b22e/users/ce996aac321f4f39a4fb8bc759020a6d/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:42.215450 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080813d-39ad-478a-8375-b9f6703ee272 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:42.215749 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080813d-39ad-478a-8375-b9f6703ee272 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:42.216053 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080813d-39ad-478a-8375-b9f6703ee272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:42.234368 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-f080813d-39ad-478a-8375-b9f6703ee272 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:42.235580 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-f080813d-39ad-478a-8375-b9f6703ee272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:42.294828 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1373/2747] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:33:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:42.304904 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c0c12-828a-461c-b5a1-96b92d2206d2 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:42.306619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-fe9c0c12-828a-461c-b5a1-96b92d2206d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:42.363335 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c0c12-828a-461c-b5a1-96b92d2206d2 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:42.367902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0848e-6f60-4291-b95c-79c2d9af40bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:42.368543 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0848e-6f60-4291-b95c-79c2d9af40bb service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:42.368837 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0848e-6f60-4291-b95c-79c2d9af40bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:42.369132 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0848e-6f60-4291-b95c-79c2d9af40bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:42.378832 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0848e-6f60-4291-b95c-79c2d9af40bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:42.380271 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0848e-6f60-4291-b95c-79c2d9af40bb service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:42.389865 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1375/2748] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:33:47.836897 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f2053-46dd-40db-974a-ae22622cfb1d None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:47.837354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f2053-46dd-40db-974a-ae22622cfb1d None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:47.837452 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f2053-46dd-40db-974a-ae22622cfb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:47.869640 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-289f2053-46dd-40db-974a-ae22622cfb1d None None] MFA Rules not processed for user `ce996aac321f4f39a4fb8bc759020a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:47.871148 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-289f2053-46dd-40db-974a-ae22622cfb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:47.922704 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:47.944560 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1374/2749] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:33:47 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:47.949878 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0848e-6f60-4291-b95c-79c2d9af40bb service neutron] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:47.960965 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0848e-6f60-4291-b95c-79c2d9af40bb service neutron] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:47.965648 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df79cb-9901-484a-b1fe-bca1ec7859b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:47.966350 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df79cb-9901-484a-b1fe-bca1ec7859b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:47.966637 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df79cb-9901-484a-b1fe-bca1ec7859b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:47.966918 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df79cb-9901-484a-b1fe-bca1ec7859b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:47.967625 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df79cb-9901-484a-b1fe-bca1ec7859b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:47.969699 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df79cb-9901-484a-b1fe-bca1ec7859b9 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:48.114525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1376/2750] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:33:47 2022] POST /identity/v3/projects => generated 371 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:33:48.119406 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f2053-46dd-40db-974a-ae22622cfb1d None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:48.131687 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f2053-46dd-40db-974a-ae22622cfb1d None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:48.198453 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a4c83-02a9-4320-b89e-1edf86e3d801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:48.199234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a4c83-02a9-4320-b89e-1edf86e3d801 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:48.200191 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a4c83-02a9-4320-b89e-1edf86e3d801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:48.200191 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a4c83-02a9-4320-b89e-1edf86e3d801 admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:48.200810 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a4c83-02a9-4320-b89e-1edf86e3d801 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:48.203329 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a4c83-02a9-4320-b89e-1edf86e3d801 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:48.300202 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1375/2751] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:33:48 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:33:48.301569 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df79cb-9901-484a-b1fe-bca1ec7859b9 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:48.312627 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df79cb-9901-484a-b1fe-bca1ec7859b9 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:48.317394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3deb118-dd4d-45d5-9a49-2b0ea34d73b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:48.318137 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3deb118-dd4d-45d5-9a49-2b0ea34d73b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:48.318422 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3deb118-dd4d-45d5-9a49-2b0ea34d73b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:48.318698 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3deb118-dd4d-45d5-9a49-2b0ea34d73b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:48.319427 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3deb118-dd4d-45d5-9a49-2b0ea34d73b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:48.321187 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3deb118-dd4d-45d5-9a49-2b0ea34d73b1 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:48.331880 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1377/2752] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:33:48.336768 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a4c83-02a9-4320-b89e-1edf86e3d801 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:48.347094 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a4c83-02a9-4320-b89e-1edf86e3d801 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:48.352857 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23002ab-d327-49c9-ac3c-b21851460b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:48.353577 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23002ab-d327-49c9-ac3c-b21851460b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:48.353861 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23002ab-d327-49c9-ac3c-b21851460b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:48.354139 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23002ab-d327-49c9-ac3c-b21851460b30 admin admin] PATH_INFO: `/v3/projects/58cd7ad2902b4741a192535bd1decc81/users/33e8789853a44b7497bad7bc36ac4dbc/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:48.369254 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23002ab-d327-49c9-ac3c-b21851460b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58cd7ad2902b4741a192535bd1decc81, user_id=33e8789853a44b7497bad7bc36ac4dbc, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:48.371883 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23002ab-d327-49c9-ac3c-b21851460b30 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:48.463423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1376/2753] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:33:48 2022] PUT /identity/v3/projects/58cd7ad2902b4741a192535bd1decc81/users/33e8789853a44b7497bad7bc36ac4dbc/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:48.467530 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3deb118-dd4d-45d5-9a49-2b0ea34d73b1 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:48.478951 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3deb118-dd4d-45d5-9a49-2b0ea34d73b1 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:48.536069 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88234c78-16b9-4d23-9bc6-42db8bf65752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:48.536741 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88234c78-16b9-4d23-9bc6-42db8bf65752 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:48.537058 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88234c78-16b9-4d23-9bc6-42db8bf65752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:48.537339 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88234c78-16b9-4d23-9bc6-42db8bf65752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:48.538064 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88234c78-16b9-4d23-9bc6-42db8bf65752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:48.540330 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88234c78-16b9-4d23-9bc6-42db8bf65752 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:48.550021 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1378/2754] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:33:48.554114 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23002ab-d327-49c9-ac3c-b21851460b30 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:48.564377 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23002ab-d327-49c9-ac3c-b21851460b30 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:48.569190 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec44d2-c055-4d0c-96c7-c864e3339fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:48.570091 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec44d2-c055-4d0c-96c7-c864e3339fae admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:48.570373 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec44d2-c055-4d0c-96c7-c864e3339fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:48.570652 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec44d2-c055-4d0c-96c7-c864e3339fae admin admin] PATH_INFO: `/v3/projects/58cd7ad2902b4741a192535bd1decc81/users/33e8789853a44b7497bad7bc36ac4dbc/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:48.572654 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec44d2-c055-4d0c-96c7-c864e3339fae admin admin] RBAC: Authorizing `identity:create_grant(project_id=58cd7ad2902b4741a192535bd1decc81, user_id=33e8789853a44b7497bad7bc36ac4dbc, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:48.575330 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec44d2-c055-4d0c-96c7-c864e3339fae admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:48.587612 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1377/2755] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:33:48 2022] PUT /identity/v3/projects/58cd7ad2902b4741a192535bd1decc81/users/33e8789853a44b7497bad7bc36ac4dbc/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:33:53.956833 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a9778-9955-4962-a026-6ad860b2308f None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:53.957404 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a9778-9955-4962-a026-6ad860b2308f None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:53.957404 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a9778-9955-4962-a026-6ad860b2308f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:53.985519 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-379a9778-9955-4962-a026-6ad860b2308f None None] MFA Rules not processed for user `33e8789853a44b7497bad7bc36ac4dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:53.986696 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-379a9778-9955-4962-a026-6ad860b2308f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:53.996538 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:54.059816 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1379/2756] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:33:53 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:33:54.075933 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec44d2-c055-4d0c-96c7-c864e3339fae admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:33:54.077759 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-93ec44d2-c055-4d0c-96c7-c864e3339fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:54.173049 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec44d2-c055-4d0c-96c7-c864e3339fae admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:33:54.181050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ad428-8801-4a5e-9946-150ffbe00264 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:33:54.181725 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ad428-8801-4a5e-9946-150ffbe00264 service nova] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:54.182012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ad428-8801-4a5e-9946-150ffbe00264 service nova] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:54.182360 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ad428-8801-4a5e-9946-150ffbe00264 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:54.229815 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:54.248328 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ad428-8801-4a5e-9946-150ffbe00264 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:33:54.250096 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ad428-8801-4a5e-9946-150ffbe00264 service nova] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:33:54.260219 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1378/2757] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:33:54 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:33:57.217189 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71cb87-53c2-4fa0-b850-1c57ca55e7ac None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:33:57.217669 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71cb87-53c2-4fa0-b850-1c57ca55e7ac None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:33:57.218570 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71cb87-53c2-4fa0-b850-1c57ca55e7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:33:57.235818 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-2c71cb87-53c2-4fa0-b850-1c57ca55e7ac None None] MFA Rules not processed for user `ce996aac321f4f39a4fb8bc759020a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:33:57.237142 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-2c71cb87-53c2-4fa0-b850-1c57ca55e7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:33:57.244741 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1380/2758] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:33:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:34:04.319103 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=10 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:07.230433 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=27 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:23.801521 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ad428-8801-4a5e-9946-150ffbe00264 service nova] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:34:23.862509 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ad428-8801-4a5e-9946-150ffbe00264 service nova] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:34:23.866339 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db9aac-5b44-4220-833e-e8e1fa6e8db2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:34:23.867079 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db9aac-5b44-4220-833e-e8e1fa6e8db2 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:34:23.867366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db9aac-5b44-4220-833e-e8e1fa6e8db2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:34:23.867644 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db9aac-5b44-4220-833e-e8e1fa6e8db2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:34:23.869502 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-e1db9aac-5b44-4220-833e-e8e1fa6e8db2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:34:23.879417 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db9aac-5b44-4220-833e-e8e1fa6e8db2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:34:23.880909 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db9aac-5b44-4220-833e-e8e1fa6e8db2 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:34:23.889033 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1379/2759] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:34:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:34:33.885314 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=26 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:37.983958 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71cb87-53c2-4fa0-b850-1c57ca55e7ac None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:34:37.994274 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71cb87-53c2-4fa0-b850-1c57ca55e7ac None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:34:37.997943 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd23d31-8818-4f84-91bb-67071d53ff78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:34:37.998612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd23d31-8818-4f84-91bb-67071d53ff78 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:34:37.998902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd23d31-8818-4f84-91bb-67071d53ff78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:34:37.999183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd23d31-8818-4f84-91bb-67071d53ff78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:34:38.008675 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd23d31-8818-4f84-91bb-67071d53ff78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:34:38.010171 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd23d31-8818-4f84-91bb-67071d53ff78 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:34:38.024923 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1381/2760] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:34:37 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:34:48.017946 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=6 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:00.663561 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db9aac-5b44-4220-833e-e8e1fa6e8db2 service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:00.678077 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db9aac-5b44-4220-833e-e8e1fa6e8db2 service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:00.684086 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273aa7aa-6974-4f68-a4e9-60f863fdfcaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:00.684933 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aa7aa-6974-4f68-a4e9-60f863fdfcaf service nova] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:00.685334 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aa7aa-6974-4f68-a4e9-60f863fdfcaf service nova] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:00.685629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aa7aa-6974-4f68-a4e9-60f863fdfcaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:00.687765 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-273aa7aa-6974-4f68-a4e9-60f863fdfcaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:00.705198 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273aa7aa-6974-4f68-a4e9-60f863fdfcaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:00.706851 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273aa7aa-6974-4f68-a4e9-60f863fdfcaf service nova] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:00.720007 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1380/2761] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:35:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:35:07.681054 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd23d31-8818-4f84-91bb-67071d53ff78 service neutron] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:07.690492 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd23d31-8818-4f84-91bb-67071d53ff78 service neutron] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:07.694151 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2faf9-0e7f-47d4-9c4b-22b0fa7d9769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:07.694788 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2faf9-0e7f-47d4-9c4b-22b0fa7d9769 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:07.695065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2faf9-0e7f-47d4-9c4b-22b0fa7d9769 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:07.695342 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2faf9-0e7f-47d4-9c4b-22b0fa7d9769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:07.697149 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-dfa2faf9-0e7f-47d4-9c4b-22b0fa7d9769 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:07.759525 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2faf9-0e7f-47d4-9c4b-22b0fa7d9769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:07.760998 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2faf9-0e7f-47d4-9c4b-22b0fa7d9769 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:07.771884 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1382/2762] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:35:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:35:10.713846 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=6 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:11.758294 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273aa7aa-6974-4f68-a4e9-60f863fdfcaf service nova] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:11.759831 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-273aa7aa-6974-4f68-a4e9-60f863fdfcaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:11.829623 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273aa7aa-6974-4f68-a4e9-60f863fdfcaf service nova] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:11.834635 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad99f96-46fb-4d9a-8fd8-66351034054f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '675892a676054b4f86f9ac12d95f4f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:11.835290 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad99f96-46fb-4d9a-8fd8-66351034054f service placement] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:11.835574 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad99f96-46fb-4d9a-8fd8-66351034054f service placement] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:11.835855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad99f96-46fb-4d9a-8fd8-66351034054f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:11.837654 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-6ad99f96-46fb-4d9a-8fd8-66351034054f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:11.850024 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad99f96-46fb-4d9a-8fd8-66351034054f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:11.851592 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad99f96-46fb-4d9a-8fd8-66351034054f service placement] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:11.861358 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1381/2763] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:35:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:35:12.003096 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2faf9-0e7f-47d4-9c4b-22b0fa7d9769 service neutron] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:12.004528 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-dfa2faf9-0e7f-47d4-9c4b-22b0fa7d9769 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:12.016692 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2faf9-0e7f-47d4-9c4b-22b0fa7d9769 service neutron] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:12.023139 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc1ba6-7e5d-4433-a7c8-87ec63508053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:12.024096 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc1ba6-7e5d-4433-a7c8-87ec63508053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:12.024382 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc1ba6-7e5d-4433-a7c8-87ec63508053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:12.024659 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc1ba6-7e5d-4433-a7c8-87ec63508053 admin admin] PATH_INFO: `/v3/users/082ece6ea4244242a6ba99152572c80f` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:12.025899 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc1ba6-7e5d-4433-a7c8-87ec63508053 admin admin] RBAC: Authorizing `identity:delete_user(user_id=082ece6ea4244242a6ba99152572c80f)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:12.027887 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc1ba6-7e5d-4433-a7c8-87ec63508053 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:12.305163 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f5fc1ba6-7e5d-4433-a7c8-87ec63508053 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '082ece6ea4244242a6ba99152572c80f'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:12.317496 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f5fc1ba6-7e5d-4433-a7c8-87ec63508053 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '082ece6ea4244242a6ba99152572c80f'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:12.451988 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f5fc1ba6-7e5d-4433-a7c8-87ec63508053 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '082ece6ea4244242a6ba99152572c80f'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:12.452539 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f5fc1ba6-7e5d-4433-a7c8-87ec63508053 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '082ece6ea4244242a6ba99152572c80f'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:12.459977 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-f5fc1ba6-7e5d-4433-a7c8-87ec63508053 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '082ece6ea4244242a6ba99152572c80f'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:12.465933 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1383/2764] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:35:12 2022] DELETE /identity/v3/users/082ece6ea4244242a6ba99152572c80f => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:35:12.880334 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad99f96-46fb-4d9a-8fd8-66351034054f service placement] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:12.891820 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad99f96-46fb-4d9a-8fd8-66351034054f service placement] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:12.949804 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b32b6c-ac3b-49e9-adc8-4ceae7369768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:12.950677 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b32b6c-ac3b-49e9-adc8-4ceae7369768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:12.950976 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b32b6c-ac3b-49e9-adc8-4ceae7369768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:12.951250 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b32b6c-ac3b-49e9-adc8-4ceae7369768 admin admin] PATH_INFO: `/v3/projects/347c4ccbcb464091b8254475babf2874` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:12.953050 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b32b6c-ac3b-49e9-adc8-4ceae7369768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=347c4ccbcb464091b8254475babf2874)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:12.954965 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b32b6c-ac3b-49e9-adc8-4ceae7369768 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:13.259471 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b9b32b6c-ac3b-49e9-adc8-4ceae7369768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '347c4ccbcb464091b8254475babf2874', 'request_id': 'req-b9b32b6c-ac3b-49e9-adc8-4ceae7369768'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:13.265199 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b9b32b6c-ac3b-49e9-adc8-4ceae7369768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '347c4ccbcb464091b8254475babf2874', 'request_id': 'req-b9b32b6c-ac3b-49e9-adc8-4ceae7369768'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:13.522795 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b9b32b6c-ac3b-49e9-adc8-4ceae7369768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '347c4ccbcb464091b8254475babf2874', 'request_id': 'req-b9b32b6c-ac3b-49e9-adc8-4ceae7369768'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:13.534907 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b9b32b6c-ac3b-49e9-adc8-4ceae7369768 admin admin] The token cache is being invalidate because project 347c4ccbcb464091b8254475babf2874 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:35:13.535191 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b9b32b6c-ac3b-49e9-adc8-4ceae7369768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:13.535823 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-b9b32b6c-ac3b-49e9-adc8-4ceae7369768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:13.537474 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1382/2765] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:35:12 2022] DELETE /identity/v3/projects/347c4ccbcb464091b8254475babf2874 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:35:13.542380 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e2468-04b5-4238-a7ea-43e3e639d971 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:13.542882 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e2468-04b5-4238-a7ea-43e3e639d971 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:13.542999 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e2468-04b5-4238-a7ea-43e3e639d971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:13.560420 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-eb5e2468-04b5-4238-a7ea-43e3e639d971 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:35:13.562175 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-eb5e2468-04b5-4238-a7ea-43e3e639d971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:13.621696 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1384/2766] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:35:13.630326 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec693e9-d09a-4471-9276-3023fdc35bbc None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:13.630629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec693e9-d09a-4471-9276-3023fdc35bbc None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:13.630912 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec693e9-d09a-4471-9276-3023fdc35bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:13.650069 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-eec693e9-d09a-4471-9276-3023fdc35bbc None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:35:13.651354 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-eec693e9-d09a-4471-9276-3023fdc35bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:13.659255 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1383/2767] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:35:13.663509 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e2468-04b5-4238-a7ea-43e3e639d971 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:13.673639 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e2468-04b5-4238-a7ea-43e3e639d971 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:13.678292 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7a633-5b37-405d-babc-456591e1f907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:13.678962 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7a633-5b37-405d-babc-456591e1f907 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:13.679423 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7a633-5b37-405d-babc-456591e1f907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:13.679681 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7a633-5b37-405d-babc-456591e1f907 admin admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:13.680425 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7a633-5b37-405d-babc-456591e1f907 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:35:13.680737 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7a633-5b37-405d-babc-456591e1f907 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:13.682385 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7a633-5b37-405d-babc-456591e1f907 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:13.683984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:13.695545 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1385/2768] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:35:13.700002 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec693e9-d09a-4471-9276-3023fdc35bbc None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:13.709373 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec693e9-d09a-4471-9276-3023fdc35bbc None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:13.714036 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cfed5-40c1-44a9-9d6a-7b0c4b76136f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:13.714686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cfed5-40c1-44a9-9d6a-7b0c4b76136f admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:13.714966 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cfed5-40c1-44a9-9d6a-7b0c4b76136f admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:13.715242 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cfed5-40c1-44a9-9d6a-7b0c4b76136f admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:13.716014 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79cfed5-40c1-44a9-9d6a-7b0c4b76136f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:13.718481 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79cfed5-40c1-44a9-9d6a-7b0c4b76136f admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:13.728319 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:13.856367 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1384/2769] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:35:13 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:35:13.861171 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7a633-5b37-405d-babc-456591e1f907 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:13.872136 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7a633-5b37-405d-babc-456591e1f907 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:13.927919 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86032150-e410-42aa-8532-f4810ac3feb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:13.928596 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86032150-e410-42aa-8532-f4810ac3feb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:13.928915 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86032150-e410-42aa-8532-f4810ac3feb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:13.929197 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86032150-e410-42aa-8532-f4810ac3feb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:13.929919 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86032150-e410-42aa-8532-f4810ac3feb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:13.931840 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86032150-e410-42aa-8532-f4810ac3feb1 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:14.012439 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1386/2770] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:35:13 2022] POST /identity/v3/users => generated 291 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:35:14.017653 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cfed5-40c1-44a9-9d6a-7b0c4b76136f admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:14.028224 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cfed5-40c1-44a9-9d6a-7b0c4b76136f admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:14.033656 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ae0e8-1b95-44bf-bb58-dffd959d32d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:14.034316 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ae0e8-1b95-44bf-bb58-dffd959d32d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:14.034609 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ae0e8-1b95-44bf-bb58-dffd959d32d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:14.034889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ae0e8-1b95-44bf-bb58-dffd959d32d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:14.035620 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ae0e8-1b95-44bf-bb58-dffd959d32d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:14.037274 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ae0e8-1b95-44bf-bb58-dffd959d32d2 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:14.048085 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1385/2771] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:35:14.052042 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86032150-e410-42aa-8532-f4810ac3feb1 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:14.062214 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86032150-e410-42aa-8532-f4810ac3feb1 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:14.067412 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8db71-6fe6-42aa-b953-a52a8b59bf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:14.068087 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8db71-6fe6-42aa-b953-a52a8b59bf5c admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:14.068375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8db71-6fe6-42aa-b953-a52a8b59bf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:14.068655 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8db71-6fe6-42aa-b953-a52a8b59bf5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:14.069462 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8db71-6fe6-42aa-b953-a52a8b59bf5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:14.071079 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8db71-6fe6-42aa-b953-a52a8b59bf5c admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:14.082741 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1387/2772] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:35:14.086952 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ae0e8-1b95-44bf-bb58-dffd959d32d2 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:14.097499 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ae0e8-1b95-44bf-bb58-dffd959d32d2 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:14.102169 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c281eb-6816-4617-af82-58474a008641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:14.103047 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c281eb-6816-4617-af82-58474a008641 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:14.103335 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c281eb-6816-4617-af82-58474a008641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:14.103610 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c281eb-6816-4617-af82-58474a008641 admin admin] PATH_INFO: `/v3/projects/d1cf491c30654b76963f9c8871603e27/users/c7704e572ae14367b4ad652026126c9a/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:14.118874 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c281eb-6816-4617-af82-58474a008641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1cf491c30654b76963f9c8871603e27, user_id=c7704e572ae14367b4ad652026126c9a, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:14.121498 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c281eb-6816-4617-af82-58474a008641 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:14.218660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1386/2773] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:35:14 2022] PUT /identity/v3/projects/d1cf491c30654b76963f9c8871603e27/users/c7704e572ae14367b4ad652026126c9a/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:35:14.228748 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ea310-2adb-4f0a-9d6e-960f87a6b97b None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:14.229055 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ea310-2adb-4f0a-9d6e-960f87a6b97b None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:14.229331 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ea310-2adb-4f0a-9d6e-960f87a6b97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:14.257497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-487ea310-2adb-4f0a-9d6e-960f87a6b97b None None] MFA Rules not processed for user `c7704e572ae14367b4ad652026126c9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:35:14.258703 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-487ea310-2adb-4f0a-9d6e-960f87a6b97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:14.325682 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1388/2774] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:35:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:35:14.330916 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c281eb-6816-4617-af82-58474a008641 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:14.391990 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c281eb-6816-4617-af82-58474a008641 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:14.397006 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456c9a7-e6ea-4c48-9a23-4b3f0e0d34ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:14.397687 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456c9a7-e6ea-4c48-9a23-4b3f0e0d34ff admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:14.397975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456c9a7-e6ea-4c48-9a23-4b3f0e0d34ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:14.398256 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456c9a7-e6ea-4c48-9a23-4b3f0e0d34ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:14.398977 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456c9a7-e6ea-4c48-9a23-4b3f0e0d34ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:14.400928 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456c9a7-e6ea-4c48-9a23-4b3f0e0d34ff admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:14.556897 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1387/2775] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:35:14 2022] POST /identity/v3/projects => generated 381 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:35:14.560805 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ea310-2adb-4f0a-9d6e-960f87a6b97b None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:14.572259 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ea310-2adb-4f0a-9d6e-960f87a6b97b None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:14.626408 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1890e-2b8f-4c54-8053-9f14a13718ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:14.627085 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1890e-2b8f-4c54-8053-9f14a13718ae admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:14.627378 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1890e-2b8f-4c54-8053-9f14a13718ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:14.627636 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1890e-2b8f-4c54-8053-9f14a13718ae admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:14.628323 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1890e-2b8f-4c54-8053-9f14a13718ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:14.630275 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1890e-2b8f-4c54-8053-9f14a13718ae admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:14.637722 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:14.840841 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1389/2776] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:35:14 2022] POST /identity/v3/users => generated 297 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:35:14.844794 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456c9a7-e6ea-4c48-9a23-4b3f0e0d34ff admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:14.855179 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456c9a7-e6ea-4c48-9a23-4b3f0e0d34ff admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:14.860549 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3402c-c8da-48e9-8f6e-c28cb270470d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:14.861249 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3402c-c8da-48e9-8f6e-c28cb270470d admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:14.861533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3402c-c8da-48e9-8f6e-c28cb270470d admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:14.861838 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3402c-c8da-48e9-8f6e-c28cb270470d admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:14.862565 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3402c-c8da-48e9-8f6e-c28cb270470d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:14.864194 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3402c-c8da-48e9-8f6e-c28cb270470d admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:14.875660 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1388/2777] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:35:14.880079 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1890e-2b8f-4c54-8053-9f14a13718ae admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:14.890743 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1890e-2b8f-4c54-8053-9f14a13718ae admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:14.895667 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4d09f-03bb-4ab5-9e16-ba3f399dfdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:14.896612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4d09f-03bb-4ab5-9e16-ba3f399dfdf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:14.896936 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4d09f-03bb-4ab5-9e16-ba3f399dfdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:14.897242 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4d09f-03bb-4ab5-9e16-ba3f399dfdf1 admin admin] PATH_INFO: `/v3/projects/20e4d3969f17483e89886cd3c4d58ae6/users/264a47e1315f4a7d81cd06cd0857453c/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:14.912478 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4d09f-03bb-4ab5-9e16-ba3f399dfdf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20e4d3969f17483e89886cd3c4d58ae6, user_id=264a47e1315f4a7d81cd06cd0857453c, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:14.915197 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c4d09f-03bb-4ab5-9e16-ba3f399dfdf1 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:15.058314 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1390/2778] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:35:14 2022] PUT /identity/v3/projects/20e4d3969f17483e89886cd3c4d58ae6/users/264a47e1315f4a7d81cd06cd0857453c/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:35:15.062544 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3402c-c8da-48e9-8f6e-c28cb270470d admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:15.074782 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3402c-c8da-48e9-8f6e-c28cb270470d admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:15.128644 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35ea01-6258-4480-9fcc-a720db5d3648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:15.129336 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35ea01-6258-4480-9fcc-a720db5d3648 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:15.140101 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35ea01-6258-4480-9fcc-a720db5d3648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:15.140101 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35ea01-6258-4480-9fcc-a720db5d3648 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:15.140101 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d35ea01-6258-4480-9fcc-a720db5d3648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:15.140101 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d35ea01-6258-4480-9fcc-a720db5d3648 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:15.141947 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1389/2779] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:35:15.146468 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4d09f-03bb-4ab5-9e16-ba3f399dfdf1 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:15.157473 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4d09f-03bb-4ab5-9e16-ba3f399dfdf1 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:15.162215 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a70cb2-3190-4648-8b45-386f2534ad15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:15.163103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a70cb2-3190-4648-8b45-386f2534ad15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:15.163386 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a70cb2-3190-4648-8b45-386f2534ad15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:15.163666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a70cb2-3190-4648-8b45-386f2534ad15 admin admin] PATH_INFO: `/v3/projects/20e4d3969f17483e89886cd3c4d58ae6/users/264a47e1315f4a7d81cd06cd0857453c/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:15.165694 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a70cb2-3190-4648-8b45-386f2534ad15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20e4d3969f17483e89886cd3c4d58ae6, user_id=264a47e1315f4a7d81cd06cd0857453c, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:15.168776 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a70cb2-3190-4648-8b45-386f2534ad15 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:15.179754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1391/2780] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:35:15 2022] PUT /identity/v3/projects/20e4d3969f17483e89886cd3c4d58ae6/users/264a47e1315f4a7d81cd06cd0857453c/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:35:15.191139 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7e8c5-29bb-4d51-9a0b-6cdddd7787c2 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:15.191423 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7e8c5-29bb-4d51-9a0b-6cdddd7787c2 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:15.191701 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7e8c5-29bb-4d51-9a0b-6cdddd7787c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:15.218633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-c5d7e8c5-29bb-4d51-9a0b-6cdddd7787c2 None None] MFA Rules not processed for user `264a47e1315f4a7d81cd06cd0857453c`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:35:15.219832 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-c5d7e8c5-29bb-4d51-9a0b-6cdddd7787c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:15.234106 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:15.291350 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1390/2781] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:35:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:35:15.303283 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a70cb2-3190-4648-8b45-386f2534ad15 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:15.306278 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-d4a70cb2-3190-4648-8b45-386f2534ad15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:15.385110 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a70cb2-3190-4648-8b45-386f2534ad15 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:15.388862 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fe672-20e7-45dc-8d00-192b2ae383a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:15.390035 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fe672-20e7-45dc-8d00-192b2ae383a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:15.390315 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fe672-20e7-45dc-8d00-192b2ae383a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:15.390590 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fe672-20e7-45dc-8d00-192b2ae383a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:15.400252 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60fe672-20e7-45dc-8d00-192b2ae383a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:15.401720 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60fe672-20e7-45dc-8d00-192b2ae383a4 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:15.411866 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1392/2782] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:35:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:35:15.671630 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7e8c5-29bb-4d51-9a0b-6cdddd7787c2 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:15.681320 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7e8c5-29bb-4d51-9a0b-6cdddd7787c2 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:15.685115 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2b497-d61b-4849-b91c-3ef86b4770b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:15.685763 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2b497-d61b-4849-b91c-3ef86b4770b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:15.686048 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2b497-d61b-4849-b91c-3ef86b4770b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:15.686329 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2b497-d61b-4849-b91c-3ef86b4770b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:15.742873 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2b497-d61b-4849-b91c-3ef86b4770b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:15.744323 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2b497-d61b-4849-b91c-3ef86b4770b3 service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:15.753299 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1391/2783] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:35:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:35:25.407585 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:INSERT=4,keystone:SELECT=52 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:25.857885 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=50 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:30.278174 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fe672-20e7-45dc-8d00-192b2ae383a4 service cinder] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:30.345081 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fe672-20e7-45dc-8d00-192b2ae383a4 service cinder] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:30.350416 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2d3c6-c2b7-4497-9956-d4ab1e6e6bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:30.351309 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2d3c6-c2b7-4497-9956-d4ab1e6e6bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:30.351591 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2d3c6-c2b7-4497-9956-d4ab1e6e6bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:30.351868 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2d3c6-c2b7-4497-9956-d4ab1e6e6bc9 admin admin] PATH_INFO: `/v3/users/c7704e572ae14367b4ad652026126c9a` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:30.353191 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2d3c6-c2b7-4497-9956-d4ab1e6e6bc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7704e572ae14367b4ad652026126c9a)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:30.355113 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2d3c6-c2b7-4497-9956-d4ab1e6e6bc9 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:30.539633 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-66c2d3c6-c2b7-4497-9956-d4ab1e6e6bc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7704e572ae14367b4ad652026126c9a'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:30.552747 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-66c2d3c6-c2b7-4497-9956-d4ab1e6e6bc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7704e572ae14367b4ad652026126c9a'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:30.593595 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-66c2d3c6-c2b7-4497-9956-d4ab1e6e6bc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7704e572ae14367b4ad652026126c9a'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:30.594218 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-66c2d3c6-c2b7-4497-9956-d4ab1e6e6bc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7704e572ae14367b4ad652026126c9a'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:30.601481 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-66c2d3c6-c2b7-4497-9956-d4ab1e6e6bc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7704e572ae14367b4ad652026126c9a'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:30.607999 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1393/2784] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:35:30 2022] DELETE /identity/v3/users/c7704e572ae14367b4ad652026126c9a => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:35:30.613082 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce9249-ff1a-4366-be83-704cabfc52b6 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:30.613567 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce9249-ff1a-4366-be83-704cabfc52b6 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:30.613705 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce9249-ff1a-4366-be83-704cabfc52b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:30.630641 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-bfce9249-ff1a-4366-be83-704cabfc52b6 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:35:30.631828 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-bfce9249-ff1a-4366-be83-704cabfc52b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:30.694575 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1392/2785] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:35:30.704455 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2d3c6-c2b7-4497-9956-d4ab1e6e6bc9 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:30.709048 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-66c2d3c6-c2b7-4497-9956-d4ab1e6e6bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:30.765400 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2d3c6-c2b7-4497-9956-d4ab1e6e6bc9 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:30.770002 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b262e4-5702-454d-a57a-f44cd3b06c42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:30.770652 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b262e4-5702-454d-a57a-f44cd3b06c42 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:30.770937 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b262e4-5702-454d-a57a-f44cd3b06c42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:30.771221 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b262e4-5702-454d-a57a-f44cd3b06c42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:30.780964 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b262e4-5702-454d-a57a-f44cd3b06c42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:30.782460 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b262e4-5702-454d-a57a-f44cd3b06c42 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:30.792292 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1394/2786] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:35:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:35:31.155574 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce9249-ff1a-4366-be83-704cabfc52b6 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:31.160450 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-bfce9249-ff1a-4366-be83-704cabfc52b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:31.170284 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce9249-ff1a-4366-be83-704cabfc52b6 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:31.175054 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1da4c2-0bb9-479c-902d-dec7770d6e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:31.175933 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1da4c2-0bb9-479c-902d-dec7770d6e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:31.176219 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1da4c2-0bb9-479c-902d-dec7770d6e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:31.176504 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1da4c2-0bb9-479c-902d-dec7770d6e95 admin admin] PATH_INFO: `/v3/projects/d1cf491c30654b76963f9c8871603e27` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:31.177767 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1da4c2-0bb9-479c-902d-dec7770d6e95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1cf491c30654b76963f9c8871603e27)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:31.179709 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1da4c2-0bb9-479c-902d-dec7770d6e95 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:31.292866 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9e1da4c2-0bb9-479c-902d-dec7770d6e95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1cf491c30654b76963f9c8871603e27', 'request_id': 'req-9e1da4c2-0bb9-479c-902d-dec7770d6e95'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:31.298676 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9e1da4c2-0bb9-479c-902d-dec7770d6e95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1cf491c30654b76963f9c8871603e27', 'request_id': 'req-9e1da4c2-0bb9-479c-902d-dec7770d6e95'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:31.383002 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9e1da4c2-0bb9-479c-902d-dec7770d6e95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1cf491c30654b76963f9c8871603e27', 'request_id': 'req-9e1da4c2-0bb9-479c-902d-dec7770d6e95'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:31.394791 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9e1da4c2-0bb9-479c-902d-dec7770d6e95 admin admin] The token cache is being invalidate because project d1cf491c30654b76963f9c8871603e27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:35:31.395074 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9e1da4c2-0bb9-479c-902d-dec7770d6e95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:31.395723 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9e1da4c2-0bb9-479c-902d-dec7770d6e95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:31.399048 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1393/2787] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:35:31 2022] DELETE /identity/v3/projects/d1cf491c30654b76963f9c8871603e27 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:35:31.403037 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b262e4-5702-454d-a57a-f44cd3b06c42 service neutron] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:31.413601 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b262e4-5702-454d-a57a-f44cd3b06c42 service neutron] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:31.431700 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:31.468194 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633dd8ef-d4ac-4df2-9244-2894926e16f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:31.469097 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dd8ef-d4ac-4df2-9244-2894926e16f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:31.469384 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dd8ef-d4ac-4df2-9244-2894926e16f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:31.469664 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dd8ef-d4ac-4df2-9244-2894926e16f8 admin admin] PATH_INFO: `/v3/users/264a47e1315f4a7d81cd06cd0857453c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:31.470857 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633dd8ef-d4ac-4df2-9244-2894926e16f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=264a47e1315f4a7d81cd06cd0857453c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:31.473374 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633dd8ef-d4ac-4df2-9244-2894926e16f8 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:31.622012 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-633dd8ef-d4ac-4df2-9244-2894926e16f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '264a47e1315f4a7d81cd06cd0857453c'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:31.634632 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-633dd8ef-d4ac-4df2-9244-2894926e16f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '264a47e1315f4a7d81cd06cd0857453c'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:31.702153 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-633dd8ef-d4ac-4df2-9244-2894926e16f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '264a47e1315f4a7d81cd06cd0857453c'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:31.702766 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-633dd8ef-d4ac-4df2-9244-2894926e16f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '264a47e1315f4a7d81cd06cd0857453c'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:31.710211 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-633dd8ef-d4ac-4df2-9244-2894926e16f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '264a47e1315f4a7d81cd06cd0857453c'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:31.716120 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1395/2788] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:35:31 2022] DELETE /identity/v3/users/264a47e1315f4a7d81cd06cd0857453c => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:35:32.120942 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1da4c2-0bb9-479c-902d-dec7770d6e95 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:32.122421 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-9e1da4c2-0bb9-479c-902d-dec7770d6e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:32.136882 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1da4c2-0bb9-479c-902d-dec7770d6e95 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:32.198203 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552e713-2d52-45fb-96b0-7051224f332a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:32.199080 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552e713-2d52-45fb-96b0-7051224f332a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:32.199363 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552e713-2d52-45fb-96b0-7051224f332a admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:32.199641 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552e713-2d52-45fb-96b0-7051224f332a admin admin] PATH_INFO: `/v3/projects/20e4d3969f17483e89886cd3c4d58ae6` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:32.200852 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9552e713-2d52-45fb-96b0-7051224f332a admin admin] RBAC: Authorizing `identity:delete_project(project_id=20e4d3969f17483e89886cd3c4d58ae6)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:32.202755 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9552e713-2d52-45fb-96b0-7051224f332a admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:32.304040 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:32.320234 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9552e713-2d52-45fb-96b0-7051224f332a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20e4d3969f17483e89886cd3c4d58ae6', 'request_id': 'req-9552e713-2d52-45fb-96b0-7051224f332a'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:32.325721 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9552e713-2d52-45fb-96b0-7051224f332a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20e4d3969f17483e89886cd3c4d58ae6', 'request_id': 'req-9552e713-2d52-45fb-96b0-7051224f332a'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:32.417262 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9552e713-2d52-45fb-96b0-7051224f332a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20e4d3969f17483e89886cd3c4d58ae6', 'request_id': 'req-9552e713-2d52-45fb-96b0-7051224f332a'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:32.434185 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9552e713-2d52-45fb-96b0-7051224f332a admin admin] The token cache is being invalidate because project 20e4d3969f17483e89886cd3c4d58ae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:35:32.434470 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9552e713-2d52-45fb-96b0-7051224f332a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:32.435131 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9552e713-2d52-45fb-96b0-7051224f332a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:32.436730 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1394/2789] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:35:32 2022] DELETE /identity/v3/projects/20e4d3969f17483e89886cd3c4d58ae6 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:35:32.441793 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae788a0-9973-4af8-89f4-0793968e5663 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:32.442340 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae788a0-9973-4af8-89f4-0793968e5663 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:32.442453 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae788a0-9973-4af8-89f4-0793968e5663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:32.459993 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-eae788a0-9973-4af8-89f4-0793968e5663 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:35:32.461281 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-eae788a0-9973-4af8-89f4-0793968e5663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:32.519207 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1396/2790] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:35:32.526959 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6212bc-164b-434c-83d3-8041abdbcd78 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:32.527247 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6212bc-164b-434c-83d3-8041abdbcd78 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:32.527519 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6212bc-164b-434c-83d3-8041abdbcd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:32.545659 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-da6212bc-164b-434c-83d3-8041abdbcd78 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:35:32.546848 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-da6212bc-164b-434c-83d3-8041abdbcd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:32.555767 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1395/2791] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:35:32.560151 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae788a0-9973-4af8-89f4-0793968e5663 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:32.569882 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae788a0-9973-4af8-89f4-0793968e5663 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:32.574447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52524e86-5a78-4159-9b42-e503e924c598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:32.575092 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52524e86-5a78-4159-9b42-e503e924c598 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:32.575375 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52524e86-5a78-4159-9b42-e503e924c598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:32.575648 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52524e86-5a78-4159-9b42-e503e924c598 admin admin] PATH_INFO: `/v3/domains` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:32.576366 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52524e86-5a78-4159-9b42-e503e924c598 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80499) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:35:32.576670 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52524e86-5a78-4159-9b42-e503e924c598 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:32.578297 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52524e86-5a78-4159-9b42-e503e924c598 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:32.590278 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1397/2792] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:35:32.594481 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6212bc-164b-434c-83d3-8041abdbcd78 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:32.604183 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6212bc-164b-434c-83d3-8041abdbcd78 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:32.608742 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b668041-9831-40ec-a3d4-8a865d70f806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:32.609413 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b668041-9831-40ec-a3d4-8a865d70f806 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:32.609695 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b668041-9831-40ec-a3d4-8a865d70f806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:32.609976 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b668041-9831-40ec-a3d4-8a865d70f806 admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:32.610661 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b668041-9831-40ec-a3d4-8a865d70f806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:32.612556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b668041-9831-40ec-a3d4-8a865d70f806 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:32.750390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1396/2793] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:35:32 2022] POST /identity/v3/projects => generated 389 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:35:32.755114 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52524e86-5a78-4159-9b42-e503e924c598 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:32.765597 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52524e86-5a78-4159-9b42-e503e924c598 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:32.793025 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:32.822867 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fd7fb-db0a-43a0-b3ad-969478b226eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:32.823538 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fd7fb-db0a-43a0-b3ad-969478b226eb admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:32.823826 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fd7fb-db0a-43a0-b3ad-969478b226eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:32.824106 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fd7fb-db0a-43a0-b3ad-969478b226eb admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:32.824792 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fd7fb-db0a-43a0-b3ad-969478b226eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:32.826754 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fd7fb-db0a-43a0-b3ad-969478b226eb admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:32.898337 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1398/2794] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:35:32 2022] POST /identity/v3/users => generated 295 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:35:32.902358 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b668041-9831-40ec-a3d4-8a865d70f806 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:32.913277 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b668041-9831-40ec-a3d4-8a865d70f806 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:32.917965 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229e333-6787-4e9e-a0fe-66fd8106b7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:32.918558 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229e333-6787-4e9e-a0fe-66fd8106b7fe admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:32.918838 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229e333-6787-4e9e-a0fe-66fd8106b7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:32.919113 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229e333-6787-4e9e-a0fe-66fd8106b7fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:32.919863 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229e333-6787-4e9e-a0fe-66fd8106b7fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:32.921480 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229e333-6787-4e9e-a0fe-66fd8106b7fe admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:32.931917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1397/2795] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:35:32.935995 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fd7fb-db0a-43a0-b3ad-969478b226eb admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:32.951073 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fd7fb-db0a-43a0-b3ad-969478b226eb admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:32.956473 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27ebe9-74ce-4b16-a271-4ffb16601f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:32.957194 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27ebe9-74ce-4b16-a271-4ffb16601f26 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:32.957482 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27ebe9-74ce-4b16-a271-4ffb16601f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:32.957789 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27ebe9-74ce-4b16-a271-4ffb16601f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:32.958547 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27ebe9-74ce-4b16-a271-4ffb16601f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:32.960148 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27ebe9-74ce-4b16-a271-4ffb16601f26 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:32.970459 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1399/2796] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:35:32.977144 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229e333-6787-4e9e-a0fe-66fd8106b7fe admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:32.987889 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229e333-6787-4e9e-a0fe-66fd8106b7fe admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:32.992642 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5ff12-29b8-44b6-ab9f-5121640cc553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:32.993565 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5ff12-29b8-44b6-ab9f-5121640cc553 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:32.993846 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5ff12-29b8-44b6-ab9f-5121640cc553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:32.994124 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5ff12-29b8-44b6-ab9f-5121640cc553 admin admin] PATH_INFO: `/v3/projects/3a35c1bbd2d14dfeb46ac35e79280dd5/users/b64c6d56ace943a085058da825b35ccc/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:33.013246 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d5ff12-29b8-44b6-ab9f-5121640cc553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a35c1bbd2d14dfeb46ac35e79280dd5, user_id=b64c6d56ace943a085058da825b35ccc, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:33.015908 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d5ff12-29b8-44b6-ab9f-5121640cc553 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:33.132239 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1398/2797] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:35:32 2022] PUT /identity/v3/projects/3a35c1bbd2d14dfeb46ac35e79280dd5/users/b64c6d56ace943a085058da825b35ccc/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:35:33.144708 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1a0f2-47fa-41e8-bf3a-cdae5045a845 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:33.145052 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1a0f2-47fa-41e8-bf3a-cdae5045a845 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:33.145325 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1a0f2-47fa-41e8-bf3a-cdae5045a845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:33.172263 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-dde1a0f2-47fa-41e8-bf3a-cdae5045a845 None None] MFA Rules not processed for user `b64c6d56ace943a085058da825b35ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:35:33.173537 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-dde1a0f2-47fa-41e8-bf3a-cdae5045a845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:33.237313 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1400/2798] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:35:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:35:33.241804 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5ff12-29b8-44b6-ab9f-5121640cc553 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:33.302913 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5ff12-29b8-44b6-ab9f-5121640cc553 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:33.307676 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f510f8b-7216-4ca1-b528-7b03f9fdd559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:33.308333 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f510f8b-7216-4ca1-b528-7b03f9fdd559 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:33.308621 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f510f8b-7216-4ca1-b528-7b03f9fdd559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:33.308931 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f510f8b-7216-4ca1-b528-7b03f9fdd559 admin admin] PATH_INFO: `/v3/projects` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:33.309634 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f510f8b-7216-4ca1-b528-7b03f9fdd559 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:33.311530 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f510f8b-7216-4ca1-b528-7b03f9fdd559 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:33.442266 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1399/2799] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:35:33 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:35:33.446350 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1a0f2-47fa-41e8-bf3a-cdae5045a845 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:33.457127 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1a0f2-47fa-41e8-bf3a-cdae5045a845 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:33.513196 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0851b-2838-43f6-80e4-11f843db2686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:33.513883 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0851b-2838-43f6-80e4-11f843db2686 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:33.514166 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0851b-2838-43f6-80e4-11f843db2686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:33.514438 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0851b-2838-43f6-80e4-11f843db2686 admin admin] PATH_INFO: `/v3/users` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:33.515126 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0851b-2838-43f6-80e4-11f843db2686 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:33.517309 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0851b-2838-43f6-80e4-11f843db2686 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:33.640230 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1401/2800] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:35:33 2022] POST /identity/v3/users => generated 299 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:35:33.644582 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f510f8b-7216-4ca1-b528-7b03f9fdd559 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:33.654831 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f510f8b-7216-4ca1-b528-7b03f9fdd559 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:33.659795 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4436445-3d73-45a9-b9e9-d3eb68228b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:33.660441 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4436445-3d73-45a9-b9e9-d3eb68228b67 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:33.660722 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4436445-3d73-45a9-b9e9-d3eb68228b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:33.661028 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4436445-3d73-45a9-b9e9-d3eb68228b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:33.661762 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4436445-3d73-45a9-b9e9-d3eb68228b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:33.663340 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4436445-3d73-45a9-b9e9-d3eb68228b67 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:33.677008 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1400/2801] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:35:33.681636 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0851b-2838-43f6-80e4-11f843db2686 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:33.694683 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0851b-2838-43f6-80e4-11f843db2686 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:33.699299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5c6bc-a157-494f-8a33-499b8ef84d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:33.700194 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5c6bc-a157-494f-8a33-499b8ef84d37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:33.700470 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5c6bc-a157-494f-8a33-499b8ef84d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:33.700749 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5c6bc-a157-494f-8a33-499b8ef84d37 admin admin] PATH_INFO: `/v3/projects/2a371679032a461a8792abd901b483c8/users/8bb378106d8e465c90135703aa4a3b9d/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:33.719740 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5c6bc-a157-494f-8a33-499b8ef84d37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a371679032a461a8792abd901b483c8, user_id=8bb378106d8e465c90135703aa4a3b9d, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:33.723934 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5c6bc-a157-494f-8a33-499b8ef84d37 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:33.846601 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1402/2802] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:35:33 2022] PUT /identity/v3/projects/2a371679032a461a8792abd901b483c8/users/8bb378106d8e465c90135703aa4a3b9d/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:35:33.850541 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4436445-3d73-45a9-b9e9-d3eb68228b67 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:33.860477 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4436445-3d73-45a9-b9e9-d3eb68228b67 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:33.880515 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:33.917491 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe09819-19d0-4352-82fd-40753b78ceba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:33.918160 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe09819-19d0-4352-82fd-40753b78ceba admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:33.918450 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe09819-19d0-4352-82fd-40753b78ceba admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:33.918728 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe09819-19d0-4352-82fd-40753b78ceba admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:33.919456 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe09819-19d0-4352-82fd-40753b78ceba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:33.921107 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe09819-19d0-4352-82fd-40753b78ceba admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:33.931351 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1401/2803] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:35:33.935835 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5c6bc-a157-494f-8a33-499b8ef84d37 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:33.941434 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:33.949913 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5c6bc-a157-494f-8a33-499b8ef84d37 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:33.951504 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d699fb-9b1a-4036-b681-2494930f7315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:33.952397 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d699fb-9b1a-4036-b681-2494930f7315 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:33.952685 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d699fb-9b1a-4036-b681-2494930f7315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:33.953012 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d699fb-9b1a-4036-b681-2494930f7315 admin admin] PATH_INFO: `/v3/projects/2a371679032a461a8792abd901b483c8/users/8bb378106d8e465c90135703aa4a3b9d/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:33.955070 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d699fb-9b1a-4036-b681-2494930f7315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a371679032a461a8792abd901b483c8, user_id=8bb378106d8e465c90135703aa4a3b9d, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:33.957829 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d699fb-9b1a-4036-b681-2494930f7315 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:33.967894 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1403/2804] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:35:33 2022] PUT /identity/v3/projects/2a371679032a461a8792abd901b483c8/users/8bb378106d8e465c90135703aa4a3b9d/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:35:33.978604 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74e87e-f75c-4000-8443-2904afb8b3ec None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:33.978897 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74e87e-f75c-4000-8443-2904afb8b3ec None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:33.979178 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74e87e-f75c-4000-8443-2904afb8b3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:34.007074 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-bb74e87e-f75c-4000-8443-2904afb8b3ec None None] MFA Rules not processed for user `8bb378106d8e465c90135703aa4a3b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:35:34.008293 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-bb74e87e-f75c-4000-8443-2904afb8b3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:34.077842 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1402/2805] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:35:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:35:34.090078 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d699fb-9b1a-4036-b681-2494930f7315 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:34.091780 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-23d699fb-9b1a-4036-b681-2494930f7315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:34.151313 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d699fb-9b1a-4036-b681-2494930f7315 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:34.155001 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7bb4b-a8e2-4f51-b06a-07f02ee245bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:34.155654 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7bb4b-a8e2-4f51-b06a-07f02ee245bf service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:34.155934 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7bb4b-a8e2-4f51-b06a-07f02ee245bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:34.156210 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7bb4b-a8e2-4f51-b06a-07f02ee245bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:34.166509 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7bb4b-a8e2-4f51-b06a-07f02ee245bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:34.169549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7bb4b-a8e2-4f51-b06a-07f02ee245bf service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:34.181007 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1404/2806] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:35:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:35:34.313773 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74e87e-f75c-4000-8443-2904afb8b3ec None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:34.375277 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74e87e-f75c-4000-8443-2904afb8b3ec None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:34.380410 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c55758-75ba-4620-b4e5-bb68c4711a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:34.381295 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c55758-75ba-4620-b4e5-bb68c4711a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:34.381573 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c55758-75ba-4620-b4e5-bb68c4711a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:34.381848 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c55758-75ba-4620-b4e5-bb68c4711a5a admin admin] PATH_INFO: `/v3/users/b64c6d56ace943a085058da825b35ccc` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:34.383034 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c55758-75ba-4620-b4e5-bb68c4711a5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b64c6d56ace943a085058da825b35ccc)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:34.384976 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c55758-75ba-4620-b4e5-bb68c4711a5a admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:34.579662 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-81c55758-75ba-4620-b4e5-bb68c4711a5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b64c6d56ace943a085058da825b35ccc'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:34.580361 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-81c55758-75ba-4620-b4e5-bb68c4711a5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b64c6d56ace943a085058da825b35ccc'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:34.582751 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:34.674615 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-81c55758-75ba-4620-b4e5-bb68c4711a5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b64c6d56ace943a085058da825b35ccc'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:34.687263 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-81c55758-75ba-4620-b4e5-bb68c4711a5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b64c6d56ace943a085058da825b35ccc'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:34.693982 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-81c55758-75ba-4620-b4e5-bb68c4711a5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b64c6d56ace943a085058da825b35ccc'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:34.699920 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1403/2807] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:35:34 2022] DELETE /identity/v3/users/b64c6d56ace943a085058da825b35ccc => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:35:34.704506 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8e5c6-9084-4ba3-bffb-2ef01fd6703d None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:34.705043 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8e5c6-9084-4ba3-bffb-2ef01fd6703d None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:34.705153 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8e5c6-9084-4ba3-bffb-2ef01fd6703d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:34.722444 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-12e8e5c6-9084-4ba3-bffb-2ef01fd6703d None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:35:34.723675 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-12e8e5c6-9084-4ba3-bffb-2ef01fd6703d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:34.782861 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1405/2808] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:35:34.793461 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c55758-75ba-4620-b4e5-bb68c4711a5a admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:34.795012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-81c55758-75ba-4620-b4e5-bb68c4711a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:34.854821 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c55758-75ba-4620-b4e5-bb68c4711a5a admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:34.858513 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6512ffe3-0b32-46d8-b861-6fb177f73693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:34.860307 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512ffe3-0b32-46d8-b861-6fb177f73693 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:34.860307 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512ffe3-0b32-46d8-b861-6fb177f73693 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:34.860307 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512ffe3-0b32-46d8-b861-6fb177f73693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:34.869379 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6512ffe3-0b32-46d8-b861-6fb177f73693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:34.870804 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6512ffe3-0b32-46d8-b861-6fb177f73693 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:34.880426 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1404/2809] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:35:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:35:35.287741 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8e5c6-9084-4ba3-bffb-2ef01fd6703d None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:35.291246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-12e8e5c6-9084-4ba3-bffb-2ef01fd6703d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:35.303860 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8e5c6-9084-4ba3-bffb-2ef01fd6703d None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:35.308688 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac78ab7-3bf3-466e-b2d0-edf85a946bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:35.309587 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac78ab7-3bf3-466e-b2d0-edf85a946bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:35.309864 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac78ab7-3bf3-466e-b2d0-edf85a946bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:35.310144 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac78ab7-3bf3-466e-b2d0-edf85a946bc2 admin admin] PATH_INFO: `/v3/projects/3a35c1bbd2d14dfeb46ac35e79280dd5` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:35.311504 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac78ab7-3bf3-466e-b2d0-edf85a946bc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a35c1bbd2d14dfeb46ac35e79280dd5)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:35.313458 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac78ab7-3bf3-466e-b2d0-edf85a946bc2 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:35.446315 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-8ac78ab7-3bf3-466e-b2d0-edf85a946bc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a35c1bbd2d14dfeb46ac35e79280dd5', 'request_id': 'req-8ac78ab7-3bf3-466e-b2d0-edf85a946bc2'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:35.452518 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-8ac78ab7-3bf3-466e-b2d0-edf85a946bc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a35c1bbd2d14dfeb46ac35e79280dd5', 'request_id': 'req-8ac78ab7-3bf3-466e-b2d0-edf85a946bc2'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:35.519337 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-8ac78ab7-3bf3-466e-b2d0-edf85a946bc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a35c1bbd2d14dfeb46ac35e79280dd5', 'request_id': 'req-8ac78ab7-3bf3-466e-b2d0-edf85a946bc2'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:35.529918 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-8ac78ab7-3bf3-466e-b2d0-edf85a946bc2 admin admin] The token cache is being invalidate because project 3a35c1bbd2d14dfeb46ac35e79280dd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:35:35.530209 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-8ac78ab7-3bf3-466e-b2d0-edf85a946bc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:35.530837 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-8ac78ab7-3bf3-466e-b2d0-edf85a946bc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:35.532394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1406/2810] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:35:35 2022] DELETE /identity/v3/projects/3a35c1bbd2d14dfeb46ac35e79280dd5 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:35:35.536995 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6512ffe3-0b32-46d8-b861-6fb177f73693 service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:35.546645 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6512ffe3-0b32-46d8-b861-6fb177f73693 service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:35.601757 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41719138-e045-4ba6-9609-61bad12b1ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:35.602617 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41719138-e045-4ba6-9609-61bad12b1ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:35.602897 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41719138-e045-4ba6-9609-61bad12b1ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:35.603171 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41719138-e045-4ba6-9609-61bad12b1ef8 admin admin] PATH_INFO: `/v3/users/8bb378106d8e465c90135703aa4a3b9d` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:35.604330 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41719138-e045-4ba6-9609-61bad12b1ef8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bb378106d8e465c90135703aa4a3b9d)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:35.606327 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41719138-e045-4ba6-9609-61bad12b1ef8 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:35.779042 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-41719138-e045-4ba6-9609-61bad12b1ef8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bb378106d8e465c90135703aa4a3b9d'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:35.779629 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-41719138-e045-4ba6-9609-61bad12b1ef8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bb378106d8e465c90135703aa4a3b9d'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:35.845446 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-41719138-e045-4ba6-9609-61bad12b1ef8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bb378106d8e465c90135703aa4a3b9d'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:35.857667 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:35.858957 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-41719138-e045-4ba6-9609-61bad12b1ef8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bb378106d8e465c90135703aa4a3b9d'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:35.865761 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-41719138-e045-4ba6-9609-61bad12b1ef8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bb378106d8e465c90135703aa4a3b9d'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:35.872603 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1405/2811] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:35:35 2022] DELETE /identity/v3/users/8bb378106d8e465c90135703aa4a3b9d => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:35:36.258930 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac78ab7-3bf3-466e-b2d0-edf85a946bc2 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:36.260501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-8ac78ab7-3bf3-466e-b2d0-edf85a946bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:36.276333 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac78ab7-3bf3-466e-b2d0-edf85a946bc2 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:36.289640 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:36.334943 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67340197-8901-40d7-aba1-16f48da84a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:36.335737 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67340197-8901-40d7-aba1-16f48da84a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:36.336012 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67340197-8901-40d7-aba1-16f48da84a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:36.336329 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67340197-8901-40d7-aba1-16f48da84a00 admin admin] PATH_INFO: `/v3/projects/2a371679032a461a8792abd901b483c8` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:36.337725 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67340197-8901-40d7-aba1-16f48da84a00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a371679032a461a8792abd901b483c8)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:36.340869 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67340197-8901-40d7-aba1-16f48da84a00 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:36.468804 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-67340197-8901-40d7-aba1-16f48da84a00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a371679032a461a8792abd901b483c8', 'request_id': 'req-67340197-8901-40d7-aba1-16f48da84a00'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:36.475179 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-67340197-8901-40d7-aba1-16f48da84a00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a371679032a461a8792abd901b483c8', 'request_id': 'req-67340197-8901-40d7-aba1-16f48da84a00'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:36.547816 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-67340197-8901-40d7-aba1-16f48da84a00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a371679032a461a8792abd901b483c8', 'request_id': 'req-67340197-8901-40d7-aba1-16f48da84a00'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:36.559179 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-67340197-8901-40d7-aba1-16f48da84a00 admin admin] The token cache is being invalidate because project 2a371679032a461a8792abd901b483c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:35:36.559469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-67340197-8901-40d7-aba1-16f48da84a00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:36.560101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-67340197-8901-40d7-aba1-16f48da84a00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:36.561696 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1407/2812] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:35:36 2022] DELETE /identity/v3/projects/2a371679032a461a8792abd901b483c8 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:35:36.567359 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bb2cd-52f5-4cda-a3f8-5d12bb8cd322 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:36.567827 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bb2cd-52f5-4cda-a3f8-5d12bb8cd322 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:36.567948 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bb2cd-52f5-4cda-a3f8-5d12bb8cd322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:36.585805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-0a5bb2cd-52f5-4cda-a3f8-5d12bb8cd322 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:35:36.586995 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-0a5bb2cd-52f5-4cda-a3f8-5d12bb8cd322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:36.646175 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1406/2813] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:35:36.654176 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75557b3-0832-42e9-9852-69d63a70a9b8 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:36.654561 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75557b3-0832-42e9-9852-69d63a70a9b8 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:36.654758 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75557b3-0832-42e9-9852-69d63a70a9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:36.675366 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-e75557b3-0832-42e9-9852-69d63a70a9b8 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:35:36.676735 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-e75557b3-0832-42e9-9852-69d63a70a9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:36.685031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1408/2814] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:35:36.689277 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5bb2cd-52f5-4cda-a3f8-5d12bb8cd322 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:36.699175 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5bb2cd-52f5-4cda-a3f8-5d12bb8cd322 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:36.703787 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8eba9b-a3a1-43d6-bbf8-370e94dc90ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:36.704444 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8eba9b-a3a1-43d6-bbf8-370e94dc90ab admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:36.704730 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8eba9b-a3a1-43d6-bbf8-370e94dc90ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:36.705062 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8eba9b-a3a1-43d6-bbf8-370e94dc90ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:36.705808 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8eba9b-a3a1-43d6-bbf8-370e94dc90ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:35:36.706122 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8eba9b-a3a1-43d6-bbf8-370e94dc90ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:36.707707 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8eba9b-a3a1-43d6-bbf8-370e94dc90ab admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:36.719253 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1407/2815] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:35:36.724053 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75557b3-0832-42e9-9852-69d63a70a9b8 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:36.733184 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75557b3-0832-42e9-9852-69d63a70a9b8 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:36.737870 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383f209-e337-482b-915b-581ddbf1cd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:36.738509 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383f209-e337-482b-915b-581ddbf1cd7f admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:36.738790 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383f209-e337-482b-915b-581ddbf1cd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:36.739067 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383f209-e337-482b-915b-581ddbf1cd7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:36.739757 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383f209-e337-482b-915b-581ddbf1cd7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:36.741701 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383f209-e337-482b-915b-581ddbf1cd7f admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:36.824249 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1409/2816] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:35:36 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:35:36.828457 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8eba9b-a3a1-43d6-bbf8-370e94dc90ab admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:36.839298 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8eba9b-a3a1-43d6-bbf8-370e94dc90ab admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:36.896548 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b81f5-ac20-47af-a0a1-1dc22f1026f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:36.897246 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b81f5-ac20-47af-a0a1-1dc22f1026f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:36.897539 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b81f5-ac20-47af-a0a1-1dc22f1026f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:36.897819 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b81f5-ac20-47af-a0a1-1dc22f1026f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:36.898511 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b81f5-ac20-47af-a0a1-1dc22f1026f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:36.900417 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b81f5-ac20-47af-a0a1-1dc22f1026f9 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:37.017719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1408/2817] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:35:36 2022] POST /identity/v3/users => generated 290 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:35:37.021871 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383f209-e337-482b-915b-581ddbf1cd7f admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:37.032744 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383f209-e337-482b-915b-581ddbf1cd7f admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:37.038864 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbccce-b615-409b-a69c-560ff6c7595c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:37.039562 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbccce-b615-409b-a69c-560ff6c7595c admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:37.039851 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbccce-b615-409b-a69c-560ff6c7595c admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:37.040131 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbccce-b615-409b-a69c-560ff6c7595c admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:37.040890 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbccce-b615-409b-a69c-560ff6c7595c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:37.042560 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbccce-b615-409b-a69c-560ff6c7595c admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:37.053805 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1410/2818] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:35:37.058389 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b81f5-ac20-47af-a0a1-1dc22f1026f9 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:37.069408 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b81f5-ac20-47af-a0a1-1dc22f1026f9 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:37.074160 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b4302-1d3c-457d-9251-5f5726db25cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:37.074822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b4302-1d3c-457d-9251-5f5726db25cd admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:37.075105 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b4302-1d3c-457d-9251-5f5726db25cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:37.075383 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b4302-1d3c-457d-9251-5f5726db25cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:37.076193 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b4302-1d3c-457d-9251-5f5726db25cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:37.077820 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b4302-1d3c-457d-9251-5f5726db25cd admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:37.088439 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1409/2819] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:35:37.092685 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbccce-b615-409b-a69c-560ff6c7595c admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:37.103334 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbccce-b615-409b-a69c-560ff6c7595c admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:37.107950 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c09240-c5af-47cd-8063-6b0a96c6015f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:37.108836 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c09240-c5af-47cd-8063-6b0a96c6015f admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:37.109143 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c09240-c5af-47cd-8063-6b0a96c6015f admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:37.109420 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c09240-c5af-47cd-8063-6b0a96c6015f admin admin] PATH_INFO: `/v3/projects/f7d6e6da8eb4425cb2b43c049cbcd3ca/users/81fedb00bfc64cc39b85ff03c2e59985/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:37.123757 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c09240-c5af-47cd-8063-6b0a96c6015f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7d6e6da8eb4425cb2b43c049cbcd3ca, user_id=81fedb00bfc64cc39b85ff03c2e59985, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:37.126470 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c09240-c5af-47cd-8063-6b0a96c6015f admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:37.245757 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1411/2820] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:35:37 2022] PUT /identity/v3/projects/f7d6e6da8eb4425cb2b43c049cbcd3ca/users/81fedb00bfc64cc39b85ff03c2e59985/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:35:37.257376 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05405e-bea5-4000-8f5b-4c1dc9fa5532 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:37.257655 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05405e-bea5-4000-8f5b-4c1dc9fa5532 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:37.257937 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05405e-bea5-4000-8f5b-4c1dc9fa5532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:37.285675 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-ea05405e-bea5-4000-8f5b-4c1dc9fa5532 None None] MFA Rules not processed for user `81fedb00bfc64cc39b85ff03c2e59985`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:35:37.286881 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-ea05405e-bea5-4000-8f5b-4c1dc9fa5532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:37.326855 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:37.349712 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1410/2821] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:35:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:35:37.354299 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c09240-c5af-47cd-8063-6b0a96c6015f admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:37.398881 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:37.416559 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c09240-c5af-47cd-8063-6b0a96c6015f admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:37.421199 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7b002-6d83-43f8-b4d8-de1d6ce02823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:37.421860 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7b002-6d83-43f8-b4d8-de1d6ce02823 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:37.422141 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7b002-6d83-43f8-b4d8-de1d6ce02823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:37.422413 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7b002-6d83-43f8-b4d8-de1d6ce02823 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:37.423109 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7b002-6d83-43f8-b4d8-de1d6ce02823 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:37.425065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7b002-6d83-43f8-b4d8-de1d6ce02823 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:37.513856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1412/2822] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:35:37 2022] POST /identity/v3/projects => generated 377 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:35:37.518770 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05405e-bea5-4000-8f5b-4c1dc9fa5532 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:37.529521 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05405e-bea5-4000-8f5b-4c1dc9fa5532 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:37.584922 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8b64c-d3bc-4b68-94be-2bad1a416e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:37.585616 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8b64c-d3bc-4b68-94be-2bad1a416e34 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:37.585869 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8b64c-d3bc-4b68-94be-2bad1a416e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:37.586152 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8b64c-d3bc-4b68-94be-2bad1a416e34 admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:37.586844 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8b64c-d3bc-4b68-94be-2bad1a416e34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:37.588770 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8b64c-d3bc-4b68-94be-2bad1a416e34 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:37.673969 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1411/2823] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:35:37 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:35:37.677889 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7b002-6d83-43f8-b4d8-de1d6ce02823 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:37.688662 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7b002-6d83-43f8-b4d8-de1d6ce02823 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:37.693922 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53365d60-27a1-4ae3-bb75-9fb9a92af3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:37.694593 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53365d60-27a1-4ae3-bb75-9fb9a92af3db admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:37.694873 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53365d60-27a1-4ae3-bb75-9fb9a92af3db admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:37.695154 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53365d60-27a1-4ae3-bb75-9fb9a92af3db admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:37.695883 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53365d60-27a1-4ae3-bb75-9fb9a92af3db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:37.697529 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53365d60-27a1-4ae3-bb75-9fb9a92af3db admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:37.708734 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1413/2824] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:35:37.712740 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8b64c-d3bc-4b68-94be-2bad1a416e34 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:37.722729 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8b64c-d3bc-4b68-94be-2bad1a416e34 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:37.727379 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe35ad8-5b11-4281-89ce-be1f2b444cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:37.728036 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe35ad8-5b11-4281-89ce-be1f2b444cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:37.728321 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe35ad8-5b11-4281-89ce-be1f2b444cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:37.728601 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe35ad8-5b11-4281-89ce-be1f2b444cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:37.729369 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe35ad8-5b11-4281-89ce-be1f2b444cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:37.730947 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe35ad8-5b11-4281-89ce-be1f2b444cf7 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:37.740989 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1412/2825] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:35:37.744999 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53365d60-27a1-4ae3-bb75-9fb9a92af3db admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:37.755566 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53365d60-27a1-4ae3-bb75-9fb9a92af3db admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:37.760225 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9aeade-ee09-4100-a49e-853ea94d4e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:37.761138 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9aeade-ee09-4100-a49e-853ea94d4e06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:37.761427 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9aeade-ee09-4100-a49e-853ea94d4e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:37.761705 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9aeade-ee09-4100-a49e-853ea94d4e06 admin admin] PATH_INFO: `/v3/projects/e9bcf0ffe05c42c48b3ce88005ebfd59/users/690261e14deb4bdc88ebb7386430f5b5/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:37.777316 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9aeade-ee09-4100-a49e-853ea94d4e06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9bcf0ffe05c42c48b3ce88005ebfd59, user_id=690261e14deb4bdc88ebb7386430f5b5, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:37.779995 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9aeade-ee09-4100-a49e-853ea94d4e06 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:37.931957 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1414/2826] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:35:37 2022] PUT /identity/v3/projects/e9bcf0ffe05c42c48b3ce88005ebfd59/users/690261e14deb4bdc88ebb7386430f5b5/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:35:37.943009 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb3afb-c21a-48a4-b183-4631a77e34c4 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:37.943300 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb3afb-c21a-48a4-b183-4631a77e34c4 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:37.943668 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb3afb-c21a-48a4-b183-4631a77e34c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:37.969267 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-97cb3afb-c21a-48a4-b183-4631a77e34c4 None None] MFA Rules not processed for user `690261e14deb4bdc88ebb7386430f5b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:35:37.970472 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-97cb3afb-c21a-48a4-b183-4631a77e34c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:38.034862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1413/2827] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:35:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:35:38.040581 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9aeade-ee09-4100-a49e-853ea94d4e06 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:38.103348 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9aeade-ee09-4100-a49e-853ea94d4e06 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:38.108168 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d66c9-7a3e-4b56-b329-efe8d523c51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:38.108839 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d66c9-7a3e-4b56-b329-efe8d523c51d admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:38.109140 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d66c9-7a3e-4b56-b329-efe8d523c51d admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:38.109410 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d66c9-7a3e-4b56-b329-efe8d523c51d admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:38.110107 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d66c9-7a3e-4b56-b329-efe8d523c51d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:38.112499 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d66c9-7a3e-4b56-b329-efe8d523c51d admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:38.230578 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1415/2828] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:35:38 2022] POST /identity/v3/projects => generated 379 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:35:38.235249 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb3afb-c21a-48a4-b183-4631a77e34c4 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:38.246665 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb3afb-c21a-48a4-b183-4631a77e34c4 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:38.293405 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:38.304255 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad64926-36e1-4438-84ec-bcb5ed79fa3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:38.304968 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad64926-36e1-4438-84ec-bcb5ed79fa3e admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:38.305256 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad64926-36e1-4438-84ec-bcb5ed79fa3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:38.305631 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad64926-36e1-4438-84ec-bcb5ed79fa3e admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:38.306369 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad64926-36e1-4438-84ec-bcb5ed79fa3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:38.308338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad64926-36e1-4438-84ec-bcb5ed79fa3e admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:38.446088 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1414/2829] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:35:38 2022] POST /identity/v3/users => generated 296 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:35:38.450094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d66c9-7a3e-4b56-b329-efe8d523c51d admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:38.460735 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d66c9-7a3e-4b56-b329-efe8d523c51d admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:38.465422 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdb3ea-5bef-4ae7-9dc7-b5b4a2ea4d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:38.466108 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdb3ea-5bef-4ae7-9dc7-b5b4a2ea4d87 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:38.466390 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdb3ea-5bef-4ae7-9dc7-b5b4a2ea4d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:38.466704 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdb3ea-5bef-4ae7-9dc7-b5b4a2ea4d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:38.467428 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acdb3ea-5bef-4ae7-9dc7-b5b4a2ea4d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:38.469096 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acdb3ea-5bef-4ae7-9dc7-b5b4a2ea4d87 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:38.480879 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1416/2830] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:35:38.485112 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad64926-36e1-4438-84ec-bcb5ed79fa3e admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:38.496283 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad64926-36e1-4438-84ec-bcb5ed79fa3e admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:38.500938 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379c022-027e-4850-b219-f9c1bc1f4798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:38.501819 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379c022-027e-4850-b219-f9c1bc1f4798 admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:38.502096 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379c022-027e-4850-b219-f9c1bc1f4798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:38.502370 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379c022-027e-4850-b219-f9c1bc1f4798 admin admin] PATH_INFO: `/v3/projects/373137bfe54d4e2fade95aa7cca26321/users/260e149c7b9d4acfa5314ad51ba65faa/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:38.518508 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379c022-027e-4850-b219-f9c1bc1f4798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=373137bfe54d4e2fade95aa7cca26321, user_id=260e149c7b9d4acfa5314ad51ba65faa, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:38.521747 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379c022-027e-4850-b219-f9c1bc1f4798 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:38.610837 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1415/2831] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:35:38 2022] PUT /identity/v3/projects/373137bfe54d4e2fade95aa7cca26321/users/260e149c7b9d4acfa5314ad51ba65faa/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:35:38.614984 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdb3ea-5bef-4ae7-9dc7-b5b4a2ea4d87 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:38.625019 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdb3ea-5bef-4ae7-9dc7-b5b4a2ea4d87 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:38.690250 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126ea51-6df3-40b3-a659-ec7425c4bce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:38.691143 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126ea51-6df3-40b3-a659-ec7425c4bce1 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:38.691433 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126ea51-6df3-40b3-a659-ec7425c4bce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:38.691713 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126ea51-6df3-40b3-a659-ec7425c4bce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:38.692454 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126ea51-6df3-40b3-a659-ec7425c4bce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:38.695206 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126ea51-6df3-40b3-a659-ec7425c4bce1 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:38.707233 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1417/2832] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:35:38.712218 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379c022-027e-4850-b219-f9c1bc1f4798 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:38.722503 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379c022-027e-4850-b219-f9c1bc1f4798 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:38.727704 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bb148-9b05-42d1-9382-5c6ec2a240be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:38.728569 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bb148-9b05-42d1-9382-5c6ec2a240be admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:38.728872 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bb148-9b05-42d1-9382-5c6ec2a240be admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:38.729145 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bb148-9b05-42d1-9382-5c6ec2a240be admin admin] PATH_INFO: `/v3/projects/373137bfe54d4e2fade95aa7cca26321/users/260e149c7b9d4acfa5314ad51ba65faa/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:38.731151 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4bb148-9b05-42d1-9382-5c6ec2a240be admin admin] RBAC: Authorizing `identity:create_grant(project_id=373137bfe54d4e2fade95aa7cca26321, user_id=260e149c7b9d4acfa5314ad51ba65faa, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:38.733727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4bb148-9b05-42d1-9382-5c6ec2a240be admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:38.743852 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1416/2833] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:35:38 2022] PUT /identity/v3/projects/373137bfe54d4e2fade95aa7cca26321/users/260e149c7b9d4acfa5314ad51ba65faa/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:35:38.754212 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb85da4-145a-4e67-b373-f60f51b59006 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:38.754509 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb85da4-145a-4e67-b373-f60f51b59006 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:38.754840 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb85da4-145a-4e67-b373-f60f51b59006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:38.760908 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:38.782581 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-4bb85da4-145a-4e67-b373-f60f51b59006 None None] MFA Rules not processed for user `260e149c7b9d4acfa5314ad51ba65faa`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:35:38.783797 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-4bb85da4-145a-4e67-b373-f60f51b59006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:38.851626 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1418/2834] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:35:38 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:35:38.862780 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bb148-9b05-42d1-9382-5c6ec2a240be admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:38.864451 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-ee4bb148-9b05-42d1-9382-5c6ec2a240be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:38.922120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bb148-9b05-42d1-9382-5c6ec2a240be admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:38.925714 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768010a-4968-4d9a-8432-58de57460355 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:38.926352 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768010a-4968-4d9a-8432-58de57460355 service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:38.926632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768010a-4968-4d9a-8432-58de57460355 service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:38.926907 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768010a-4968-4d9a-8432-58de57460355 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:38.935798 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768010a-4968-4d9a-8432-58de57460355 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:38.937229 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768010a-4968-4d9a-8432-58de57460355 service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:38.946965 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1417/2835] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:35:38 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:35:39.032366 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb85da4-145a-4e67-b373-f60f51b59006 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:39.033802 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-4bb85da4-145a-4e67-b373-f60f51b59006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:39.046482 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb85da4-145a-4e67-b373-f60f51b59006 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:39.050253 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ec1bd-106f-4053-b050-a55be2f28f65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:39.050903 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ec1bd-106f-4053-b050-a55be2f28f65 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:39.051183 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ec1bd-106f-4053-b050-a55be2f28f65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:39.051455 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ec1bd-106f-4053-b050-a55be2f28f65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:39.111828 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ec1bd-106f-4053-b050-a55be2f28f65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:39.113310 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ec1bd-106f-4053-b050-a55be2f28f65 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:39.122445 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1419/2836] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:35:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:35:43.357015 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768010a-4968-4d9a-8432-58de57460355 service cinder] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:43.421716 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768010a-4968-4d9a-8432-58de57460355 service cinder] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:43.426314 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ba8da-f2f9-4211-9643-2dfcc013392a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:43.427185 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ba8da-f2f9-4211-9643-2dfcc013392a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:43.427469 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ba8da-f2f9-4211-9643-2dfcc013392a admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:43.427746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ba8da-f2f9-4211-9643-2dfcc013392a admin admin] PATH_INFO: `/v3/users/81fedb00bfc64cc39b85ff03c2e59985` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:43.429556 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ba8da-f2f9-4211-9643-2dfcc013392a admin admin] RBAC: Authorizing `identity:delete_user(user_id=81fedb00bfc64cc39b85ff03c2e59985)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:43.431469 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ba8da-f2f9-4211-9643-2dfcc013392a admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:43.589657 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-178ba8da-f2f9-4211-9643-2dfcc013392a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81fedb00bfc64cc39b85ff03c2e59985'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:43.590323 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-178ba8da-f2f9-4211-9643-2dfcc013392a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81fedb00bfc64cc39b85ff03c2e59985'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:43.592003 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:43.673498 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-178ba8da-f2f9-4211-9643-2dfcc013392a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81fedb00bfc64cc39b85ff03c2e59985'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:43.686441 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-178ba8da-f2f9-4211-9643-2dfcc013392a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81fedb00bfc64cc39b85ff03c2e59985'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:43.693098 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-178ba8da-f2f9-4211-9643-2dfcc013392a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81fedb00bfc64cc39b85ff03c2e59985'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:43.699081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1418/2837] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:35:43 2022] DELETE /identity/v3/users/81fedb00bfc64cc39b85ff03c2e59985 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:35:43.703815 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6b4c4-75bd-45b0-8122-0a00fe6bb023 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:43.707427 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6b4c4-75bd-45b0-8122-0a00fe6bb023 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:43.707427 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6b4c4-75bd-45b0-8122-0a00fe6bb023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:43.721968 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-cad6b4c4-75bd-45b0-8122-0a00fe6bb023 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:35:43.723195 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-cad6b4c4-75bd-45b0-8122-0a00fe6bb023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:43.780889 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1420/2838] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:35:43.791496 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ba8da-f2f9-4211-9643-2dfcc013392a admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:43.792994 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-178ba8da-f2f9-4211-9643-2dfcc013392a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:43.850872 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ba8da-f2f9-4211-9643-2dfcc013392a admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:43.854890 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644967b3-751e-4f98-bf39-083de9d69f38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:43.855596 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644967b3-751e-4f98-bf39-083de9d69f38 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:43.855882 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644967b3-751e-4f98-bf39-083de9d69f38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:43.856162 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644967b3-751e-4f98-bf39-083de9d69f38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:43.865440 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644967b3-751e-4f98-bf39-083de9d69f38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:43.866917 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644967b3-751e-4f98-bf39-083de9d69f38 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:43.876511 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1419/2839] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:35:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:35:44.283041 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6b4c4-75bd-45b0-8122-0a00fe6bb023 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:44.284519 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-cad6b4c4-75bd-45b0-8122-0a00fe6bb023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:44.296762 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6b4c4-75bd-45b0-8122-0a00fe6bb023 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:44.301535 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3861ba-39c2-490b-b758-fab9ec02ab9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:44.302563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3861ba-39c2-490b-b758-fab9ec02ab9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:44.302850 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3861ba-39c2-490b-b758-fab9ec02ab9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:44.303129 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3861ba-39c2-490b-b758-fab9ec02ab9f admin admin] PATH_INFO: `/v3/projects/f7d6e6da8eb4425cb2b43c049cbcd3ca` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:44.304341 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3861ba-39c2-490b-b758-fab9ec02ab9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7d6e6da8eb4425cb2b43c049cbcd3ca)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:44.306281 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3861ba-39c2-490b-b758-fab9ec02ab9f admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:44.330099 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:44.445856 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-0f3861ba-39c2-490b-b758-fab9ec02ab9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7d6e6da8eb4425cb2b43c049cbcd3ca', 'request_id': 'req-0f3861ba-39c2-490b-b758-fab9ec02ab9f'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:44.453394 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-0f3861ba-39c2-490b-b758-fab9ec02ab9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7d6e6da8eb4425cb2b43c049cbcd3ca', 'request_id': 'req-0f3861ba-39c2-490b-b758-fab9ec02ab9f'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:44.518963 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-0f3861ba-39c2-490b-b758-fab9ec02ab9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7d6e6da8eb4425cb2b43c049cbcd3ca', 'request_id': 'req-0f3861ba-39c2-490b-b758-fab9ec02ab9f'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:44.534532 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-0f3861ba-39c2-490b-b758-fab9ec02ab9f admin admin] The token cache is being invalidate because project f7d6e6da8eb4425cb2b43c049cbcd3ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:35:44.534861 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-0f3861ba-39c2-490b-b758-fab9ec02ab9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:44.535517 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-0f3861ba-39c2-490b-b758-fab9ec02ab9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:44.537112 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1421/2840] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:35:44 2022] DELETE /identity/v3/projects/f7d6e6da8eb4425cb2b43c049cbcd3ca => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:35:44.541648 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644967b3-751e-4f98-bf39-083de9d69f38 service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:44.551867 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644967b3-751e-4f98-bf39-083de9d69f38 service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:44.608984 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1a2a9-7e1a-4d46-8647-9c18205c6817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:44.609863 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1a2a9-7e1a-4d46-8647-9c18205c6817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:44.610149 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1a2a9-7e1a-4d46-8647-9c18205c6817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:44.610432 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1a2a9-7e1a-4d46-8647-9c18205c6817 admin admin] PATH_INFO: `/v3/users/690261e14deb4bdc88ebb7386430f5b5` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:44.611630 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1a2a9-7e1a-4d46-8647-9c18205c6817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=690261e14deb4bdc88ebb7386430f5b5)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:44.613581 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1a2a9-7e1a-4d46-8647-9c18205c6817 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:44.887207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-cca1a2a9-7e1a-4d46-8647-9c18205c6817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '690261e14deb4bdc88ebb7386430f5b5'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:44.887885 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-cca1a2a9-7e1a-4d46-8647-9c18205c6817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '690261e14deb4bdc88ebb7386430f5b5'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:44.958913 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-cca1a2a9-7e1a-4d46-8647-9c18205c6817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '690261e14deb4bdc88ebb7386430f5b5'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:44.970375 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:44.971583 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-cca1a2a9-7e1a-4d46-8647-9c18205c6817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '690261e14deb4bdc88ebb7386430f5b5'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:44.978848 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-cca1a2a9-7e1a-4d46-8647-9c18205c6817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '690261e14deb4bdc88ebb7386430f5b5'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:44.984931 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1420/2841] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:35:44 2022] DELETE /identity/v3/users/690261e14deb4bdc88ebb7386430f5b5 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:35:45.434855 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3861ba-39c2-490b-b758-fab9ec02ab9f admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:45.436336 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-0f3861ba-39c2-490b-b758-fab9ec02ab9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:45.449234 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3861ba-39c2-490b-b758-fab9ec02ab9f admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:45.507407 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d52f1-b4bb-4b3f-97e2-af26330c0996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:45.508272 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d52f1-b4bb-4b3f-97e2-af26330c0996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:45.508558 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d52f1-b4bb-4b3f-97e2-af26330c0996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:45.508864 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d52f1-b4bb-4b3f-97e2-af26330c0996 admin admin] PATH_INFO: `/v3/projects/e9bcf0ffe05c42c48b3ce88005ebfd59` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:45.510218 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d52f1-b4bb-4b3f-97e2-af26330c0996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9bcf0ffe05c42c48b3ce88005ebfd59)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:45.512543 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d52f1-b4bb-4b3f-97e2-af26330c0996 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:45.622253 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-050d52f1-b4bb-4b3f-97e2-af26330c0996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9bcf0ffe05c42c48b3ce88005ebfd59', 'request_id': 'req-050d52f1-b4bb-4b3f-97e2-af26330c0996'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:45.628605 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-050d52f1-b4bb-4b3f-97e2-af26330c0996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9bcf0ffe05c42c48b3ce88005ebfd59', 'request_id': 'req-050d52f1-b4bb-4b3f-97e2-af26330c0996'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:45.673812 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-050d52f1-b4bb-4b3f-97e2-af26330c0996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9bcf0ffe05c42c48b3ce88005ebfd59', 'request_id': 'req-050d52f1-b4bb-4b3f-97e2-af26330c0996'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:45.691602 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-050d52f1-b4bb-4b3f-97e2-af26330c0996 admin admin] The token cache is being invalidate because project e9bcf0ffe05c42c48b3ce88005ebfd59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:35:45.692014 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-050d52f1-b4bb-4b3f-97e2-af26330c0996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:45.692770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-050d52f1-b4bb-4b3f-97e2-af26330c0996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:45.695135 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1422/2842] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:35:45 2022] DELETE /identity/v3/projects/e9bcf0ffe05c42c48b3ce88005ebfd59 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:35:45.699155 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1a2a9-7e1a-4d46-8647-9c18205c6817 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:45.700549 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-cca1a2a9-7e1a-4d46-8647-9c18205c6817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:45.713945 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1a2a9-7e1a-4d46-8647-9c18205c6817 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:45.768962 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882020a-2136-4703-95af-05a5642ac2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:45.769824 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882020a-2136-4703-95af-05a5642ac2ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:45.770105 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882020a-2136-4703-95af-05a5642ac2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:45.770380 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882020a-2136-4703-95af-05a5642ac2ed admin admin] PATH_INFO: `/v3/users/260e149c7b9d4acfa5314ad51ba65faa` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:45.771571 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9882020a-2136-4703-95af-05a5642ac2ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=260e149c7b9d4acfa5314ad51ba65faa)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:45.774135 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9882020a-2136-4703-95af-05a5642ac2ed admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:45.984643 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9882020a-2136-4703-95af-05a5642ac2ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '260e149c7b9d4acfa5314ad51ba65faa'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:45.985266 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9882020a-2136-4703-95af-05a5642ac2ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '260e149c7b9d4acfa5314ad51ba65faa'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:46.062509 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9882020a-2136-4703-95af-05a5642ac2ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '260e149c7b9d4acfa5314ad51ba65faa'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:46.075922 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9882020a-2136-4703-95af-05a5642ac2ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '260e149c7b9d4acfa5314ad51ba65faa'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:46.082801 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-9882020a-2136-4703-95af-05a5642ac2ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '260e149c7b9d4acfa5314ad51ba65faa'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:46.088890 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1421/2843] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:35:45 2022] DELETE /identity/v3/users/260e149c7b9d4acfa5314ad51ba65faa => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:35:46.498310 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d52f1-b4bb-4b3f-97e2-af26330c0996 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:46.499838 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-050d52f1-b4bb-4b3f-97e2-af26330c0996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:46.513121 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d52f1-b4bb-4b3f-97e2-af26330c0996 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:46.560757 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:46.578605 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d4440-e857-43f8-8ef2-2f26d2608025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:46.579476 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d4440-e857-43f8-8ef2-2f26d2608025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:46.579737 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d4440-e857-43f8-8ef2-2f26d2608025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:46.580015 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d4440-e857-43f8-8ef2-2f26d2608025 admin admin] PATH_INFO: `/v3/projects/373137bfe54d4e2fade95aa7cca26321` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:46.581265 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d4440-e857-43f8-8ef2-2f26d2608025 admin admin] RBAC: Authorizing `identity:delete_project(project_id=373137bfe54d4e2fade95aa7cca26321)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:46.583222 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d4440-e857-43f8-8ef2-2f26d2608025 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:46.680400 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-b14d4440-e857-43f8-8ef2-2f26d2608025 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '373137bfe54d4e2fade95aa7cca26321', 'request_id': 'req-b14d4440-e857-43f8-8ef2-2f26d2608025'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:46.686596 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-b14d4440-e857-43f8-8ef2-2f26d2608025 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '373137bfe54d4e2fade95aa7cca26321', 'request_id': 'req-b14d4440-e857-43f8-8ef2-2f26d2608025'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:46.759178 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-b14d4440-e857-43f8-8ef2-2f26d2608025 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '373137bfe54d4e2fade95aa7cca26321', 'request_id': 'req-b14d4440-e857-43f8-8ef2-2f26d2608025'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:46.771083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-b14d4440-e857-43f8-8ef2-2f26d2608025 admin admin] The token cache is being invalidate because project 373137bfe54d4e2fade95aa7cca26321 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:35:46.771373 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-b14d4440-e857-43f8-8ef2-2f26d2608025 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:46.772527 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-b14d4440-e857-43f8-8ef2-2f26d2608025 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:46.774094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1423/2844] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:35:46 2022] DELETE /identity/v3/projects/373137bfe54d4e2fade95aa7cca26321 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:35:46.779918 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7811dd1-495f-4338-a07e-b5d11d077744 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:46.783622 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7811dd1-495f-4338-a07e-b5d11d077744 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:46.783622 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7811dd1-495f-4338-a07e-b5d11d077744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:46.801089 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-f7811dd1-495f-4338-a07e-b5d11d077744 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:35:46.802062 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-f7811dd1-495f-4338-a07e-b5d11d077744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:46.862459 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1422/2845] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:35:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:35:46.921746 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af3d7e-3704-43bb-aac8-f01500ff9630 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:46.922104 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af3d7e-3704-43bb-aac8-f01500ff9630 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:46.922429 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af3d7e-3704-43bb-aac8-f01500ff9630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:46.942655 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-a2af3d7e-3704-43bb-aac8-f01500ff9630 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:35:46.946244 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-a2af3d7e-3704-43bb-aac8-f01500ff9630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:46.952522 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1424/2846] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:35:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:35:46.957583 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7811dd1-495f-4338-a07e-b5d11d077744 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:46.967998 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7811dd1-495f-4338-a07e-b5d11d077744 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:46.972655 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b54bc-3457-411e-ae8e-218ae95da601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:46.973350 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b54bc-3457-411e-ae8e-218ae95da601 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:46.973636 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b54bc-3457-411e-ae8e-218ae95da601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:46.973915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b54bc-3457-411e-ae8e-218ae95da601 admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:46.974650 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b54bc-3457-411e-ae8e-218ae95da601 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:35:46.974959 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b54bc-3457-411e-ae8e-218ae95da601 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:46.977157 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b54bc-3457-411e-ae8e-218ae95da601 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:46.978642 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:46.989191 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1423/2847] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:35:46.993713 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af3d7e-3704-43bb-aac8-f01500ff9630 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:47.003018 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af3d7e-3704-43bb-aac8-f01500ff9630 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:47.007716 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdc51b-bdcd-4427-9745-890ea171859d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:47.008363 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdc51b-bdcd-4427-9745-890ea171859d admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:47.008647 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdc51b-bdcd-4427-9745-890ea171859d admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:47.008957 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdc51b-bdcd-4427-9745-890ea171859d admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:47.009760 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fdc51b-bdcd-4427-9745-890ea171859d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:47.011678 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fdc51b-bdcd-4427-9745-890ea171859d admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:47.156882 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1425/2848] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:35:46 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:35:47.160158 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b54bc-3457-411e-ae8e-218ae95da601 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:47.170175 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b54bc-3457-411e-ae8e-218ae95da601 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:47.225968 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cd1ee-a7a5-40ca-9b7a-59d7002859a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:47.226640 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cd1ee-a7a5-40ca-9b7a-59d7002859a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:47.226928 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cd1ee-a7a5-40ca-9b7a-59d7002859a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:47.227210 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cd1ee-a7a5-40ca-9b7a-59d7002859a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:47.227900 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37cd1ee-a7a5-40ca-9b7a-59d7002859a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:47.229848 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37cd1ee-a7a5-40ca-9b7a-59d7002859a5 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:47.336890 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1424/2849] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:35:47 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:35:47.341164 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdc51b-bdcd-4427-9745-890ea171859d admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:47.352396 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdc51b-bdcd-4427-9745-890ea171859d admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:47.357631 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125a8d6-f16d-4fb5-94a0-30e0edbc1763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:47.358401 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125a8d6-f16d-4fb5-94a0-30e0edbc1763 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:47.358796 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125a8d6-f16d-4fb5-94a0-30e0edbc1763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:47.359173 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125a8d6-f16d-4fb5-94a0-30e0edbc1763 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:47.360008 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125a8d6-f16d-4fb5-94a0-30e0edbc1763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:47.361811 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125a8d6-f16d-4fb5-94a0-30e0edbc1763 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:47.373101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1426/2850] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:35:47.378263 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cd1ee-a7a5-40ca-9b7a-59d7002859a5 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:47.389010 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cd1ee-a7a5-40ca-9b7a-59d7002859a5 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:47.394052 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b894b-cd9b-4e06-8cc5-f275302aa90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:47.394758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b894b-cd9b-4e06-8cc5-f275302aa90e admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:47.395042 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b894b-cd9b-4e06-8cc5-f275302aa90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:47.395318 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b894b-cd9b-4e06-8cc5-f275302aa90e admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:47.396051 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b894b-cd9b-4e06-8cc5-f275302aa90e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:47.398366 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b894b-cd9b-4e06-8cc5-f275302aa90e admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:47.410563 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1425/2851] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:35:47.414756 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125a8d6-f16d-4fb5-94a0-30e0edbc1763 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:47.425083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125a8d6-f16d-4fb5-94a0-30e0edbc1763 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:47.430246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccba4aa-a733-49c9-b878-0bd3d7c769fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:47.431407 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccba4aa-a733-49c9-b878-0bd3d7c769fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:47.431693 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccba4aa-a733-49c9-b878-0bd3d7c769fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:47.431966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccba4aa-a733-49c9-b878-0bd3d7c769fe admin admin] PATH_INFO: `/v3/projects/60c8a959249c42928c39b6a4688480f4/users/e2431051e28d447ca88ebbc4d7727bbb/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:47.446996 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccba4aa-a733-49c9-b878-0bd3d7c769fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=60c8a959249c42928c39b6a4688480f4, user_id=e2431051e28d447ca88ebbc4d7727bbb, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:47.449673 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccba4aa-a733-49c9-b878-0bd3d7c769fe admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:47.565414 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1427/2852] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:35:47 2022] PUT /identity/v3/projects/60c8a959249c42928c39b6a4688480f4/users/e2431051e28d447ca88ebbc4d7727bbb/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:35:47.577158 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d725826-6d37-49a9-a1a2-99831e62732a None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:47.577449 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d725826-6d37-49a9-a1a2-99831e62732a None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:47.577730 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d725826-6d37-49a9-a1a2-99831e62732a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:47.603480 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-8d725826-6d37-49a9-a1a2-99831e62732a None None] MFA Rules not processed for user `e2431051e28d447ca88ebbc4d7727bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:35:47.604616 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-8d725826-6d37-49a9-a1a2-99831e62732a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:47.668243 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1426/2853] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:35:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:35:47.672489 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccba4aa-a733-49c9-b878-0bd3d7c769fe admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:47.733533 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccba4aa-a733-49c9-b878-0bd3d7c769fe admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:47.738324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fdef0-7460-49c8-a536-f8b3f7bda214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:47.738980 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fdef0-7460-49c8-a536-f8b3f7bda214 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:47.739261 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fdef0-7460-49c8-a536-f8b3f7bda214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:47.739537 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fdef0-7460-49c8-a536-f8b3f7bda214 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:47.740258 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62fdef0-7460-49c8-a536-f8b3f7bda214 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:47.742709 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62fdef0-7460-49c8-a536-f8b3f7bda214 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:47.752223 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:47.823696 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1428/2854] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:35:47 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:35:47.827669 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d725826-6d37-49a9-a1a2-99831e62732a None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:47.838787 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d725826-6d37-49a9-a1a2-99831e62732a None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:47.895434 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9673165-747e-4a41-af8e-11493ed0064b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:47.896013 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9673165-747e-4a41-af8e-11493ed0064b admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:47.896300 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9673165-747e-4a41-af8e-11493ed0064b admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:47.896606 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9673165-747e-4a41-af8e-11493ed0064b admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:47.897352 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9673165-747e-4a41-af8e-11493ed0064b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:47.899281 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9673165-747e-4a41-af8e-11493ed0064b admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:47.906735 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:48.004975 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1427/2855] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:35:47 2022] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:35:48.009081 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fdef0-7460-49c8-a536-f8b3f7bda214 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:48.019725 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fdef0-7460-49c8-a536-f8b3f7bda214 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:48.024549 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5bc1d-1599-4ab6-90e6-61dcd95aeb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:48.025243 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5bc1d-1599-4ab6-90e6-61dcd95aeb20 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:48.025529 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5bc1d-1599-4ab6-90e6-61dcd95aeb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:48.025806 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5bc1d-1599-4ab6-90e6-61dcd95aeb20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:48.026612 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5bc1d-1599-4ab6-90e6-61dcd95aeb20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:48.028214 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5bc1d-1599-4ab6-90e6-61dcd95aeb20 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:48.039652 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1429/2856] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:35:48.043900 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9673165-747e-4a41-af8e-11493ed0064b admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:48.054578 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9673165-747e-4a41-af8e-11493ed0064b admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:48.059331 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d720a6-fef5-413a-affd-5dd294db00fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:48.060210 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d720a6-fef5-413a-affd-5dd294db00fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:48.060496 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d720a6-fef5-413a-affd-5dd294db00fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:48.060771 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d720a6-fef5-413a-affd-5dd294db00fb admin admin] PATH_INFO: `/v3/projects/66f0184545cd40b2ab4c36a50cbcf424/users/b7af3736ee9f4a7c834fabff0f1137a4/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:48.075340 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d720a6-fef5-413a-affd-5dd294db00fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=66f0184545cd40b2ab4c36a50cbcf424, user_id=b7af3736ee9f4a7c834fabff0f1137a4, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:48.078080 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d720a6-fef5-413a-affd-5dd294db00fb admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:48.147687 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1428/2857] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:35:48 2022] PUT /identity/v3/projects/66f0184545cd40b2ab4c36a50cbcf424/users/b7af3736ee9f4a7c834fabff0f1137a4/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:35:48.153606 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5bc1d-1599-4ab6-90e6-61dcd95aeb20 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:48.164574 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5bc1d-1599-4ab6-90e6-61dcd95aeb20 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:48.221477 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d281e89-a99f-4471-abe8-863aa67511ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:48.222149 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d281e89-a99f-4471-abe8-863aa67511ea admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:48.222436 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d281e89-a99f-4471-abe8-863aa67511ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:48.222717 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d281e89-a99f-4471-abe8-863aa67511ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:48.223447 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d281e89-a99f-4471-abe8-863aa67511ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:48.225646 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d281e89-a99f-4471-abe8-863aa67511ea admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:48.235653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1430/2858] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:35:48.239896 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d720a6-fef5-413a-affd-5dd294db00fb admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:48.251037 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d720a6-fef5-413a-affd-5dd294db00fb admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:48.255727 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215cfa6-e99b-4f27-b3d9-7b0d1156d84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:48.257335 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215cfa6-e99b-4f27-b3d9-7b0d1156d84d admin admin] REQUEST_METHOD: `PUT` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:48.257619 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215cfa6-e99b-4f27-b3d9-7b0d1156d84d admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:48.257898 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215cfa6-e99b-4f27-b3d9-7b0d1156d84d admin admin] PATH_INFO: `/v3/projects/66f0184545cd40b2ab4c36a50cbcf424/users/b7af3736ee9f4a7c834fabff0f1137a4/roles/106aa464a69a49b09de7de5417083d3c` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:48.259902 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215cfa6-e99b-4f27-b3d9-7b0d1156d84d admin admin] RBAC: Authorizing `identity:create_grant(project_id=66f0184545cd40b2ab4c36a50cbcf424, user_id=b7af3736ee9f4a7c834fabff0f1137a4, role_id=106aa464a69a49b09de7de5417083d3c)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:48.262581 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215cfa6-e99b-4f27-b3d9-7b0d1156d84d admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:48.273051 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1429/2859] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:35:48 2022] PUT /identity/v3/projects/66f0184545cd40b2ab4c36a50cbcf424/users/b7af3736ee9f4a7c834fabff0f1137a4/roles/106aa464a69a49b09de7de5417083d3c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:35:48.284267 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd78ac3-fcf3-4c4b-b1ea-664c818b1b9c None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:48.284563 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd78ac3-fcf3-4c4b-b1ea-664c818b1b9c None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:48.284873 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd78ac3-fcf3-4c4b-b1ea-664c818b1b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:48.311626 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-3bd78ac3-fcf3-4c4b-b1ea-664c818b1b9c None None] MFA Rules not processed for user `b7af3736ee9f4a7c834fabff0f1137a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:35:48.312867 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-3bd78ac3-fcf3-4c4b-b1ea-664c818b1b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:48.379295 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1431/2860] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:35:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:35:48.392751 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215cfa6-e99b-4f27-b3d9-7b0d1156d84d admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:48.394654 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-6215cfa6-e99b-4f27-b3d9-7b0d1156d84d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:48.451643 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215cfa6-e99b-4f27-b3d9-7b0d1156d84d admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:48.455218 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b34f9e-0db4-4905-b91f-bb22e6608876 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:48.455863 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b34f9e-0db4-4905-b91f-bb22e6608876 service cinder] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:48.456146 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b34f9e-0db4-4905-b91f-bb22e6608876 service cinder] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:48.456424 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b34f9e-0db4-4905-b91f-bb22e6608876 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:48.515424 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b34f9e-0db4-4905-b91f-bb22e6608876 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:48.517228 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b34f9e-0db4-4905-b91f-bb22e6608876 service cinder] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:48.526458 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1430/2861] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:35:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:35:53.689493 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd78ac3-fcf3-4c4b-b1ea-664c818b1b9c None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:53.690902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-3bd78ac3-fcf3-4c4b-b1ea-664c818b1b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:35:53.703546 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd78ac3-fcf3-4c4b-b1ea-664c818b1b9c None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:53.707126 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ee125-65de-4bfb-949c-8964f3d15f30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:53.707767 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ee125-65de-4bfb-949c-8964f3d15f30 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:53.708051 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ee125-65de-4bfb-949c-8964f3d15f30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:53.708331 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ee125-65de-4bfb-949c-8964f3d15f30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:53.717740 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ee125-65de-4bfb-949c-8964f3d15f30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:53.719205 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ee125-65de-4bfb-949c-8964f3d15f30 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:53.728761 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1432/2862] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:35:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:35:58.522842 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:INSERT=4,keystone:SELECT=65 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:59.609552 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b34f9e-0db4-4905-b91f-bb22e6608876 service cinder] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:35:59.671488 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b34f9e-0db4-4905-b91f-bb22e6608876 service cinder] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:35:59.676083 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2906669-3a74-4a7a-8aa0-0af2014e5eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:35:59.676987 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2906669-3a74-4a7a-8aa0-0af2014e5eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:35:59.677273 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2906669-3a74-4a7a-8aa0-0af2014e5eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:35:59.677552 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2906669-3a74-4a7a-8aa0-0af2014e5eab admin admin] PATH_INFO: `/v3/users/e2431051e28d447ca88ebbc4d7727bbb` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:35:59.678784 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2906669-3a74-4a7a-8aa0-0af2014e5eab admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2431051e28d447ca88ebbc4d7727bbb)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:35:59.680697 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2906669-3a74-4a7a-8aa0-0af2014e5eab admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:35:59.921237 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-a2906669-3a74-4a7a-8aa0-0af2014e5eab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2431051e28d447ca88ebbc4d7727bbb'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:35:59.921822 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-a2906669-3a74-4a7a-8aa0-0af2014e5eab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2431051e28d447ca88ebbc4d7727bbb'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:36:00.004350 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-a2906669-3a74-4a7a-8aa0-0af2014e5eab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2431051e28d447ca88ebbc4d7727bbb'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:36:00.017658 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-a2906669-3a74-4a7a-8aa0-0af2014e5eab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2431051e28d447ca88ebbc4d7727bbb'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:36:00.025076 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-a2906669-3a74-4a7a-8aa0-0af2014e5eab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2431051e28d447ca88ebbc4d7727bbb'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:36:00.031097 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1431/2863] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:35:59 2022] DELETE /identity/v3/users/e2431051e28d447ca88ebbc4d7727bbb => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:36:00.035902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db4f87-bfc3-4819-926b-fbd476c7e921 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:00.036377 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db4f87-bfc3-4819-926b-fbd476c7e921 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:00.036481 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db4f87-bfc3-4819-926b-fbd476c7e921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:00.054405 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-e7db4f87-bfc3-4819-926b-fbd476c7e921 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:36:00.055613 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-e7db4f87-bfc3-4819-926b-fbd476c7e921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:36:00.100224 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:36:00.115186 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1433/2864] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:36:00.124912 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2906669-3a74-4a7a-8aa0-0af2014e5eab admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:36:00.126338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-a2906669-3a74-4a7a-8aa0-0af2014e5eab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:36:00.183907 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2906669-3a74-4a7a-8aa0-0af2014e5eab admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:36:00.187533 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784176e0-fc51-4bc5-9f61-55904202c0df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:36:00.188184 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784176e0-fc51-4bc5-9f61-55904202c0df service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:00.188468 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784176e0-fc51-4bc5-9f61-55904202c0df service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:00.188747 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784176e0-fc51-4bc5-9f61-55904202c0df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:00.198451 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784176e0-fc51-4bc5-9f61-55904202c0df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:36:00.199880 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784176e0-fc51-4bc5-9f61-55904202c0df service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:36:00.209326 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1432/2865] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:36:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:36:00.606024 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db4f87-bfc3-4819-926b-fbd476c7e921 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:36:00.607832 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-e7db4f87-bfc3-4819-926b-fbd476c7e921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:36:00.621844 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db4f87-bfc3-4819-926b-fbd476c7e921 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:36:00.629094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c900cd-2f0f-4b35-b1ad-f4b21a7a21f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:36:00.629094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c900cd-2f0f-4b35-b1ad-f4b21a7a21f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:00.629094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c900cd-2f0f-4b35-b1ad-f4b21a7a21f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:00.629094 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c900cd-2f0f-4b35-b1ad-f4b21a7a21f4 admin admin] PATH_INFO: `/v3/projects/60c8a959249c42928c39b6a4688480f4` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:00.629533 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c900cd-2f0f-4b35-b1ad-f4b21a7a21f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60c8a959249c42928c39b6a4688480f4)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:36:00.631246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c900cd-2f0f-4b35-b1ad-f4b21a7a21f4 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:36:00.772673 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-49c900cd-2f0f-4b35-b1ad-f4b21a7a21f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60c8a959249c42928c39b6a4688480f4', 'request_id': 'req-49c900cd-2f0f-4b35-b1ad-f4b21a7a21f4'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:36:00.779772 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-49c900cd-2f0f-4b35-b1ad-f4b21a7a21f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60c8a959249c42928c39b6a4688480f4', 'request_id': 'req-49c900cd-2f0f-4b35-b1ad-f4b21a7a21f4'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:36:00.861399 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-49c900cd-2f0f-4b35-b1ad-f4b21a7a21f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60c8a959249c42928c39b6a4688480f4', 'request_id': 'req-49c900cd-2f0f-4b35-b1ad-f4b21a7a21f4'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:36:00.872272 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-49c900cd-2f0f-4b35-b1ad-f4b21a7a21f4 admin admin] The token cache is being invalidate because project 60c8a959249c42928c39b6a4688480f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:36:00.872559 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-49c900cd-2f0f-4b35-b1ad-f4b21a7a21f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:36:00.873241 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-49c900cd-2f0f-4b35-b1ad-f4b21a7a21f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:36:00.874790 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1434/2866] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:36:00 2022] DELETE /identity/v3/projects/60c8a959249c42928c39b6a4688480f4 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:36:00.878878 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784176e0-fc51-4bc5-9f61-55904202c0df service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:36:00.889125 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784176e0-fc51-4bc5-9f61-55904202c0df service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:36:00.908116 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:36:00.945663 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e91f6f-38ac-49a3-adce-777255588d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:36:00.946805 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e91f6f-38ac-49a3-adce-777255588d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:00.947248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e91f6f-38ac-49a3-adce-777255588d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:00.947880 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e91f6f-38ac-49a3-adce-777255588d57 admin admin] PATH_INFO: `/v3/users/b7af3736ee9f4a7c834fabff0f1137a4` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:00.949151 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e91f6f-38ac-49a3-adce-777255588d57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7af3736ee9f4a7c834fabff0f1137a4)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:36:00.951067 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e91f6f-38ac-49a3-adce-777255588d57 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:36:01.124848 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-c2e91f6f-38ac-49a3-adce-777255588d57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7af3736ee9f4a7c834fabff0f1137a4'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:36:01.125493 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-c2e91f6f-38ac-49a3-adce-777255588d57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7af3736ee9f4a7c834fabff0f1137a4'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:36:01.238630 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-c2e91f6f-38ac-49a3-adce-777255588d57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7af3736ee9f4a7c834fabff0f1137a4'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:36:01.251628 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-c2e91f6f-38ac-49a3-adce-777255588d57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7af3736ee9f4a7c834fabff0f1137a4'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:36:01.258555 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-c2e91f6f-38ac-49a3-adce-777255588d57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7af3736ee9f4a7c834fabff0f1137a4'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:36:01.264474 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1433/2867] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:36:00 2022] DELETE /identity/v3/users/b7af3736ee9f4a7c834fabff0f1137a4 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:36:01.673530 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c900cd-2f0f-4b35-b1ad-f4b21a7a21f4 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:36:01.675064 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-49c900cd-2f0f-4b35-b1ad-f4b21a7a21f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:36:01.692615 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c900cd-2f0f-4b35-b1ad-f4b21a7a21f4 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:36:01.746091 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97653cc-c7e0-4b18-867c-fea10803d22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:36:01.746952 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97653cc-c7e0-4b18-867c-fea10803d22d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:01.747233 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97653cc-c7e0-4b18-867c-fea10803d22d admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:01.747508 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97653cc-c7e0-4b18-867c-fea10803d22d admin admin] PATH_INFO: `/v3/projects/66f0184545cd40b2ab4c36a50cbcf424` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:01.748704 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97653cc-c7e0-4b18-867c-fea10803d22d admin admin] RBAC: Authorizing `identity:delete_project(project_id=66f0184545cd40b2ab4c36a50cbcf424)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:36:01.750643 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97653cc-c7e0-4b18-867c-fea10803d22d admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:36:01.890222 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e97653cc-c7e0-4b18-867c-fea10803d22d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66f0184545cd40b2ab4c36a50cbcf424', 'request_id': 'req-e97653cc-c7e0-4b18-867c-fea10803d22d'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:36:01.896470 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e97653cc-c7e0-4b18-867c-fea10803d22d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66f0184545cd40b2ab4c36a50cbcf424', 'request_id': 'req-e97653cc-c7e0-4b18-867c-fea10803d22d'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:36:02.032653 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e97653cc-c7e0-4b18-867c-fea10803d22d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66f0184545cd40b2ab4c36a50cbcf424', 'request_id': 'req-e97653cc-c7e0-4b18-867c-fea10803d22d'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:36:02.044619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e97653cc-c7e0-4b18-867c-fea10803d22d admin admin] The token cache is being invalidate because project 66f0184545cd40b2ab4c36a50cbcf424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:36:02.044966 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e97653cc-c7e0-4b18-867c-fea10803d22d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:36:02.052203 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-e97653cc-c7e0-4b18-867c-fea10803d22d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:36:02.052203 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1435/2868] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:36:01 2022] DELETE /identity/v3/projects/66f0184545cd40b2ab4c36a50cbcf424 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:36:02.054012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbc6b8-9e2e-47cc-8a98-cb71daaa8b0c None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:02.054485 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbc6b8-9e2e-47cc-8a98-cb71daaa8b0c None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:02.054603 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbc6b8-9e2e-47cc-8a98-cb71daaa8b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:02.072090 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-90fbc6b8-9e2e-47cc-8a98-cb71daaa8b0c None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:36:02.073317 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-90fbc6b8-9e2e-47cc-8a98-cb71daaa8b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:36:02.134718 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1434/2869] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:36:02.143386 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc34bd-397b-4f22-b915-19c9a8df154e None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:02.143672 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc34bd-397b-4f22-b915-19c9a8df154e None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:02.143948 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc34bd-397b-4f22-b915-19c9a8df154e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:02.150310 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:36:02.163500 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-15fc34bd-397b-4f22-b915-19c9a8df154e None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:36:02.168898 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-15fc34bd-397b-4f22-b915-19c9a8df154e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:36:02.172874 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1436/2870] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:36:02.177248 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fbc6b8-9e2e-47cc-8a98-cb71daaa8b0c None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:36:02.187768 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fbc6b8-9e2e-47cc-8a98-cb71daaa8b0c None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:36:02.192383 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735d6fe-337f-41b1-ab32-d4e4cc808072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:36:02.193139 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735d6fe-337f-41b1-ab32-d4e4cc808072 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:02.193444 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735d6fe-337f-41b1-ab32-d4e4cc808072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:02.193706 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735d6fe-337f-41b1-ab32-d4e4cc808072 admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:02.194437 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735d6fe-337f-41b1-ab32-d4e4cc808072 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:36:02.194748 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735d6fe-337f-41b1-ab32-d4e4cc808072 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:36:02.196347 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735d6fe-337f-41b1-ab32-d4e4cc808072 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:36:02.208188 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1435/2871] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:36:02.213365 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc34bd-397b-4f22-b915-19c9a8df154e None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:36:02.222514 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc34bd-397b-4f22-b915-19c9a8df154e None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:36:02.227743 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55a518-403e-4d4e-84c8-8f64a0781ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:36:02.228387 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55a518-403e-4d4e-84c8-8f64a0781ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:02.228669 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55a518-403e-4d4e-84c8-8f64a0781ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:02.228981 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55a518-403e-4d4e-84c8-8f64a0781ba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:02.229670 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb55a518-403e-4d4e-84c8-8f64a0781ba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:36:02.231577 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb55a518-403e-4d4e-84c8-8f64a0781ba9 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:36:02.360090 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1437/2872] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:36:02 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:36:02.364217 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735d6fe-337f-41b1-ab32-d4e4cc808072 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:36:02.374334 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735d6fe-337f-41b1-ab32-d4e4cc808072 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:36:02.401706 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:36:02.433966 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547844f-3962-49f0-b499-e415aebee853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:36:02.434638 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547844f-3962-49f0-b499-e415aebee853 admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:02.434924 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547844f-3962-49f0-b499-e415aebee853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:02.435204 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547844f-3962-49f0-b499-e415aebee853 admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:02.435912 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547844f-3962-49f0-b499-e415aebee853 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:36:02.437862 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547844f-3962-49f0-b499-e415aebee853 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:36:02.541567 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1436/2873] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:36:02 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:36:02.546003 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55a518-403e-4d4e-84c8-8f64a0781ba9 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:36:02.557123 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55a518-403e-4d4e-84c8-8f64a0781ba9 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:36:02.561857 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8d1e1-21bb-469b-a1c6-01999507a815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:36:02.562534 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8d1e1-21bb-469b-a1c6-01999507a815 admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:02.562823 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8d1e1-21bb-469b-a1c6-01999507a815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:02.563101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8d1e1-21bb-469b-a1c6-01999507a815 admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:02.563844 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8d1e1-21bb-469b-a1c6-01999507a815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:36:02.565507 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8d1e1-21bb-469b-a1c6-01999507a815 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:36:02.576574 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1438/2874] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:36:02.581012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547844f-3962-49f0-b499-e415aebee853 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:36:02.590916 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547844f-3962-49f0-b499-e415aebee853 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:36:02.596281 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282e6ec-3cfb-4765-9906-fa45d2f1ec50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:36:02.597004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282e6ec-3cfb-4765-9906-fa45d2f1ec50 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:02.597291 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282e6ec-3cfb-4765-9906-fa45d2f1ec50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:02.597573 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282e6ec-3cfb-4765-9906-fa45d2f1ec50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:02.598301 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282e6ec-3cfb-4765-9906-fa45d2f1ec50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:36:02.599896 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282e6ec-3cfb-4765-9906-fa45d2f1ec50 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:36:02.610052 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1437/2875] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:36:02.614185 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8d1e1-21bb-469b-a1c6-01999507a815 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:36:02.624558 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8d1e1-21bb-469b-a1c6-01999507a815 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:36:02.629187 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1483109b-782b-433b-9638-ffe11fd979e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:36:02.630056 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483109b-782b-433b-9638-ffe11fd979e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:02.630332 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483109b-782b-433b-9638-ffe11fd979e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:02.630606 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483109b-782b-433b-9638-ffe11fd979e4 admin admin] PATH_INFO: `/v3/projects/96d2dd96c66a43b5a09d65b7ef9b340e/users/716ddc279d4d4fef8f8efbcdeca72c47/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:02.645855 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1483109b-782b-433b-9638-ffe11fd979e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96d2dd96c66a43b5a09d65b7ef9b340e, user_id=716ddc279d4d4fef8f8efbcdeca72c47, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:36:02.648651 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1483109b-782b-433b-9638-ffe11fd979e4 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:36:02.714109 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1439/2876] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:36:02 2022] PUT /identity/v3/projects/96d2dd96c66a43b5a09d65b7ef9b340e/users/716ddc279d4d4fef8f8efbcdeca72c47/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:36:02.727321 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0daeb-9212-462e-9dc7-3aa85488163c None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:02.727633 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0daeb-9212-462e-9dc7-3aa85488163c None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:02.727915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0daeb-9212-462e-9dc7-3aa85488163c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:02.754546 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-09c0daeb-9212-462e-9dc7-3aa85488163c None None] MFA Rules not processed for user `716ddc279d4d4fef8f8efbcdeca72c47`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:36:02.755765 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-09c0daeb-9212-462e-9dc7-3aa85488163c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:36:02.829603 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1438/2877] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:36:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:36:02.847222 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1483109b-782b-433b-9638-ffe11fd979e4 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:36:02.850526 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-1483109b-782b-433b-9638-ffe11fd979e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:36:02.938360 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1483109b-782b-433b-9638-ffe11fd979e4 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:36:02.942198 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da60ef-b493-4754-8610-3b9983f1eecd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a4fbf9b051940bd82547a700796d118', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:36:02.942852 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da60ef-b493-4754-8610-3b9983f1eecd service glance] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:02.943139 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da60ef-b493-4754-8610-3b9983f1eecd service glance] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:02.943418 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da60ef-b493-4754-8610-3b9983f1eecd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:02.956353 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da60ef-b493-4754-8610-3b9983f1eecd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:36:02.957888 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da60ef-b493-4754-8610-3b9983f1eecd service glance] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:36:02.967326 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1440/2878] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:36:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:36:12.822883 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=53,keystone:INSERT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:36:12.962982 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=61,keystone:INSERT=2 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:36:35.547148 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0daeb-9212-462e-9dc7-3aa85488163c None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:36:35.608121 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0daeb-9212-462e-9dc7-3aa85488163c None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:36:35.612668 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8da38-71e4-48db-9e81-adfc19a2849c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:36:35.613566 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8da38-71e4-48db-9e81-adfc19a2849c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:35.613846 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8da38-71e4-48db-9e81-adfc19a2849c admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:35.614120 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8da38-71e4-48db-9e81-adfc19a2849c admin admin] PATH_INFO: `/v3/users/716ddc279d4d4fef8f8efbcdeca72c47` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:35.615347 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8da38-71e4-48db-9e81-adfc19a2849c admin admin] RBAC: Authorizing `identity:delete_user(user_id=716ddc279d4d4fef8f8efbcdeca72c47)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:36:35.617341 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8da38-71e4-48db-9e81-adfc19a2849c admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:36:35.897986 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-c9d8da38-71e4-48db-9e81-adfc19a2849c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '716ddc279d4d4fef8f8efbcdeca72c47'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:36:35.898740 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-c9d8da38-71e4-48db-9e81-adfc19a2849c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '716ddc279d4d4fef8f8efbcdeca72c47'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:36:36.048886 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-c9d8da38-71e4-48db-9e81-adfc19a2849c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '716ddc279d4d4fef8f8efbcdeca72c47'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:36:36.062732 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-c9d8da38-71e4-48db-9e81-adfc19a2849c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '716ddc279d4d4fef8f8efbcdeca72c47'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:36:36.069934 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-c9d8da38-71e4-48db-9e81-adfc19a2849c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '716ddc279d4d4fef8f8efbcdeca72c47'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:36:36.076121 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1439/2879] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:36:35 2022] DELETE /identity/v3/users/716ddc279d4d4fef8f8efbcdeca72c47 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:36:36.080575 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eeee7a-81b4-41ad-90c8-6768422b357a None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:36.081098 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eeee7a-81b4-41ad-90c8-6768422b357a None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:36.081212 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eeee7a-81b4-41ad-90c8-6768422b357a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:36.099291 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-21eeee7a-81b4-41ad-90c8-6768422b357a None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:36:36.110250 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-21eeee7a-81b4-41ad-90c8-6768422b357a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:36:36.161896 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1441/2880] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:36:36.172223 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8da38-71e4-48db-9e81-adfc19a2849c admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:36:36.173716 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-c9d8da38-71e4-48db-9e81-adfc19a2849c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:36:36.241338 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8da38-71e4-48db-9e81-adfc19a2849c admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:36:36.245044 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c12c0-7354-41ba-a2fe-416e3cf8b730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:36:36.245706 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c12c0-7354-41ba-a2fe-416e3cf8b730 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:36.245993 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c12c0-7354-41ba-a2fe-416e3cf8b730 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:36.246274 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c12c0-7354-41ba-a2fe-416e3cf8b730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:36.255952 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c12c0-7354-41ba-a2fe-416e3cf8b730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:36:36.257971 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c12c0-7354-41ba-a2fe-416e3cf8b730 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:36:36.267782 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1440/2881] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:36:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:36:36.684215 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eeee7a-81b4-41ad-90c8-6768422b357a None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:36:36.685827 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-21eeee7a-81b4-41ad-90c8-6768422b357a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:36:36.700160 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eeee7a-81b4-41ad-90c8-6768422b357a None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:36:36.704988 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe524a5-298a-4126-bb14-ee04176e8ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:36:36.705886 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe524a5-298a-4126-bb14-ee04176e8ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:36.706172 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe524a5-298a-4126-bb14-ee04176e8ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:36.706452 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe524a5-298a-4126-bb14-ee04176e8ee6 admin admin] PATH_INFO: `/v3/projects/96d2dd96c66a43b5a09d65b7ef9b340e` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:36.707670 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe524a5-298a-4126-bb14-ee04176e8ee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96d2dd96c66a43b5a09d65b7ef9b340e)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:36:36.710209 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe524a5-298a-4126-bb14-ee04176e8ee6 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:36:36.814513 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-dbe524a5-298a-4126-bb14-ee04176e8ee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96d2dd96c66a43b5a09d65b7ef9b340e', 'request_id': 'req-dbe524a5-298a-4126-bb14-ee04176e8ee6'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:36:36.821297 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-dbe524a5-298a-4126-bb14-ee04176e8ee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96d2dd96c66a43b5a09d65b7ef9b340e', 'request_id': 'req-dbe524a5-298a-4126-bb14-ee04176e8ee6'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:36:36.905791 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-dbe524a5-298a-4126-bb14-ee04176e8ee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96d2dd96c66a43b5a09d65b7ef9b340e', 'request_id': 'req-dbe524a5-298a-4126-bb14-ee04176e8ee6'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:36:36.916769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-dbe524a5-298a-4126-bb14-ee04176e8ee6 admin admin] The token cache is being invalidate because project 96d2dd96c66a43b5a09d65b7ef9b340e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:36:36.917103 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-dbe524a5-298a-4126-bb14-ee04176e8ee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:36:36.917733 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-dbe524a5-298a-4126-bb14-ee04176e8ee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:36:36.919422 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1442/2882] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:36:36 2022] DELETE /identity/v3/projects/96d2dd96c66a43b5a09d65b7ef9b340e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:36:36.924721 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f51f0-9c84-4773-b219-285745387e7d None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:36.925313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f51f0-9c84-4773-b219-285745387e7d None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:36.925313 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f51f0-9c84-4773-b219-285745387e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:36.943153 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-808f51f0-9c84-4773-b219-285745387e7d None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:36:36.944869 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-808f51f0-9c84-4773-b219-285745387e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:36:36.961432 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:36:37.003244 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1441/2883] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:36:37.011218 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e00aa-2453-4285-af51-d69b669eff17 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:37.011527 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e00aa-2453-4285-af51-d69b669eff17 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:37.011852 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e00aa-2453-4285-af51-d69b669eff17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:37.030842 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-1c5e00aa-2453-4285-af51-d69b669eff17 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:36:37.032051 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-1c5e00aa-2453-4285-af51-d69b669eff17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:36:37.041002 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1443/2884] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:36:37.045793 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f51f0-9c84-4773-b219-285745387e7d None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:36:37.055710 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f51f0-9c84-4773-b219-285745387e7d None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:36:37.060408 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6070a5-10f9-443e-82a3-f1a26ebff020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:36:37.065639 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6070a5-10f9-443e-82a3-f1a26ebff020 admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:37.065639 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6070a5-10f9-443e-82a3-f1a26ebff020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:37.065639 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6070a5-10f9-443e-82a3-f1a26ebff020 admin admin] PATH_INFO: `/v3/domains` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:37.065639 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6070a5-10f9-443e-82a3-f1a26ebff020 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:36:37.065639 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6070a5-10f9-443e-82a3-f1a26ebff020 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:36:37.065639 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6070a5-10f9-443e-82a3-f1a26ebff020 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:36:37.080223 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1442/2885] 10.222.0.46 () {58 vars in 1152 bytes} [Wed Jun 22 10:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:36:37.085441 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e00aa-2453-4285-af51-d69b669eff17 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:36:37.095064 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e00aa-2453-4285-af51-d69b669eff17 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:36:37.100705 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443936dd-31e2-45de-86f0-9752616eef54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:36:37.101417 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443936dd-31e2-45de-86f0-9752616eef54 admin admin] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:37.101700 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443936dd-31e2-45de-86f0-9752616eef54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:37.101975 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443936dd-31e2-45de-86f0-9752616eef54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:37.102668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443936dd-31e2-45de-86f0-9752616eef54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:36:37.104603 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443936dd-31e2-45de-86f0-9752616eef54 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:36:37.192489 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1444/2886] 10.222.0.46 () {60 vars in 1152 bytes} [Wed Jun 22 10:36:37 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:36:37.202955 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6070a5-10f9-443e-82a3-f1a26ebff020 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:36:37.207399 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6070a5-10f9-443e-82a3-f1a26ebff020 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:36:37.264068 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4f87c-8e6f-40ed-b22a-80d4c5060e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:36:37.264744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4f87c-8e6f-40ed-b22a-80d4c5060e0d admin admin] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:37.265060 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4f87c-8e6f-40ed-b22a-80d4c5060e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:37.265393 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4f87c-8e6f-40ed-b22a-80d4c5060e0d admin admin] PATH_INFO: `/v3/users` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:37.266090 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4f87c-8e6f-40ed-b22a-80d4c5060e0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:36:37.267991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4f87c-8e6f-40ed-b22a-80d4c5060e0d admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:36:37.339038 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1443/2887] 10.222.0.46 () {60 vars in 1143 bytes} [Wed Jun 22 10:36:37 2022] POST /identity/v3/users => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:36:37.343296 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443936dd-31e2-45de-86f0-9752616eef54 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:36:37.354410 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443936dd-31e2-45de-86f0-9752616eef54 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:36:37.359024 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1666d2-1623-4fb1-a305-9f921260161f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:36:37.363495 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1666d2-1623-4fb1-a305-9f921260161f admin admin] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:37.363495 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1666d2-1623-4fb1-a305-9f921260161f admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:37.363495 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1666d2-1623-4fb1-a305-9f921260161f admin admin] PATH_INFO: `/v3/roles` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:37.363495 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1666d2-1623-4fb1-a305-9f921260161f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:36:37.363495 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1666d2-1623-4fb1-a305-9f921260161f admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:36:37.373330 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1445/2888] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:36:37.377397 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4f87c-8e6f-40ed-b22a-80d4c5060e0d admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:36:37.387743 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4f87c-8e6f-40ed-b22a-80d4c5060e0d admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:36:37.392746 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41863226-81f5-481d-8e52-1702c84cc5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:36:37.393450 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41863226-81f5-481d-8e52-1702c84cc5ce admin admin] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:37.393739 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41863226-81f5-481d-8e52-1702c84cc5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:37.394023 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41863226-81f5-481d-8e52-1702c84cc5ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:37.394757 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41863226-81f5-481d-8e52-1702c84cc5ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:36:37.396359 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41863226-81f5-481d-8e52-1702c84cc5ce admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:36:37.407232 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1444/2889] 10.222.0.46 () {58 vars in 1121 bytes} [Wed Jun 22 10:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:36:37.411503 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1666d2-1623-4fb1-a305-9f921260161f admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:36:37.422177 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1666d2-1623-4fb1-a305-9f921260161f admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:36:37.426813 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848b36e-afd1-4989-9f2b-549decabbcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:36:37.427686 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848b36e-afd1-4989-9f2b-549decabbcd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:37.427971 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848b36e-afd1-4989-9f2b-549decabbcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:37.428912 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848b36e-afd1-4989-9f2b-549decabbcd0 admin admin] PATH_INFO: `/v3/projects/95ce4ff3b62f4bc0a7afc77dde603bd0/users/f67a7d7265ee4d4b84099a88cf9edfbd/roles/b8f82737ef614907a0d320c6e1f2facf` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:37.445956 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848b36e-afd1-4989-9f2b-549decabbcd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95ce4ff3b62f4bc0a7afc77dde603bd0, user_id=f67a7d7265ee4d4b84099a88cf9edfbd, role_id=b8f82737ef614907a0d320c6e1f2facf)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:36:37.448621 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848b36e-afd1-4989-9f2b-549decabbcd0 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:36:37.534148 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1446/2890] 10.222.0.46 () {60 vars in 1482 bytes} [Wed Jun 22 10:36:37 2022] PUT /identity/v3/projects/95ce4ff3b62f4bc0a7afc77dde603bd0/users/f67a7d7265ee4d4b84099a88cf9edfbd/roles/b8f82737ef614907a0d320c6e1f2facf => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:36:37.544961 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f8f22-6b3b-4e27-ac2e-e1405fe0d921 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:37.545249 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f8f22-6b3b-4e27-ac2e-e1405fe0d921 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:37.545526 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f8f22-6b3b-4e27-ac2e-e1405fe0d921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:37.572396 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-077f8f22-6b3b-4e27-ac2e-e1405fe0d921 None None] MFA Rules not processed for user `f67a7d7265ee4d4b84099a88cf9edfbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:36:37.573639 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-077f8f22-6b3b-4e27-ac2e-e1405fe0d921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:36:37.637686 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1445/2891] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:36:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:36:37.649346 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848b36e-afd1-4989-9f2b-549decabbcd0 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:36:37.651093 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-d848b36e-afd1-4989-9f2b-549decabbcd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:36:37.665501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:36:37.710411 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848b36e-afd1-4989-9f2b-549decabbcd0 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:36:37.714065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35526fcd-38ad-431e-9c8d-46ea23b72aa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eea844b342b418895d08eef368bbd24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:36:37.714710 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35526fcd-38ad-431e-9c8d-46ea23b72aa1 service cinder] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:37.714990 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35526fcd-38ad-431e-9c8d-46ea23b72aa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:37.715263 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35526fcd-38ad-431e-9c8d-46ea23b72aa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:37.723620 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35526fcd-38ad-431e-9c8d-46ea23b72aa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:36:37.725071 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35526fcd-38ad-431e-9c8d-46ea23b72aa1 service cinder] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:36:37.734425 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1447/2892] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:36:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:36:39.562369 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c70fa4-f514-43ae-981a-9e694322e182 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:39.562883 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c70fa4-f514-43ae-981a-9e694322e182 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:39.563589 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c70fa4-f514-43ae-981a-9e694322e182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:39.580933 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-64c70fa4-f514-43ae-981a-9e694322e182 None None] MFA Rules not processed for user `f67a7d7265ee4d4b84099a88cf9edfbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:36:39.582131 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-64c70fa4-f514-43ae-981a-9e694322e182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:36:39.590178 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1446/2893] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:36:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:36:40.208246 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35526fcd-38ad-431e-9c8d-46ea23b72aa1 service cinder] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:36:40.209786 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-35526fcd-38ad-431e-9c8d-46ea23b72aa1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:36:40.288501 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35526fcd-38ad-431e-9c8d-46ea23b72aa1 service cinder] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:36:40.293521 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1e8c9-2234-4b76-a178-416273b1e06e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '675892a676054b4f86f9ac12d95f4f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:36:40.294168 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1e8c9-2234-4b76-a178-416273b1e06e service placement] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:40.294450 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1e8c9-2234-4b76-a178-416273b1e06e service placement] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:40.294724 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1e8c9-2234-4b76-a178-416273b1e06e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:40.296515 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-73c1e8c9-2234-4b76-a178-416273b1e06e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:36:40.309548 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1e8c9-2234-4b76-a178-416273b1e06e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:36:40.311171 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1e8c9-2234-4b76-a178-416273b1e06e service placement] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:36:40.321606 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1448/2894] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:36:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:36:40.785084 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c70fa4-f514-43ae-981a-9e694322e182 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:36:40.786583 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-64c70fa4-f514-43ae-981a-9e694322e182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:36:40.801422 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c70fa4-f514-43ae-981a-9e694322e182 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:36:40.807079 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfa7d5-05e6-42fa-a059-a5903ba72054 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '675892a676054b4f86f9ac12d95f4f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:36:40.807783 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfa7d5-05e6-42fa-a059-a5903ba72054 service placement] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:40.808061 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfa7d5-05e6-42fa-a059-a5903ba72054 service placement] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:40.808632 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfa7d5-05e6-42fa-a059-a5903ba72054 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:40.810138 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-a5bfa7d5-05e6-42fa-a059-a5903ba72054 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:36:40.824012 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bfa7d5-05e6-42fa-a059-a5903ba72054 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:36:40.825683 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bfa7d5-05e6-42fa-a059-a5903ba72054 service placement] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:36:40.830151 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:36:40.837450 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1447/2895] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:36:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:36:50.317133 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=53 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:36:51.229279 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:36:52.147306 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1e8c9-2234-4b76-a178-416273b1e06e service placement] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:36:52.150499 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-73c1e8c9-2234-4b76-a178-416273b1e06e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:36:52.222746 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1e8c9-2234-4b76-a178-416273b1e06e service placement] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:36:52.229647 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da59d9-090b-4dbf-b97b-4fb62be8882a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ed9a00723ab4af2b633ab7614d178a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:36:52.230408 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da59d9-090b-4dbf-b97b-4fb62be8882a service nova] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:52.230666 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da59d9-090b-4dbf-b97b-4fb62be8882a service nova] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:52.230947 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da59d9-090b-4dbf-b97b-4fb62be8882a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:52.232767 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-95da59d9-090b-4dbf-b97b-4fb62be8882a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:36:52.246075 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da59d9-090b-4dbf-b97b-4fb62be8882a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:36:52.247732 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da59d9-090b-4dbf-b97b-4fb62be8882a service nova] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:36:52.259255 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1449/2896] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:36:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:36:59.475702 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325feb8b-8eab-4330-ae40-443e1ef9768b None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:59.476207 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325feb8b-8eab-4330-ae40-443e1ef9768b None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:59.476340 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325feb8b-8eab-4330-ae40-443e1ef9768b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:59.534814 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-325feb8b-8eab-4330-ae40-443e1ef9768b None None] MFA Rules not processed for user `7b4d3b1fe8064cc592d89e7bab91bace`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:36:59.535942 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-325feb8b-8eab-4330-ae40-443e1ef9768b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:36:59.603088 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1448/2897] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Jun 22 10:36:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:36:59.754269 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da59d9-090b-4dbf-b97b-4fb62be8882a service nova] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:36:59.755730 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-95da59d9-090b-4dbf-b97b-4fb62be8882a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:36:59.847442 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da59d9-090b-4dbf-b97b-4fb62be8882a service nova] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:36:59.852590 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e90b50-c0da-4173-9bbf-770d2d8c9dc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c724063ce51470ca09c5c5ab231fd9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:36:59.853314 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e90b50-c0da-4173-9bbf-770d2d8c9dc4 service swift] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:36:59.853600 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e90b50-c0da-4173-9bbf-770d2d8c9dc4 service swift] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:36:59.853885 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e90b50-c0da-4173-9bbf-770d2d8c9dc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:36:59.862324 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e90b50-c0da-4173-9bbf-770d2d8c9dc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:36:59.863969 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e90b50-c0da-4173-9bbf-770d2d8c9dc4 service swift] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:36:59.872524 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1450/2898] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 22 10:36:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:37:00.744523 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e2982-dc85-4a37-836b-f2ee7a4601f4 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:00.745076 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e2982-dc85-4a37-836b-f2ee7a4601f4 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:00.749831 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e2982-dc85-4a37-836b-f2ee7a4601f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:00.772758 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-570e2982-dc85-4a37-836b-f2ee7a4601f4 None None] MFA Rules not processed for user `7b4d3b1fe8064cc592d89e7bab91bace`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:37:00.774602 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-570e2982-dc85-4a37-836b-f2ee7a4601f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:37:00.781952 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1449/2899] 10.222.0.46 () {58 vars in 967 bytes} [Wed Jun 22 10:37:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:37:00.794523 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e90b50-c0da-4173-9bbf-770d2d8c9dc4 service swift] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:37:00.805976 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e90b50-c0da-4173-9bbf-770d2d8c9dc4 service swift] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:37:00.811865 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76507c-5b08-423b-b6a1-d982bcecf94d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c724063ce51470ca09c5c5ab231fd9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:37:00.814469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76507c-5b08-423b-b6a1-d982bcecf94d service swift] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:00.814469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76507c-5b08-423b-b6a1-d982bcecf94d service swift] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:00.814469 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76507c-5b08-423b-b6a1-d982bcecf94d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:00.823031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76507c-5b08-423b-b6a1-d982bcecf94d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:37:00.824717 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c76507c-5b08-423b-b6a1-d982bcecf94d service swift] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:37:00.833826 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1451/2900] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 22 10:37:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:37:01.439535 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb70b7-b7ea-4e52-8ae1-7d29a69167bc None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:01.439824 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb70b7-b7ea-4e52-8ae1-7d29a69167bc None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:01.440105 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb70b7-b7ea-4e52-8ae1-7d29a69167bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:01.457684 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-e9fb70b7-b7ea-4e52-8ae1-7d29a69167bc None None] MFA Rules not processed for user `7b4d3b1fe8064cc592d89e7bab91bace`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:37:01.458900 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-e9fb70b7-b7ea-4e52-8ae1-7d29a69167bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:37:01.466190 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1450/2901] 10.222.0.46 () {58 vars in 1009 bytes} [Wed Jun 22 10:37:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:37:01.478356 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76507c-5b08-423b-b6a1-d982bcecf94d service swift] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:37:01.488976 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76507c-5b08-423b-b6a1-d982bcecf94d service swift] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:37:01.496368 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b6c47-ff4b-4074-b041-bdf6cbfde0f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c724063ce51470ca09c5c5ab231fd9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:37:01.497055 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b6c47-ff4b-4074-b041-bdf6cbfde0f3 service swift] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:01.497343 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b6c47-ff4b-4074-b041-bdf6cbfde0f3 service swift] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:01.497623 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b6c47-ff4b-4074-b041-bdf6cbfde0f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:01.506101 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b6c47-ff4b-4074-b041-bdf6cbfde0f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:37:01.507669 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b6c47-ff4b-4074-b041-bdf6cbfde0f3 service swift] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:37:01.515954 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1452/2902] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 22 10:37:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:37:02.128315 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c32d3-2621-43f3-9e79-3ca029cb7270 None None] REQUEST_METHOD: `POST` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:02.128789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c32d3-2621-43f3-9e79-3ca029cb7270 None None] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:02.128916 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c32d3-2621-43f3-9e79-3ca029cb7270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:02.147039 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.auth.core [None req-f76c32d3-2621-43f3-9e79-3ca029cb7270 None None] MFA Rules not processed for user `7b4d3b1fe8064cc592d89e7bab91bace`. Rule list: `[]` (Enabled: `True`). {{(pid=80500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:37:02.148242 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-f76c32d3-2621-43f3-9e79-3ca029cb7270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:37:02.156022 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1451/2903] 10.222.0.46 () {58 vars in 967 bytes} [Wed Jun 22 10:37:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:37:02.168065 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b6c47-ff4b-4074-b041-bdf6cbfde0f3 service swift] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:37:02.178950 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b6c47-ff4b-4074-b041-bdf6cbfde0f3 service swift] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:37:02.184220 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549661c9-dd85-4b4e-b124-ab4bc53f51d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c724063ce51470ca09c5c5ab231fd9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:37:02.184897 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549661c9-dd85-4b4e-b124-ab4bc53f51d3 service swift] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:02.185185 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549661c9-dd85-4b4e-b124-ab4bc53f51d3 service swift] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:02.185461 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549661c9-dd85-4b4e-b124-ab4bc53f51d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:02.193930 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549661c9-dd85-4b4e-b124-ab4bc53f51d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:37:02.196031 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549661c9-dd85-4b4e-b124-ab4bc53f51d3 service swift] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:37:02.204348 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1453/2904] 10.222.0.46 () {60 vars in 1384 bytes} [Wed Jun 22 10:37:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 10:37:04.824941 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c32d3-2621-43f3-9e79-3ca029cb7270 None None] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:37:04.890188 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c32d3-2621-43f3-9e79-3ca029cb7270 None None] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:37:04.894770 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb0c39-4476-4863-8712-15f746e4c894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:37:04.895898 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb0c39-4476-4863-8712-15f746e4c894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:04.896184 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb0c39-4476-4863-8712-15f746e4c894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:04.896463 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb0c39-4476-4863-8712-15f746e4c894 admin admin] PATH_INFO: `/v3/users/f67a7d7265ee4d4b84099a88cf9edfbd` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:04.897744 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb0c39-4476-4863-8712-15f746e4c894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f67a7d7265ee4d4b84099a88cf9edfbd)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:37:04.899775 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb0c39-4476-4863-8712-15f746e4c894 admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:37:05.186939 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:37:05.188481 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-19bb0c39-4476-4863-8712-15f746e4c894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f67a7d7265ee4d4b84099a88cf9edfbd'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:05.189199 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-19bb0c39-4476-4863-8712-15f746e4c894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f67a7d7265ee4d4b84099a88cf9edfbd'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:05.265156 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-19bb0c39-4476-4863-8712-15f746e4c894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f67a7d7265ee4d4b84099a88cf9edfbd'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:05.278261 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-19bb0c39-4476-4863-8712-15f746e4c894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f67a7d7265ee4d4b84099a88cf9edfbd'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:05.285060 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-19bb0c39-4476-4863-8712-15f746e4c894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f67a7d7265ee4d4b84099a88cf9edfbd'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:05.291681 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1452/2905] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:37:04 2022] DELETE /identity/v3/users/f67a7d7265ee4d4b84099a88cf9edfbd => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:37:05.298152 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a0d8e-9f38-47ae-8b24-d8db2d81ca65 None None] REQUEST_METHOD: `POST` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:05.298733 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a0d8e-9f38-47ae-8b24-d8db2d81ca65 None None] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:05.298733 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a0d8e-9f38-47ae-8b24-d8db2d81ca65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:05.322848 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.auth.core [None req-fe8a0d8e-9f38-47ae-8b24-d8db2d81ca65 None None] MFA Rules not processed for user `af7691de913843509188548c36ece976`. Rule list: `[]` (Enabled: `True`). {{(pid=80499) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:37:05.324083 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-fe8a0d8e-9f38-47ae-8b24-d8db2d81ca65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:37:05.334092 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=100 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:37:05.388557 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1454/2906] 10.222.0.46 () {58 vars in 957 bytes} [Wed Jun 22 10:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:37:05.399343 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb0c39-4476-4863-8712-15f746e4c894 admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:37:05.400962 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-19bb0c39-4476-4863-8712-15f746e4c894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:37:05.469091 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb0c39-4476-4863-8712-15f746e4c894 admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:37:05.473478 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d7b04-6055-4380-be29-3b12dbe36d8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:37:05.474146 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d7b04-6055-4380-be29-3b12dbe36d8d service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:05.474427 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d7b04-6055-4380-be29-3b12dbe36d8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:05.474704 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d7b04-6055-4380-be29-3b12dbe36d8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:05.486408 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d7b04-6055-4380-be29-3b12dbe36d8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:37:05.487853 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d7b04-6055-4380-be29-3b12dbe36d8d service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:37:05.500734 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1453/2907] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:37:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:37:05.803805 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a0d8e-9f38-47ae-8b24-d8db2d81ca65 None None] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:37:05.807834 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-fe8a0d8e-9f38-47ae-8b24-d8db2d81ca65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:37:05.820367 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a0d8e-9f38-47ae-8b24-d8db2d81ca65 None None] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:37:05.825606 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab8262-7395-4a6c-9f8b-b6a21c266858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:37:05.827102 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab8262-7395-4a6c-9f8b-b6a21c266858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:05.827102 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab8262-7395-4a6c-9f8b-b6a21c266858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:05.827310 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab8262-7395-4a6c-9f8b-b6a21c266858 admin admin] PATH_INFO: `/v3/projects/95ce4ff3b62f4bc0a7afc77dde603bd0` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:05.828510 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeab8262-7395-4a6c-9f8b-b6a21c266858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95ce4ff3b62f4bc0a7afc77dde603bd0)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:37:05.830540 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeab8262-7395-4a6c-9f8b-b6a21c266858 admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:37:05.980319 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-aeab8262-7395-4a6c-9f8b-b6a21c266858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95ce4ff3b62f4bc0a7afc77dde603bd0', 'request_id': 'req-aeab8262-7395-4a6c-9f8b-b6a21c266858'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:05.986504 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-aeab8262-7395-4a6c-9f8b-b6a21c266858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95ce4ff3b62f4bc0a7afc77dde603bd0', 'request_id': 'req-aeab8262-7395-4a6c-9f8b-b6a21c266858'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:06.082017 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-aeab8262-7395-4a6c-9f8b-b6a21c266858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95ce4ff3b62f4bc0a7afc77dde603bd0', 'request_id': 'req-aeab8262-7395-4a6c-9f8b-b6a21c266858'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:06.094475 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-aeab8262-7395-4a6c-9f8b-b6a21c266858 admin admin] The token cache is being invalidate because project 95ce4ff3b62f4bc0a7afc77dde603bd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:37:06.094760 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-aeab8262-7395-4a6c-9f8b-b6a21c266858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:06.095840 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-aeab8262-7395-4a6c-9f8b-b6a21c266858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:37:06.096955 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1455/2908] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:37:05 2022] DELETE /identity/v3/projects/95ce4ff3b62f4bc0a7afc77dde603bd0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:37:12.729326 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d7b04-6055-4380-be29-3b12dbe36d8d service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:37:12.730808 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-5c8d7b04-6055-4380-be29-3b12dbe36d8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:37:12.741878 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d7b04-6055-4380-be29-3b12dbe36d8d service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:37:12.792535 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0b82b-a610-472c-9912-02e90d3888f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:37:12.793228 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0b82b-a610-472c-9912-02e90d3888f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:12.793513 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0b82b-a610-472c-9912-02e90d3888f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:12.793789 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0b82b-a610-472c-9912-02e90d3888f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:12.795600 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-0bd0b82b-a610-472c-9912-02e90d3888f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:37:12.806197 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0b82b-a610-472c-9912-02e90d3888f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:37:12.808188 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0b82b-a610-472c-9912-02e90d3888f8 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:37:12.817131 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1454/2909] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:37:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:37:13.122098 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab8262-7395-4a6c-9f8b-b6a21c266858 admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:37:13.124133 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-aeab8262-7395-4a6c-9f8b-b6a21c266858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:37:13.137513 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab8262-7395-4a6c-9f8b-b6a21c266858 admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:37:13.141392 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551d2db-ba8f-4243-bfd3-31ccbec0dbb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:37:13.142045 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551d2db-ba8f-4243-bfd3-31ccbec0dbb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:13.142334 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551d2db-ba8f-4243-bfd3-31ccbec0dbb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:13.142619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551d2db-ba8f-4243-bfd3-31ccbec0dbb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:13.144441 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-f551d2db-ba8f-4243-bfd3-31ccbec0dbb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:37:13.155203 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551d2db-ba8f-4243-bfd3-31ccbec0dbb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:37:13.156662 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551d2db-ba8f-4243-bfd3-31ccbec0dbb5 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:37:13.165480 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1456/2910] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:37:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:37:13.250650 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0b82b-a610-472c-9912-02e90d3888f8 service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:37:13.259364 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0b82b-a610-472c-9912-02e90d3888f8 service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:37:13.263915 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67091401-2090-4e1f-9559-73163cccba79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:37:13.264594 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67091401-2090-4e1f-9559-73163cccba79 service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:37:13.264903 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67091401-2090-4e1f-9559-73163cccba79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:37:13.265183 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67091401-2090-4e1f-9559-73163cccba79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:37:13.266965 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-67091401-2090-4e1f-9559-73163cccba79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:37:13.332966 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:37:13.336708 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67091401-2090-4e1f-9559-73163cccba79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:37:13.338709 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67091401-2090-4e1f-9559-73163cccba79 service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:37:13.349643 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1455/2911] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:37:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:37:23.161556 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:37:23.424764 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=3 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:39:08.279940 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551d2db-ba8f-4243-bfd3-31ccbec0dbb5 service neutron] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:39:08.281408 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-f551d2db-ba8f-4243-bfd3-31ccbec0dbb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:39:08.292518 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551d2db-ba8f-4243-bfd3-31ccbec0dbb5 service neutron] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:39:08.296265 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad05ff-08ad-43c2-ab3e-69e755459ea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:39:08.296967 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad05ff-08ad-43c2-ab3e-69e755459ea1 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:39:08.297260 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad05ff-08ad-43c2-ab3e-69e755459ea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:39:08.297554 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad05ff-08ad-43c2-ab3e-69e755459ea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:39:08.299398 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-d4ad05ff-08ad-43c2-ab3e-69e755459ea1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:39:08.357364 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad05ff-08ad-43c2-ab3e-69e755459ea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:39:08.358805 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad05ff-08ad-43c2-ab3e-69e755459ea1 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:39:08.367732 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1457/2912] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:39:08 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:39:09.739540 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67091401-2090-4e1f-9559-73163cccba79 service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:39:09.748983 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67091401-2090-4e1f-9559-73163cccba79 service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:39:09.753906 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f80a9-0411-4226-b2e1-a516063cc6ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:39:09.754649 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f80a9-0411-4226-b2e1-a516063cc6ef service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:39:09.755002 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f80a9-0411-4226-b2e1-a516063cc6ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:39:09.755349 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f80a9-0411-4226-b2e1-a516063cc6ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:39:09.758733 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-d63f80a9-0411-4226-b2e1-a516063cc6ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:39:09.774669 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f80a9-0411-4226-b2e1-a516063cc6ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:39:09.776151 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f80a9-0411-4226-b2e1-a516063cc6ef service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:39:09.788339 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1456/2913] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:39:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:39:10.982189 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad05ff-08ad-43c2-ab3e-69e755459ea1 service neutron] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:39:10.991255 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad05ff-08ad-43c2-ab3e-69e755459ea1 service neutron] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:39:10.994921 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ded373-a90e-40e6-866d-38403657b848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:39:10.995566 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ded373-a90e-40e6-866d-38403657b848 service neutron] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:39:10.995853 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ded373-a90e-40e6-866d-38403657b848 service neutron] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:39:10.996133 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ded373-a90e-40e6-866d-38403657b848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:39:10.998078 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-84ded373-a90e-40e6-866d-38403657b848 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:39:11.012150 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ded373-a90e-40e6-866d-38403657b848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:39:11.014020 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ded373-a90e-40e6-866d-38403657b848 service neutron] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:39:11.025764 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1458/2914] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:39:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:39:14.713004 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f80a9-0411-4226-b2e1-a516063cc6ef service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:39:14.721766 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f80a9-0411-4226-b2e1-a516063cc6ef service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:39:14.725390 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa98313-4386-4cfa-bebe-81ac2351465e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0bddc02875304e8c92ac367c8095efee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:39:14.726573 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa98313-4386-4cfa-bebe-81ac2351465e service neutron] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:39:14.726919 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa98313-4386-4cfa-bebe-81ac2351465e service neutron] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:39:14.727203 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa98313-4386-4cfa-bebe-81ac2351465e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:39:14.729033 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-4aa98313-4386-4cfa-bebe-81ac2351465e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:39:14.805195 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa98313-4386-4cfa-bebe-81ac2351465e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:39:14.806634 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa98313-4386-4cfa-bebe-81ac2351465e service neutron] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:39:14.817081 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1457/2915] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:39:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:39:21.020149 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=34 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:39:21.974047 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ded373-a90e-40e6-866d-38403657b848 service neutron] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:39:21.975652 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-84ded373-a90e-40e6-866d-38403657b848 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:39:22.049437 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ded373-a90e-40e6-866d-38403657b848 service neutron] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:39:22.055159 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057c8a8-6e1f-42af-9677-77f6806be983 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '675892a676054b4f86f9ac12d95f4f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:39:22.055806 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057c8a8-6e1f-42af-9677-77f6806be983 service placement] REQUEST_METHOD: `GET` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:39:22.056117 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057c8a8-6e1f-42af-9677-77f6806be983 service placement] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:39:22.056392 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057c8a8-6e1f-42af-9677-77f6806be983 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:39:22.058222 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-f057c8a8-6e1f-42af-9677-77f6806be983 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:39:22.070846 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057c8a8-6e1f-42af-9677-77f6806be983 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:39:22.072440 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057c8a8-6e1f-42af-9677-77f6806be983 service placement] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:39:22.082770 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1459/2916] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:39:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:39:22.119652 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa98313-4386-4cfa-bebe-81ac2351465e service neutron] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:39:22.121263 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-4aa98313-4386-4cfa-bebe-81ac2351465e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:39:22.133966 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa98313-4386-4cfa-bebe-81ac2351465e service neutron] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:39:22.138955 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885c182-4ad0-4c73-bcd1-80a5e191a23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:39:22.139832 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885c182-4ad0-4c73-bcd1-80a5e191a23a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:39:22.140201 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885c182-4ad0-4c73-bcd1-80a5e191a23a admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:39:22.140485 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885c182-4ad0-4c73-bcd1-80a5e191a23a admin admin] PATH_INFO: `/v3/users/ce996aac321f4f39a4fb8bc759020a6d` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:39:22.141719 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885c182-4ad0-4c73-bcd1-80a5e191a23a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce996aac321f4f39a4fb8bc759020a6d)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:39:22.143653 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885c182-4ad0-4c73-bcd1-80a5e191a23a admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:39:22.333399 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-7885c182-4ad0-4c73-bcd1-80a5e191a23a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce996aac321f4f39a4fb8bc759020a6d'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:39:22.334070 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-7885c182-4ad0-4c73-bcd1-80a5e191a23a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce996aac321f4f39a4fb8bc759020a6d'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:39:22.438322 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-7885c182-4ad0-4c73-bcd1-80a5e191a23a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce996aac321f4f39a4fb8bc759020a6d'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:39:22.451267 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-7885c182-4ad0-4c73-bcd1-80a5e191a23a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce996aac321f4f39a4fb8bc759020a6d'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:39:22.458056 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-7885c182-4ad0-4c73-bcd1-80a5e191a23a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce996aac321f4f39a4fb8bc759020a6d'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:39:22.464082 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1458/2917] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:39:22 2022] DELETE /identity/v3/users/ce996aac321f4f39a4fb8bc759020a6d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:39:22.721036 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057c8a8-6e1f-42af-9677-77f6806be983 service placement] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:39:22.732659 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057c8a8-6e1f-42af-9677-77f6806be983 service placement] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:39:22.792050 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baac86a-5a18-4ba8-810a-02a242eacffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:39:22.792941 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baac86a-5a18-4ba8-810a-02a242eacffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:39:22.793223 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baac86a-5a18-4ba8-810a-02a242eacffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:39:22.793497 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baac86a-5a18-4ba8-810a-02a242eacffe admin admin] PATH_INFO: `/v3/projects/7ed0bebe0a884b0b96282770ef35b22e` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:39:22.794692 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baac86a-5a18-4ba8-810a-02a242eacffe admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ed0bebe0a884b0b96282770ef35b22e)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:39:22.796583 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baac86a-5a18-4ba8-810a-02a242eacffe admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:39:22.885902 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-7baac86a-5a18-4ba8-810a-02a242eacffe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ed0bebe0a884b0b96282770ef35b22e', 'request_id': 'req-7baac86a-5a18-4ba8-810a-02a242eacffe'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:39:22.892877 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-7baac86a-5a18-4ba8-810a-02a242eacffe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ed0bebe0a884b0b96282770ef35b22e', 'request_id': 'req-7baac86a-5a18-4ba8-810a-02a242eacffe'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:39:22.947702 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-7baac86a-5a18-4ba8-810a-02a242eacffe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ed0bebe0a884b0b96282770ef35b22e', 'request_id': 'req-7baac86a-5a18-4ba8-810a-02a242eacffe'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:39:22.958819 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-7baac86a-5a18-4ba8-810a-02a242eacffe admin admin] The token cache is being invalidate because project 7ed0bebe0a884b0b96282770ef35b22e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:39:22.959109 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-7baac86a-5a18-4ba8-810a-02a242eacffe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:39:22.959776 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-7baac86a-5a18-4ba8-810a-02a242eacffe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:39:22.961953 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1460/2918] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:39:22 2022] DELETE /identity/v3/projects/7ed0bebe0a884b0b96282770ef35b22e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:39:22.966158 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885c182-4ad0-4c73-bcd1-80a5e191a23a admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:39:22.967588 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-7885c182-4ad0-4c73-bcd1-80a5e191a23a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:39:22.980965 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885c182-4ad0-4c73-bcd1-80a5e191a23a admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:39:23.029970 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:39:23.039070 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307fc022-3d18-4a6e-9d27-d08f3d10a61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:39:23.050607 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fc022-3d18-4a6e-9d27-d08f3d10a61e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:39:23.050607 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fc022-3d18-4a6e-9d27-d08f3d10a61e admin admin] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:39:23.050607 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fc022-3d18-4a6e-9d27-d08f3d10a61e admin admin] PATH_INFO: `/v3/users/33e8789853a44b7497bad7bc36ac4dbc` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:39:23.050607 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307fc022-3d18-4a6e-9d27-d08f3d10a61e admin admin] RBAC: Authorizing `identity:delete_user(user_id=33e8789853a44b7497bad7bc36ac4dbc)` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:39:23.050607 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307fc022-3d18-4a6e-9d27-d08f3d10a61e admin admin] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:39:23.173698 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-307fc022-3d18-4a6e-9d27-d08f3d10a61e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33e8789853a44b7497bad7bc36ac4dbc'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:39:23.174337 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-307fc022-3d18-4a6e-9d27-d08f3d10a61e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33e8789853a44b7497bad7bc36ac4dbc'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:39:23.221824 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-307fc022-3d18-4a6e-9d27-d08f3d10a61e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33e8789853a44b7497bad7bc36ac4dbc'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:39:23.235524 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-307fc022-3d18-4a6e-9d27-d08f3d10a61e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33e8789853a44b7497bad7bc36ac4dbc'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:39:23.243445 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.notifications [None req-307fc022-3d18-4a6e-9d27-d08f3d10a61e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33e8789853a44b7497bad7bc36ac4dbc'} {{(pid=80500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:39:23.249942 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1459/2919] 10.222.0.46 () {58 vars in 1223 bytes} [Wed Jun 22 10:39:22 2022] DELETE /identity/v3/users/33e8789853a44b7497bad7bc36ac4dbc => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:39:23.509544 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baac86a-5a18-4ba8-810a-02a242eacffe admin admin] Authenticating user token {{(pid=80499) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:39:23.511044 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.fernet_utils [None req-7baac86a-5a18-4ba8-810a-02a242eacffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80499) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:39:23.528215 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baac86a-5a18-4ba8-810a-02a242eacffe admin admin] Validating token access rules against request {{(pid=80499) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:39:23.546925 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:39:23.591054 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7de83-dbc2-4d54-83cc-ea42b7a22f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7691de913843509188548c36ece976', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '40e8688682434d2c9756b8751cda6e48', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80499) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:39:23.591958 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7de83-dbc2-4d54-83cc-ea42b7a22f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:39:23.592238 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7de83-dbc2-4d54-83cc-ea42b7a22f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:39:23.592523 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7de83-dbc2-4d54-83cc-ea42b7a22f7c admin admin] PATH_INFO: `/v3/projects/58cd7ad2902b4741a192535bd1decc81` {{(pid=80499) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:39:23.593769 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7de83-dbc2-4d54-83cc-ea42b7a22f7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=58cd7ad2902b4741a192535bd1decc81)` {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:39:23.595681 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7de83-dbc2-4d54-83cc-ea42b7a22f7c admin admin] RBAC: Authorization granted {{(pid=80499) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:39:23.703980 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-6ed7de83-dbc2-4d54-83cc-ea42b7a22f7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58cd7ad2902b4741a192535bd1decc81', 'request_id': 'req-6ed7de83-dbc2-4d54-83cc-ea42b7a22f7c'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:39:23.711007 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-6ed7de83-dbc2-4d54-83cc-ea42b7a22f7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58cd7ad2902b4741a192535bd1decc81', 'request_id': 'req-6ed7de83-dbc2-4d54-83cc-ea42b7a22f7c'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:39:23.776668 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-6ed7de83-dbc2-4d54-83cc-ea42b7a22f7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58cd7ad2902b4741a192535bd1decc81', 'request_id': 'req-6ed7de83-dbc2-4d54-83cc-ea42b7a22f7c'} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:39:23.788333 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-6ed7de83-dbc2-4d54-83cc-ea42b7a22f7c admin admin] The token cache is being invalidate because project 58cd7ad2902b4741a192535bd1decc81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80499) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:39:23.788619 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-6ed7de83-dbc2-4d54-83cc-ea42b7a22f7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:39:23.789306 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG keystone.notifications [None req-6ed7de83-dbc2-4d54-83cc-ea42b7a22f7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80499) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:39:23.790872 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: [pid: 80499|app: 0|req: 1461/2920] 10.222.0.46 () {58 vars in 1232 bytes} [Wed Jun 22 10:39:23 2022] DELETE /identity/v3/projects/58cd7ad2902b4741a192535bd1decc81 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:39:33.246168 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:39:33.785046 dv-cinder-843277-5-iscsi devstack@keystone.service[80499]: DEBUG dbcounter [-] [80499] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:41:44.038127 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307fc022-3d18-4a6e-9d27-d08f3d10a61e admin admin] Authenticating user token {{(pid=80500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:41:44.039577 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-307fc022-3d18-4a6e-9d27-d08f3d10a61e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:41:44.180324 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307fc022-3d18-4a6e-9d27-d08f3d10a61e admin admin] Validating token access rules against request {{(pid=80500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:41:44.240230 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c56f4-8493-4d13-81d9-d2f107f68a92 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '675892a676054b4f86f9ac12d95f4f5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2bb614e4d7747c1a3fff154c8bc18d9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:41:44.240916 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c56f4-8493-4d13-81d9-d2f107f68a92 service placement] REQUEST_METHOD: `GET` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:41:44.241206 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c56f4-8493-4d13-81d9-d2f107f68a92 service placement] SCRIPT_NAME: `/identity` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:41:44.241488 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c56f4-8493-4d13-81d9-d2f107f68a92 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:41:44.243348 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.fernet_utils [None req-068c56f4-8493-4d13-81d9-d2f107f68a92 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:41:44.255030 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c56f4-8493-4d13-81d9-d2f107f68a92 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:41:44.256597 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c56f4-8493-4d13-81d9-d2f107f68a92 service placement] RBAC: Authorization granted {{(pid=80500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:41:44.266991 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: [pid: 80500|app: 0|req: 1460/2921] 10.222.0.46 () {60 vars in 1365 bytes} [Wed Jun 22 10:41:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:41:54.262574 dv-cinder-843277-5-iscsi devstack@keystone.service[80500]: DEBUG dbcounter [-] [80500] Writing DB stats keystone:SELECT=89 {{(pid=80500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}